Jul 09 01:36:06.880141 ip-10-0-131-181 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 09 01:36:06.880155 ip-10-0-131-181 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 09 01:36:06.880163 ip-10-0-131-181 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 09 01:36:06.880379 ip-10-0-131-181 systemd[1]: Failed to start Kubernetes Kubelet. Jul 09 01:36:16.995769 ip-10-0-131-181 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 09 01:36:16.995792 ip-10-0-131-181 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot cc4ed6dfaa7f4ac79dad47ed6ccce370 -- Jul 09 01:37:47.207495 ip-10-0-131-181 systemd[1]: Starting Kubernetes Kubelet... Jul 09 01:37:47.676949 ip-10-0-131-181 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 01:37:47.676949 ip-10-0-131-181 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 01:37:47.676949 ip-10-0-131-181 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 01:37:47.676949 ip-10-0-131-181 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 01:37:47.676949 ip-10-0-131-181 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 01:37:47.676949 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.665430 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 01:37:47.676949 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672000 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 01:37:47.676949 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672017 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 01:37:47.676949 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672020 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 01:37:47.676949 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672024 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 01:37:47.676949 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672027 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 01:37:47.676949 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672030 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 01:37:47.676949 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672033 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 01:37:47.676949 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672035 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 01:37:47.691792 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672038 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 01:37:47.691792 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672041 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 01:37:47.691792 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672044 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 01:37:47.691792 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672046 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 01:37:47.691792 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672049 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 01:37:47.691792 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672051 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 01:37:47.691792 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672055 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 01:37:47.691792 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672058 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 01:37:47.691792 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672062 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 01:37:47.691792 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672065 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 01:37:47.691792 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672067 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 01:37:47.691792 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672070 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 01:37:47.691792 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672072 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 01:37:47.691792 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672080 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 01:37:47.691792 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672083 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 01:37:47.691792 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672086 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 01:37:47.691792 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672089 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 01:37:47.691792 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672091 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 01:37:47.691792 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672094 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 01:37:47.741936 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672098 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 01:37:47.741936 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672102 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 01:37:47.741936 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672105 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 01:37:47.741936 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672108 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 01:37:47.741936 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672111 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 01:37:47.741936 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672113 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 01:37:47.741936 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672116 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 01:37:47.741936 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672118 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 01:37:47.741936 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672121 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 01:37:47.741936 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672123 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 01:37:47.741936 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672126 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 01:37:47.741936 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672128 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 01:37:47.741936 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672131 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 01:37:47.741936 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672133 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 01:37:47.741936 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672136 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 01:37:47.741936 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672139 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 01:37:47.741936 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672141 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 01:37:47.741936 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672144 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 01:37:47.741936 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672147 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 01:37:47.741936 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672150 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 01:37:47.743221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672152 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 01:37:47.743221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672155 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 01:37:47.743221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672158 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 01:37:47.743221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672160 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 01:37:47.743221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672164 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 01:37:47.743221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672166 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 01:37:47.743221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672169 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 01:37:47.743221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672172 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 01:37:47.743221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672174 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 01:37:47.743221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672177 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 01:37:47.743221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672179 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 01:37:47.743221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672182 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 01:37:47.743221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672187 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 01:37:47.743221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672189 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 01:37:47.743221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672192 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 01:37:47.743221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672196 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 01:37:47.743221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672200 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 01:37:47.743221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672202 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 01:37:47.743221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672206 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 01:37:47.743221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672209 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 01:37:47.742976 ip-10-0-131-181 systemd[1]: Started Kubernetes Kubelet. Jul 09 01:37:48.025909 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672212 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 01:37:48.025909 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672214 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 01:37:48.025909 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672217 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 01:37:48.025909 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672220 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 01:37:48.025909 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672223 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 01:37:48.025909 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672249 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 09 01:37:48.025909 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672253 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 01:37:48.025909 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672256 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 01:37:48.025909 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672259 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 01:37:48.025909 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672261 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 01:37:48.025909 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672265 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 01:37:48.025909 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672268 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 01:37:48.025909 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672271 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 01:37:48.025909 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672273 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 01:37:48.025909 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672276 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 01:37:48.025909 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672279 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 01:37:48.025909 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672283 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 01:37:48.025909 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672285 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 01:37:48.025909 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672289 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 01:37:48.025909 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672292 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 01:37:48.043941 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672295 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 01:37:48.043941 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672297 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 01:37:48.043941 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672300 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 01:37:48.043941 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672303 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 01:37:48.043941 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672307 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 01:37:48.043941 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672309 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 01:37:48.043941 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672313 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 01:37:48.043941 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672316 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 01:37:48.043941 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672320 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 01:37:48.043941 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672322 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 01:37:48.043941 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672325 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 01:37:48.043941 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.672328 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 01:37:48.043941 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673047 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 01:37:48.043941 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673054 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 01:37:48.043941 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673057 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 01:37:48.043941 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673060 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 01:37:48.043941 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673064 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 01:37:48.043941 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673066 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 01:37:48.043941 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673069 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 01:37:48.048874 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673073 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 01:37:48.048874 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673076 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 01:37:48.048874 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673079 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 01:37:48.048874 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673082 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 09 01:37:48.048874 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673084 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 01:37:48.048874 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673087 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 01:37:48.048874 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673089 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 01:37:48.048874 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673092 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 01:37:48.048874 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673095 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 01:37:48.048874 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673098 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 01:37:48.048874 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673102 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 01:37:48.048874 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673104 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 01:37:48.048874 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673107 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 01:37:48.048874 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673109 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 01:37:48.048874 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673112 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 01:37:48.048874 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673115 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 01:37:48.048874 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673117 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 01:37:48.048874 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673122 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 01:37:48.048874 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673125 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 01:37:48.048874 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673127 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 01:37:48.051934 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673130 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 01:37:48.051934 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673132 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 01:37:48.051934 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673135 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 01:37:48.051934 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673137 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 01:37:48.051934 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673140 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 01:37:48.051934 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673142 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 01:37:48.051934 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673145 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 01:37:48.051934 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673148 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 01:37:48.051934 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673151 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 01:37:48.051934 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673153 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 01:37:48.051934 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673156 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 01:37:48.051934 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673159 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 01:37:48.051934 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673161 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 01:37:48.051934 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673163 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 01:37:48.051934 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673166 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 01:37:48.051934 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673168 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 01:37:48.051934 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673171 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 01:37:48.051934 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673173 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 01:37:48.051934 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673176 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 01:37:48.051934 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673178 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 01:37:48.055023 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673181 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 01:37:48.055023 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673183 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 01:37:48.055023 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673185 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 01:37:48.055023 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673189 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 01:37:48.055023 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673191 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 01:37:48.055023 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673194 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 01:37:48.055023 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673196 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 01:37:48.055023 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673199 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 01:37:48.055023 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673201 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 01:37:48.055023 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673206 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 01:37:48.055023 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673209 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 01:37:48.055023 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673211 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 01:37:48.055023 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673214 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 01:37:48.055023 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673216 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 01:37:48.055023 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673219 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 01:37:48.055023 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673222 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 01:37:48.055023 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673224 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 01:37:48.055023 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673227 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 01:37:48.055023 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673248 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 01:37:48.057299 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673256 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 01:37:48.057299 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673262 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 01:37:48.057299 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673266 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 01:37:48.057299 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673268 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 01:37:48.057299 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673271 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 01:37:48.057299 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673274 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 01:37:48.057299 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673277 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 01:37:48.057299 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673280 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 01:37:48.057299 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673283 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 01:37:48.057299 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673286 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 01:37:48.057299 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673288 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 01:37:48.057299 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673291 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 01:37:48.057299 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673296 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 01:37:48.057299 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673299 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 01:37:48.057299 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673302 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 01:37:48.057299 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673304 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 01:37:48.057299 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673307 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 01:37:48.057299 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673310 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 01:37:48.057299 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673312 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 01:37:48.059213 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673315 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 01:37:48.059213 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673317 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 01:37:48.059213 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673320 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 01:37:48.059213 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673325 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 01:37:48.059213 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673329 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 01:37:48.059213 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673332 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 01:37:48.059213 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673334 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 01:37:48.059213 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673338 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 01:37:48.059213 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673340 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 01:37:48.059213 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673343 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 01:37:48.059213 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673345 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 01:37:48.059213 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673348 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 01:37:48.059213 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673351 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 01:37:48.059213 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673353 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 01:37:48.059213 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673803 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 01:37:48.059213 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673809 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 01:37:48.059213 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673812 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 01:37:48.059213 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673816 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 01:37:48.059213 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673819 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 01:37:48.060779 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673822 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 01:37:48.060779 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673825 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 01:37:48.060779 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673828 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 01:37:48.060779 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673831 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 01:37:48.060779 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673834 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 01:37:48.060779 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673837 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 01:37:48.060779 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673840 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 01:37:48.060779 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673843 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 01:37:48.060779 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673845 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 01:37:48.060779 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673848 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 01:37:48.060779 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673850 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 01:37:48.060779 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673854 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 01:37:48.060779 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673857 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 01:37:48.060779 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673860 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 01:37:48.060779 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673864 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 01:37:48.060779 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673867 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 01:37:48.060779 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673871 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 01:37:48.060779 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673874 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 01:37:48.060779 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673876 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 01:37:48.060779 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673879 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 01:37:48.061453 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673882 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 01:37:48.061453 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673884 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 01:37:48.061453 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673887 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 01:37:48.061453 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673889 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 01:37:48.061453 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673892 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 01:37:48.061453 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673896 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 01:37:48.061453 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673900 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 01:37:48.061453 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673903 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 01:37:48.061453 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673905 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 01:37:48.061453 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673908 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 01:37:48.061453 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673910 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 01:37:48.061453 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673912 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 01:37:48.061453 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673915 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 01:37:48.061453 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673918 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 01:37:48.061453 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673920 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 01:37:48.061453 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673923 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 01:37:48.061453 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673925 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 01:37:48.061453 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673927 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 01:37:48.061453 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673930 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 01:37:48.062185 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673932 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 01:37:48.062185 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673935 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 09 01:37:48.062185 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673937 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 01:37:48.062185 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673940 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 01:37:48.062185 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673942 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 01:37:48.062185 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673945 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 01:37:48.062185 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673947 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 01:37:48.062185 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673952 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 01:37:48.062185 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673955 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 01:37:48.062185 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673958 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 01:37:48.062185 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673961 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 01:37:48.062185 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673964 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 01:37:48.062185 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673967 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 01:37:48.062185 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673969 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 01:37:48.062185 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673972 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 01:37:48.062185 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673974 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 01:37:48.062185 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673977 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 01:37:48.062185 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673980 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 01:37:48.062185 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673982 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 01:37:48.062185 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673985 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 01:37:48.062878 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673987 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 01:37:48.062878 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673990 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 01:37:48.062878 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673992 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 01:37:48.062878 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673995 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 01:37:48.062878 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.673997 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 01:37:48.062878 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674000 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 01:37:48.062878 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674002 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 01:37:48.062878 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674005 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 01:37:48.062878 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674007 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 01:37:48.062878 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674009 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 01:37:48.062878 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674012 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 01:37:48.062878 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674014 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 01:37:48.062878 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674017 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 01:37:48.062878 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674021 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 01:37:48.062878 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674023 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 01:37:48.062878 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674026 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 01:37:48.062878 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674029 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 01:37:48.062878 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674031 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 01:37:48.062878 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674034 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 01:37:48.062878 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674038 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 01:37:48.063557 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674040 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 01:37:48.063557 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674044 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 01:37:48.063557 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674048 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 01:37:48.063557 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674053 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 01:37:48.063557 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674056 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 01:37:48.063557 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674059 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 01:37:48.063557 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674062 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 01:37:48.063557 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674064 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 01:37:48.063557 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674067 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 01:37:48.063557 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674070 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 01:37:48.063557 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674072 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 01:37:48.063557 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674075 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 01:37:48.063557 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674078 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 01:37:48.063557 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674083 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 01:37:48.063557 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.674086 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 01:37:48.063557 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.674169 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 01:37:48.063557 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675575 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 01:37:48.063557 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675590 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 01:37:48.063557 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675594 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 01:37:48.063557 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675599 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 01:37:48.064274 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675602 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 01:37:48.064274 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675607 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 01:37:48.064274 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675611 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 01:37:48.064274 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675615 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 01:37:48.064274 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675618 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 01:37:48.064274 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675622 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 01:37:48.064274 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675626 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 01:37:48.064274 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675629 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 01:37:48.064274 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675632 2564 flags.go:64] FLAG: --cgroup-root="" Jul 09 01:37:48.064274 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675634 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 01:37:48.064274 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675638 2564 flags.go:64] FLAG: --client-ca-file="" Jul 09 01:37:48.064274 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675641 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 09 01:37:48.064274 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675644 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 01:37:48.064274 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675649 2564 flags.go:64] FLAG: --cluster-domain="" Jul 09 01:37:48.064274 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675652 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 01:37:48.064274 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675655 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 01:37:48.064274 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675658 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 01:37:48.064274 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675662 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 01:37:48.064274 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675666 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 01:37:48.064274 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675669 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 01:37:48.064274 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675672 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 01:37:48.064274 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675675 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 01:37:48.064274 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675678 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 09 01:37:48.064274 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675683 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 01:37:48.064976 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675688 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 01:37:48.064976 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675693 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 01:37:48.064976 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675699 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 01:37:48.064976 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675706 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 01:37:48.064976 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675711 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 01:37:48.064976 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675715 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 01:37:48.064976 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675719 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 01:37:48.064976 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675723 2564 flags.go:64] FLAG: --enable-server="true" Jul 09 01:37:48.064976 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675727 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 01:37:48.064976 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675734 2564 flags.go:64] FLAG: --event-burst="100" Jul 09 01:37:48.064976 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675738 2564 flags.go:64] FLAG: --event-qps="50" Jul 09 01:37:48.064976 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675741 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 01:37:48.064976 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675745 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 01:37:48.064976 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675749 2564 flags.go:64] FLAG: --eviction-hard="" Jul 09 01:37:48.064976 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675755 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 01:37:48.064976 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675759 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 01:37:48.064976 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675763 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 01:37:48.064976 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675767 2564 flags.go:64] FLAG: --eviction-soft="" Jul 09 01:37:48.064976 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675771 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 01:37:48.064976 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675774 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 01:37:48.064976 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675781 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 01:37:48.064976 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675785 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 01:37:48.064976 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675790 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 01:37:48.064976 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675794 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 01:37:48.064976 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675798 2564 flags.go:64] FLAG: --feature-gates="" Jul 09 01:37:48.065868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675804 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 01:37:48.065868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675808 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 01:37:48.065868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675812 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 01:37:48.065868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675816 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 01:37:48.065868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675821 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 09 01:37:48.065868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675825 2564 flags.go:64] FLAG: --help="false" Jul 09 01:37:48.065868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675829 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-131-181.ec2.internal" Jul 09 01:37:48.065868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675833 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 01:37:48.065868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675837 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 01:37:48.065868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675843 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 01:37:48.065868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675847 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 01:37:48.065868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675852 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 01:37:48.065868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675856 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 01:37:48.065868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675860 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 01:37:48.065868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675864 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 01:37:48.065868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675868 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 01:37:48.065868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675873 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 01:37:48.065868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675878 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 01:37:48.065868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675882 2564 flags.go:64] FLAG: --kube-reserved="" Jul 09 01:37:48.065868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675887 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 01:37:48.065868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675892 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 01:37:48.065868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675897 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 01:37:48.065868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675901 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 01:37:48.065868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675906 2564 flags.go:64] FLAG: --lock-file="" Jul 09 01:37:48.066810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675910 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 01:37:48.066810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675915 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 01:37:48.066810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675920 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 01:37:48.066810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675927 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 01:37:48.066810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675933 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 01:37:48.066810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675938 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 01:37:48.066810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675942 2564 flags.go:64] FLAG: --logging-format="text" Jul 09 01:37:48.066810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675947 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 01:37:48.066810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675952 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 01:37:48.066810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675956 2564 flags.go:64] FLAG: --manifest-url="" Jul 09 01:37:48.066810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675961 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 09 01:37:48.066810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675967 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 01:37:48.066810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675973 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 01:37:48.066810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675979 2564 flags.go:64] FLAG: --max-pods="110" Jul 09 01:37:48.066810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675984 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 01:37:48.066810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675988 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 01:37:48.066810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675993 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 01:37:48.066810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.675999 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 01:37:48.066810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676004 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 01:37:48.066810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676009 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 01:37:48.066810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676014 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 01:37:48.066810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676025 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 01:37:48.066810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676030 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 01:37:48.066810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676035 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 01:37:48.066810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676041 2564 flags.go:64] FLAG: --pod-cidr="" Jul 09 01:37:48.067516 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676047 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 09 01:37:48.067516 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676055 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 01:37:48.067516 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676060 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 01:37:48.067516 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676064 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 09 01:37:48.067516 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676069 2564 flags.go:64] FLAG: --port="10250" Jul 09 01:37:48.067516 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676074 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 01:37:48.067516 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676078 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-030a5e19a1829db50" Jul 09 01:37:48.067516 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676083 2564 flags.go:64] FLAG: --qos-reserved="" Jul 09 01:37:48.067516 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676088 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 09 01:37:48.067516 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676092 2564 flags.go:64] FLAG: --register-node="true" Jul 09 01:37:48.067516 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676097 2564 flags.go:64] FLAG: --register-with-taints="" Jul 09 01:37:48.067516 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676103 2564 flags.go:64] FLAG: --registry-burst="10" Jul 09 01:37:48.067516 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676110 2564 flags.go:64] FLAG: --registry-qps="5" Jul 09 01:37:48.067516 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676115 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 09 01:37:48.067516 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676119 2564 flags.go:64] FLAG: --reserved-memory="" Jul 09 01:37:48.067516 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676125 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 01:37:48.067516 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676130 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 01:37:48.067516 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676135 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 01:37:48.067516 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676139 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 01:37:48.067516 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676143 2564 flags.go:64] FLAG: --runonce="false" Jul 09 01:37:48.067516 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676148 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 01:37:48.067516 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676153 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 01:37:48.067516 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676158 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 09 01:37:48.067516 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676162 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 01:37:48.067516 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676167 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 01:37:48.068220 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676173 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 01:37:48.068220 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676178 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 01:37:48.068220 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676183 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 01:37:48.068220 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676188 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 01:37:48.068220 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676192 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 01:37:48.068220 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676196 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 01:37:48.068220 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676204 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 01:37:48.068220 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676209 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 01:37:48.068220 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676213 2564 flags.go:64] FLAG: --system-cgroups="" Jul 09 01:37:48.068220 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676217 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 01:37:48.068220 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676225 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 01:37:48.068220 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676244 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 09 01:37:48.068220 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676249 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 01:37:48.068220 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676256 2564 flags.go:64] FLAG: --tls-min-version="" Jul 09 01:37:48.068220 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676260 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 01:37:48.068220 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676265 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 01:37:48.068220 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676269 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 01:37:48.068220 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676274 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 01:37:48.068220 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676279 2564 flags.go:64] FLAG: --v="2" Jul 09 01:37:48.068220 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676285 2564 flags.go:64] FLAG: --version="false" Jul 09 01:37:48.068220 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676292 2564 flags.go:64] FLAG: --vmodule="" Jul 09 01:37:48.068220 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676298 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 01:37:48.068220 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.676305 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 01:37:48.068220 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676470 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 01:37:48.068220 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676476 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 01:37:48.068912 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676480 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 01:37:48.068912 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676485 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 01:37:48.068912 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676490 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 01:37:48.068912 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676495 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 01:37:48.068912 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676499 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 01:37:48.068912 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676504 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 01:37:48.068912 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676509 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 01:37:48.068912 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676515 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 01:37:48.068912 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676519 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 01:37:48.068912 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676524 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 01:37:48.068912 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676528 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 01:37:48.068912 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676532 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 01:37:48.068912 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676536 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 01:37:48.068912 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676541 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 01:37:48.068912 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676546 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 01:37:48.068912 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676550 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 01:37:48.068912 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676554 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 01:37:48.068912 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676558 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 01:37:48.068912 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676564 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 01:37:48.068912 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676568 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 01:37:48.069613 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676572 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 01:37:48.069613 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676576 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 01:37:48.069613 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676582 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 01:37:48.069613 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676588 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 01:37:48.069613 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676592 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 01:37:48.069613 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676597 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 01:37:48.069613 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676601 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 01:37:48.069613 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676605 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 01:37:48.069613 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676610 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 01:37:48.069613 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676614 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 01:37:48.069613 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676618 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 01:37:48.069613 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676622 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 01:37:48.069613 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676626 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 01:37:48.069613 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676629 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 01:37:48.069613 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676633 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 01:37:48.069613 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676637 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 01:37:48.069613 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676641 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 01:37:48.069613 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676645 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 01:37:48.069613 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676648 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 01:37:48.069613 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676654 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 01:37:48.075521 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676658 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 01:37:48.075521 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676662 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 01:37:48.075521 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676665 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 01:37:48.075521 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676669 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 01:37:48.075521 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676674 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 01:37:48.075521 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676682 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 01:37:48.075521 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676688 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 01:37:48.075521 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676694 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 01:37:48.075521 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676698 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 01:37:48.075521 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676703 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 01:37:48.075521 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676707 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 01:37:48.075521 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676711 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 01:37:48.075521 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676715 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 01:37:48.075521 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676720 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 01:37:48.075521 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676724 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 01:37:48.075521 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676728 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 01:37:48.075521 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676732 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 01:37:48.075521 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676736 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 01:37:48.075521 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676740 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 01:37:48.076221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676743 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 01:37:48.076221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676747 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 09 01:37:48.076221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676752 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 01:37:48.076221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676756 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 01:37:48.076221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676760 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 01:37:48.076221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676764 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 01:37:48.076221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676768 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 01:37:48.076221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676772 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 01:37:48.076221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676776 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 01:37:48.076221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676780 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 01:37:48.076221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676784 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 01:37:48.076221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676788 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 01:37:48.076221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676793 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 01:37:48.076221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676797 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 01:37:48.076221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676801 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 01:37:48.076221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676805 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 01:37:48.076221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676809 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 01:37:48.076221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676814 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 01:37:48.076221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676819 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 01:37:48.076221 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676823 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 01:37:48.082990 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676828 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 01:37:48.082990 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676832 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 01:37:48.082990 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676836 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 01:37:48.082990 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676839 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 01:37:48.082990 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676843 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 01:37:48.082990 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676847 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 01:37:48.082990 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676851 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 01:37:48.082990 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676856 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 01:37:48.082990 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676860 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 01:37:48.082990 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676863 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 01:37:48.082990 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676867 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 01:37:48.082990 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676871 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 01:37:48.082990 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676875 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 01:37:48.082990 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676878 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 01:37:48.082990 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676882 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 01:37:48.082990 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676887 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 01:37:48.082990 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676891 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 01:37:48.082990 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.676895 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 01:37:48.083679 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.677597 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 01:37:48.083679 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.684658 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 09 01:37:48.083679 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.684674 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 01:37:48.083679 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.684697 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 01:37:48.083679 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.684703 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 01:37:48.083679 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684777 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 01:37:48.083679 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684782 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 01:37:48.083679 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684786 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 01:37:48.083679 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684789 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 01:37:48.083679 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684793 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 01:37:48.083679 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684796 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 01:37:48.083679 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684798 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 01:37:48.083679 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684802 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 01:37:48.083679 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684805 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 01:37:48.083679 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684807 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 01:37:48.084158 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684810 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 01:37:48.084158 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684813 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 01:37:48.084158 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684816 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 01:37:48.084158 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684818 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 01:37:48.084158 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684821 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 01:37:48.084158 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684824 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 01:37:48.084158 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684827 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 01:37:48.084158 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684830 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 01:37:48.084158 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684832 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 09 01:37:48.084158 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684835 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 01:37:48.084158 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684837 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 01:37:48.084158 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684840 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 01:37:48.084158 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684842 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 01:37:48.084158 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684845 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 01:37:48.084158 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684847 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 01:37:48.084158 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684850 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 01:37:48.084158 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684852 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 01:37:48.084158 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684855 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 01:37:48.084158 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684857 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 01:37:48.084158 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684861 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 01:37:48.084858 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684864 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 01:37:48.084858 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684867 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 01:37:48.084858 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684870 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 01:37:48.084858 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684874 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 01:37:48.084858 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684878 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 01:37:48.084858 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684881 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 01:37:48.084858 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684884 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 01:37:48.084858 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684887 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 01:37:48.084858 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684890 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 01:37:48.084858 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684893 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 01:37:48.084858 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684896 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 01:37:48.084858 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684899 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 01:37:48.084858 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684901 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 01:37:48.084858 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684904 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 01:37:48.084858 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684907 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 01:37:48.084858 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684910 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 01:37:48.084858 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684912 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 01:37:48.084858 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684915 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 01:37:48.084858 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684919 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 01:37:48.084858 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684923 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 01:37:48.085554 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684926 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 01:37:48.085554 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684929 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 01:37:48.085554 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684932 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 01:37:48.085554 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684935 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 01:37:48.085554 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684937 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 01:37:48.085554 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684940 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 01:37:48.085554 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684943 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 01:37:48.085554 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684947 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 01:37:48.085554 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684950 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 01:37:48.085554 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684953 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 01:37:48.085554 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684956 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 01:37:48.085554 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684959 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 01:37:48.085554 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684962 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 01:37:48.085554 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684966 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 01:37:48.085554 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684969 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 01:37:48.085554 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684972 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 01:37:48.085554 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684975 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 01:37:48.085554 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684978 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 01:37:48.085554 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684981 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 01:37:48.087888 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684983 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 01:37:48.087888 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684986 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 01:37:48.087888 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684989 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 01:37:48.087888 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684991 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 01:37:48.087888 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684994 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 01:37:48.087888 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684996 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 01:37:48.087888 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.684999 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 01:37:48.087888 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685002 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 01:37:48.087888 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685005 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 01:37:48.087888 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685008 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 01:37:48.087888 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685011 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 01:37:48.087888 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685013 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 01:37:48.087888 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685017 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 01:37:48.087888 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685020 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 01:37:48.087888 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685023 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 01:37:48.087888 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685025 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 01:37:48.087888 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685028 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 01:37:48.087888 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685031 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 01:37:48.087888 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685033 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 01:37:48.087888 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685036 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 01:37:48.090085 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685039 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 01:37:48.090085 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685042 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 01:37:48.090085 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685044 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 01:37:48.090085 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685047 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 01:37:48.090085 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685049 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 01:37:48.090085 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685052 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 01:37:48.090085 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685055 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 01:37:48.090085 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685057 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 01:37:48.090085 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685060 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 01:37:48.090085 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685063 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 01:37:48.090085 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.685068 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 01:37:48.090085 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685180 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 01:37:48.090085 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685185 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 01:37:48.090085 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685188 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 01:37:48.090085 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685191 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 01:37:48.090787 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685194 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 01:37:48.090787 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685197 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 01:37:48.090787 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685200 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 01:37:48.090787 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685202 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 01:37:48.090787 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685205 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 01:37:48.090787 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685207 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 01:37:48.090787 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685210 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 01:37:48.090787 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685212 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 01:37:48.090787 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685215 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 01:37:48.090787 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685217 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 01:37:48.090787 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685221 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 01:37:48.090787 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685225 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 01:37:48.090787 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685228 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 01:37:48.090787 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685250 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 01:37:48.090787 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685253 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 01:37:48.090787 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685256 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 01:37:48.090787 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685259 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 01:37:48.090787 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685262 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 01:37:48.090787 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685265 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 01:37:48.090787 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685268 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 01:37:48.091496 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685270 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 01:37:48.091496 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685273 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 01:37:48.091496 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685276 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 01:37:48.091496 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685278 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 01:37:48.091496 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685282 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 01:37:48.091496 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685284 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 01:37:48.091496 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685287 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 01:37:48.091496 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685290 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 01:37:48.091496 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685293 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 01:37:48.091496 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685296 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 01:37:48.091496 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685298 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 01:37:48.091496 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685301 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 01:37:48.091496 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685304 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 01:37:48.091496 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685306 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 01:37:48.091496 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685309 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 01:37:48.091496 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685311 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 01:37:48.091496 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685314 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 01:37:48.091496 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685316 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 01:37:48.091496 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685319 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 01:37:48.092193 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685321 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 01:37:48.092193 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685324 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 01:37:48.092193 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685327 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 01:37:48.092193 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685329 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 01:37:48.092193 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685332 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 01:37:48.092193 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685334 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 01:37:48.092193 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685337 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 01:37:48.092193 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685340 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 01:37:48.092193 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685346 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 01:37:48.092193 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685349 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 01:37:48.092193 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685351 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 01:37:48.092193 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685354 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 01:37:48.092193 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685357 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 01:37:48.092193 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685360 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 01:37:48.092193 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685362 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 01:37:48.092193 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685365 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 01:37:48.092193 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685367 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 01:37:48.092193 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685370 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 01:37:48.092193 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685373 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 01:37:48.092193 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685375 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 01:37:48.092927 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685378 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 01:37:48.092927 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685380 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 01:37:48.092927 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685383 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 01:37:48.092927 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685385 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 01:37:48.092927 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685388 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 01:37:48.092927 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685391 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 01:37:48.092927 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685393 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 01:37:48.092927 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685396 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 01:37:48.092927 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685398 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 01:37:48.092927 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685401 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 09 01:37:48.092927 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685403 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 01:37:48.092927 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685406 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 01:37:48.092927 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685409 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 01:37:48.092927 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685412 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 01:37:48.092927 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685415 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 01:37:48.092927 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685418 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 01:37:48.092927 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685421 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 01:37:48.092927 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685424 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 01:37:48.092927 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685427 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 01:37:48.092927 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685432 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 01:37:48.093598 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685436 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 01:37:48.093598 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685439 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 01:37:48.093598 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685441 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 01:37:48.093598 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685444 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 01:37:48.093598 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685447 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 01:37:48.093598 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685449 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 01:37:48.093598 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685452 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 01:37:48.093598 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685454 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 01:37:48.093598 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685457 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 01:37:48.093598 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685460 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 01:37:48.093598 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685462 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 01:37:48.093598 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685467 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 01:37:48.093598 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685471 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 01:37:48.093598 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685474 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 01:37:48.093598 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685477 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 01:37:48.093598 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:47.685479 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 01:37:48.154280 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.685485 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 01:37:48.154280 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.685589 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 01:37:48.154280 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.687909 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 01:37:48.154280 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.689662 2564 server.go:1019] "Starting client certificate rotation" Jul 09 01:37:48.154280 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.689766 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 01:37:48.154280 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.689801 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 01:37:48.154280 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.693249 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 01:37:48.154280 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.695186 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 01:37:48.154280 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.706454 2564 log.go:25] "Validated CRI v1 runtime API" Jul 09 01:37:48.154280 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.709483 2564 log.go:25] "Validated CRI v1 image API" Jul 09 01:37:48.154280 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.711181 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 01:37:48.154280 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.713676 2564 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 85746607-baeb-4f5b-bb8c-35a0871987ff:/dev/nvme0n1p3 f4158281-f225-4584-bcb6-ece5204232a8:/dev/nvme0n1p4] Jul 09 01:37:48.154812 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.713691 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 01:37:48.154812 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.718867 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 01:37:48.155218 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.718883 2564 manager.go:216] Machine: {Timestamp:2026-07-09 01:37:47.717506321 +0000 UTC m=+0.379243803 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098504 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec227d1cc577d7953ab10d47e911b6f6 SystemUUID:ec227d1c-c577-d795-3ab1-0d47e911b6f6 BootID:cc4ed6df-aa7f-4ac7-9dad-47ed6ccce370 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:05:ba:fb:dc:df Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:05:ba:fb:dc:df Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:07:e0:33:c4:35 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 01:37:48.155218 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.718984 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 01:37:48.155218 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.719062 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 01:37:48.155218 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.722346 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 01:37:48.155218 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.722370 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-181.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 01:37:48.155218 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.723175 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 01:37:48.155218 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.723185 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 01:37:48.155218 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.723192 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 01:37:48.155218 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.723206 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 01:37:48.155218 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.725203 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 01:37:48.155218 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.729901 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 09 01:37:48.155218 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.730012 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 01:37:48.155218 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.730038 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 09 01:37:48.155218 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.730056 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 01:37:48.155218 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.730070 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 01:37:48.155218 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.730082 2564 kubelet.go:398] "Adding apiserver pod source" Jul 09 01:37:48.155218 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.730092 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 01:37:48.155218 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.730471 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.730487 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.732903 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.735341 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.735368 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.736752 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.736773 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.736783 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.736790 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.736801 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.736808 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.736817 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.736825 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.736841 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.736847 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.736856 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.736861 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.737774 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.737780 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:47.741399 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-181.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:47.741451 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.741559 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-181.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.741929 2564 server.go:1268] "Started kubelet" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.742017 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.742029 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.742115 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.744323 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.744554 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:47.750732 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:47.751024 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-181.ec2.internal.18c07b5765f90f0d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-181.ec2.internal,UID:ip-10-0-131-181.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-181.ec2.internal,},FirstTimestamp:2026-07-09 01:37:47.741908749 +0000 UTC m=+0.403646231,LastTimestamp:2026-07-09 01:37:47.741908749 +0000 UTC m=+0.403646231,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-181.ec2.internal,}" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.756937 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.756949 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:47.757105 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-181.ec2.internal\" not found" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.757709 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.757727 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.757775 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.757795 2564 factory.go:55] Registering systemd factory Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.757811 2564 factory.go:223] Registration of the systemd container factory successfully Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.757832 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.757840 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.758074 2564 factory.go:153] Registering CRI-O factory Jul 09 01:37:48.155755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.758089 2564 factory.go:223] Registration of the crio container factory successfully Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.758148 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.758184 2564 factory.go:103] Registering Raw factory Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.758198 2564 manager.go:1196] Started watching for new ooms in manager Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.759330 2564 manager.go:349] Starting recovery of all containers Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.768748 2564 manager.go:354] Recovery completed Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:47.769141 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-181.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:47.769322 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.776008 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rgd22" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.778880 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.780670 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-181.ec2.internal" event="NodeHasSufficientMemory" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.780703 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-181.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.780718 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-181.ec2.internal" event="NodeHasSufficientPID" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.781272 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.781282 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.781298 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.781399 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.782011 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rgd22" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.782206 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-181.ec2.internal" event="NodeHasSufficientMemory" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.782303 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-181.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.782315 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-181.ec2.internal" event="NodeHasSufficientPID" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:47.782556 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-181.ec2.internal.18c07b576848bbd7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-181.ec2.internal,UID:ip-10-0-131-181.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-181.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-181.ec2.internal,},FirstTimestamp:2026-07-09 01:37:47.780684759 +0000 UTC m=+0.442422249,LastTimestamp:2026-07-09 01:37:47.780684759 +0000 UTC m=+0.442422249,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-181.ec2.internal,}" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.783503 2564 policy_none.go:49] "None policy: Start" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.783516 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.783526 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.785533 2564 policy_none.go:47] "Start" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.840265 2564 manager.go:337] "Starting Device Plugin manager" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:47.840304 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.840316 2564 server.go:87] "Starting device plugin registration server" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.840549 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.840558 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.840645 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.840751 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.840761 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:47.841389 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:47.841442 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-181.ec2.internal\" not found" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.858894 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.860056 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.860089 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 01:37:48.156865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.860109 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:47.860139 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.862325 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.941431 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.942417 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-181.ec2.internal" event="NodeHasSufficientMemory" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.942449 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-181.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.942466 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-181.ec2.internal" event="NodeHasSufficientPID" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.942497 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-181.ec2.internal" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.951482 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-181.ec2.internal" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:47.951503 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-181.ec2.internal\": node \"ip-10-0-131-181.ec2.internal\" not found" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.960252 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-181.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-181.ec2.internal"] Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.960315 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.961520 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-181.ec2.internal" event="NodeHasSufficientMemory" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.961552 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-181.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.961565 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-181.ec2.internal" event="NodeHasSufficientPID" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.963823 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.963924 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-181.ec2.internal" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.963968 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.964505 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-181.ec2.internal" event="NodeHasSufficientMemory" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.964514 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-181.ec2.internal" event="NodeHasSufficientMemory" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.964527 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-181.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.964537 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-181.ec2.internal" event="NodeHasSufficientPID" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.964536 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-181.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.964627 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-181.ec2.internal" event="NodeHasSufficientPID" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.966833 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-181.ec2.internal" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.966857 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.967533 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-181.ec2.internal" event="NodeHasSufficientMemory" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.967556 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-181.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:47.967565 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-181.ec2.internal" event="NodeHasSufficientPID" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:47.995463 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-181.ec2.internal\" not found" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:47.996886 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-181.ec2.internal\" not found" node="ip-10-0-131-181.ec2.internal" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:48.001201 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-181.ec2.internal\" not found" node="ip-10-0-131-181.ec2.internal" Jul 09 01:37:48.157908 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:48.096402 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-181.ec2.internal\" not found" Jul 09 01:37:48.299770 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.160765 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bc1262adfd563bb047fb14c67b9868ad-config\") pod \"kube-apiserver-proxy-ip-10-0-131-181.ec2.internal\" (UID: \"bc1262adfd563bb047fb14c67b9868ad\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-181.ec2.internal" Jul 09 01:37:48.299770 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.160791 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ddf93b56ea4cef8bce741483c29945e3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-181.ec2.internal\" (UID: \"ddf93b56ea4cef8bce741483c29945e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-181.ec2.internal" Jul 09 01:37:48.299770 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.160810 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ddf93b56ea4cef8bce741483c29945e3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-181.ec2.internal\" (UID: \"ddf93b56ea4cef8bce741483c29945e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-181.ec2.internal" Jul 09 01:37:48.299770 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:48.196977 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-181.ec2.internal\" not found" Jul 09 01:37:48.299770 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.261456 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ddf93b56ea4cef8bce741483c29945e3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-181.ec2.internal\" (UID: \"ddf93b56ea4cef8bce741483c29945e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-181.ec2.internal" Jul 09 01:37:48.299770 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.261488 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ddf93b56ea4cef8bce741483c29945e3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-181.ec2.internal\" (UID: \"ddf93b56ea4cef8bce741483c29945e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-181.ec2.internal" Jul 09 01:37:48.299770 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.261506 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bc1262adfd563bb047fb14c67b9868ad-config\") pod \"kube-apiserver-proxy-ip-10-0-131-181.ec2.internal\" (UID: \"bc1262adfd563bb047fb14c67b9868ad\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-181.ec2.internal" Jul 09 01:37:48.299770 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.261558 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bc1262adfd563bb047fb14c67b9868ad-config\") pod \"kube-apiserver-proxy-ip-10-0-131-181.ec2.internal\" (UID: \"bc1262adfd563bb047fb14c67b9868ad\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-181.ec2.internal" Jul 09 01:37:48.299770 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.261575 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ddf93b56ea4cef8bce741483c29945e3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-181.ec2.internal\" (UID: \"ddf93b56ea4cef8bce741483c29945e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-181.ec2.internal" Jul 09 01:37:48.299770 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.261559 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ddf93b56ea4cef8bce741483c29945e3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-181.ec2.internal\" (UID: \"ddf93b56ea4cef8bce741483c29945e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-181.ec2.internal" Jul 09 01:37:48.299770 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:48.297585 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-181.ec2.internal\" not found" Jul 09 01:37:48.299770 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.299724 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-181.ec2.internal" Jul 09 01:37:48.446521 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.304518 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-181.ec2.internal" Jul 09 01:37:48.446521 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:48.398503 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-181.ec2.internal\" not found" Jul 09 01:37:48.562119 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:48.498952 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-181.ec2.internal\" not found" Jul 09 01:37:48.720373 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:48.600107 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-181.ec2.internal\" not found" Jul 09 01:37:48.720373 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.626818 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 01:37:48.720373 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.688683 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 01:37:48.720373 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.688839 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 01:37:48.720373 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.688868 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 01:37:48.720373 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:48.700802 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-181.ec2.internal\" not found" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.728716 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.728898 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.730578 2564 apiserver.go:52] "Watching apiserver" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.743477 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.743796 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-6g7sx","kube-system/konnectivity-agent-c6ppx","openshift-multus/multus-6c85z","openshift-multus/network-metrics-daemon-b2d6x","openshift-network-diagnostics/network-check-target-22lm4","openshift-ovn-kubernetes/ovnkube-node-ntptr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4vdb","openshift-cluster-node-tuning-operator/tuned-lvbc2","openshift-dns/node-resolver-wwf2c","openshift-image-registry/node-ca-zj4qk","openshift-multus/multus-additional-cni-plugins-fkgtm","openshift-network-operator/iptables-alerter-nk9t8"] Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.746445 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:48.746505 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g7sx" podUID="eef45e59-8530-47b9-bdab-917bec4c3c42" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.748609 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c6ppx" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.750871 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.753054 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:48.753106 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2d6x" podUID="d06ec329-9c7d-418a-b019-385ecf29cc79" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.755200 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.755230 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.755240 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.755277 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.755810 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.755966 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vkltz\"" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.756434 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mrg8z\"" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.756477 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.756843 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:48.757141 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22lm4" podUID="d5a732a0-f772-4ff8-ba3a-9583da4f8600" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.757269 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.757864 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-181.ec2.internal" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.759187 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.761744 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-w8xxz\"" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.761812 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.762229 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4vdb" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.762509 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.762545 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.762597 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.762637 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 01:37:48.855863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.762828 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 01:37:48.857594 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.764268 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 01:37:48.857594 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.764470 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 01:37:48.857594 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.764554 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-host-var-lib-cni-multus\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.857594 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.764586 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gskz\" (UniqueName: \"kubernetes.io/projected/96cec375-64d5-4eca-b8dd-fbcd6203396f-kube-api-access-6gskz\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.857594 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.764626 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:48.857594 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.764638 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-systemd-units\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.857594 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.764665 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8d27f916-07f4-4432-bd72-f492d1284220-ovnkube-config\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.857594 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.764645 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 01:37:48.857594 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.764689 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eef45e59-8530-47b9-bdab-917bec4c3c42-kubelet-config\") pod \"global-pull-secret-syncer-6g7sx\" (UID: \"eef45e59-8530-47b9-bdab-917bec4c3c42\") " pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:37:48.857594 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.764772 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-multus-socket-dir-parent\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.857594 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.764808 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-host-run-netns\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.857594 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.764854 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-host-var-lib-cni-bin\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.857594 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.764881 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eef45e59-8530-47b9-bdab-917bec4c3c42-dbus\") pod \"global-pull-secret-syncer-6g7sx\" (UID: \"eef45e59-8530-47b9-bdab-917bec4c3c42\") " pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:37:48.857594 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.764920 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-cnibin\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.857594 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.764973 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-hostroot\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.857594 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765004 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-host-cni-bin\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.857594 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765020 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-host-cni-netd\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.857594 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765067 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-multus-cni-dir\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.857594 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765094 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-os-release\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.860044 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765124 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-host-run-k8s-cni-cncf-io\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.860044 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765150 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-host-var-lib-kubelet\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.860044 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765187 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-etc-kubernetes\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.860044 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765222 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-host-slash\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.860044 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765261 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-etc-openvswitch\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.860044 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765287 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8d27f916-07f4-4432-bd72-f492d1284220-env-overrides\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.860044 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765310 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d06ec329-9c7d-418a-b019-385ecf29cc79-metrics-certs\") pod \"network-metrics-daemon-b2d6x\" (UID: \"d06ec329-9c7d-418a-b019-385ecf29cc79\") " pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:37:48.860044 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765315 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-thfbn\"" Jul 09 01:37:48.860044 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765337 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mszt4\" (UniqueName: \"kubernetes.io/projected/d06ec329-9c7d-418a-b019-385ecf29cc79-kube-api-access-mszt4\") pod \"network-metrics-daemon-b2d6x\" (UID: \"d06ec329-9c7d-418a-b019-385ecf29cc79\") " pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:37:48.860044 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765364 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wrpr\" (UniqueName: \"kubernetes.io/projected/d5a732a0-f772-4ff8-ba3a-9583da4f8600-kube-api-access-2wrpr\") pod \"network-check-target-22lm4\" (UID: \"d5a732a0-f772-4ff8-ba3a-9583da4f8600\") " pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:37:48.860044 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765390 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0c28c3d4-f26a-4fb6-906a-32a30f09239e-agent-certs\") pod \"konnectivity-agent-c6ppx\" (UID: \"0c28c3d4-f26a-4fb6-906a-32a30f09239e\") " pod="kube-system/konnectivity-agent-c6ppx" Jul 09 01:37:48.860044 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765412 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-host-run-multus-certs\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.860044 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765475 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-host-run-netns\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.860044 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765498 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-run-ovn\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.860044 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765525 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0c28c3d4-f26a-4fb6-906a-32a30f09239e-konnectivity-ca\") pod \"konnectivity-agent-c6ppx\" (UID: \"0c28c3d4-f26a-4fb6-906a-32a30f09239e\") " pod="kube-system/konnectivity-agent-c6ppx" Jul 09 01:37:48.860044 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765540 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-system-cni-dir\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.860044 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765554 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-multus-conf-dir\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.860653 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765580 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/96cec375-64d5-4eca-b8dd-fbcd6203396f-multus-daemon-config\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.860653 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765623 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-host-kubelet\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.860653 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765638 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-run-systemd\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.860653 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765653 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-var-lib-openvswitch\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.860653 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765668 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-node-log\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.860653 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765698 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-run-openvswitch\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.860653 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765739 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.860653 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765763 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8d27f916-07f4-4432-bd72-f492d1284220-ovn-node-metrics-cert\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.860653 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765780 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8d27f916-07f4-4432-bd72-f492d1284220-ovnkube-script-lib\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.860653 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765795 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8m4w\" (UniqueName: \"kubernetes.io/projected/8d27f916-07f4-4432-bd72-f492d1284220-kube-api-access-v8m4w\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.860653 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765833 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-log-socket\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.860653 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765865 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-host-run-ovn-kubernetes\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.860653 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765895 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eef45e59-8530-47b9-bdab-917bec4c3c42-original-pull-secret\") pod \"global-pull-secret-syncer-6g7sx\" (UID: \"eef45e59-8530-47b9-bdab-917bec4c3c42\") " pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:37:48.860653 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.765924 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/96cec375-64d5-4eca-b8dd-fbcd6203396f-cni-binary-copy\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.860653 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.772445 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 01:37:48.860653 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.772481 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 01:37:48.860653 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.772528 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wwf2c" Jul 09 01:37:48.860653 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.772595 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pmjng\"" Jul 09 01:37:48.860653 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.774103 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 01:37:48.861484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.774166 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-181.ec2.internal" Jul 09 01:37:48.861484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.774707 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 01:37:48.861484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.774955 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zj4qk" Jul 09 01:37:48.861484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.775711 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 01:37:48.861484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.775791 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 01:37:48.861484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.776141 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5jj8h\"" Jul 09 01:37:48.861484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.777077 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 01:37:48.861484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.777225 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fnnvt\"" Jul 09 01:37:48.861484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.777236 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 01:37:48.861484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.777265 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 01:37:48.861484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.777503 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fkgtm" Jul 09 01:37:48.861484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.779553 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 01:37:48.861484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.779692 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-181.ec2.internal"] Jul 09 01:37:48.861484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.779759 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nk9t8" Jul 09 01:37:48.861484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.779797 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8j8tp\"" Jul 09 01:37:48.861484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.779799 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 01:37:48.861484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.781818 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mm556\"" Jul 09 01:37:48.861484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.781902 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 01:37:48.861484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.781919 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 01:37:48.861484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.782173 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 01:37:48.861484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.784602 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 01:32:48 +0000 UTC" deadline="2028-01-13 20:13:44.184728607 +0000 UTC" Jul 09 01:37:48.861484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.794271 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13290h35m55.390463671s" Jul 09 01:37:48.861484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.794477 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 01:37:48.861484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.794976 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-181.ec2.internal"] Jul 09 01:37:48.861484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.795247 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wtqgr" Jul 09 01:37:48.861484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.809166 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wtqgr" Jul 09 01:37:48.861484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.858953 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 01:37:48.994126 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866217 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eef45e59-8530-47b9-bdab-917bec4c3c42-kubelet-config\") pod \"global-pull-secret-syncer-6g7sx\" (UID: \"eef45e59-8530-47b9-bdab-917bec4c3c42\") " pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:37:48.994126 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866268 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-host-var-lib-cni-bin\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.994126 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866298 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3289febf-366d-4f6b-857c-be94e8771fba-cnibin\") pod \"multus-additional-cni-plugins-fkgtm\" (UID: \"3289febf-366d-4f6b-857c-be94e8771fba\") " pod="openshift-multus/multus-additional-cni-plugins-fkgtm" Jul 09 01:37:48.994126 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866322 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/872d30ee-57a3-4820-b761-38485e5bfcc0-serviceca\") pod \"node-ca-zj4qk\" (UID: \"872d30ee-57a3-4820-b761-38485e5bfcc0\") " pod="openshift-image-registry/node-ca-zj4qk" Jul 09 01:37:48.994126 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866375 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-host-var-lib-cni-bin\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.994126 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866373 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eef45e59-8530-47b9-bdab-917bec4c3c42-dbus\") pod \"global-pull-secret-syncer-6g7sx\" (UID: \"eef45e59-8530-47b9-bdab-917bec4c3c42\") " pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:37:48.994126 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866393 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eef45e59-8530-47b9-bdab-917bec4c3c42-kubelet-config\") pod \"global-pull-secret-syncer-6g7sx\" (UID: \"eef45e59-8530-47b9-bdab-917bec4c3c42\") " pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:37:48.994126 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866431 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-cnibin\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.994126 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866474 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-host-cni-bin\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.994126 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866501 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-host-cni-netd\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.994126 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866521 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eef45e59-8530-47b9-bdab-917bec4c3c42-dbus\") pod \"global-pull-secret-syncer-6g7sx\" (UID: \"eef45e59-8530-47b9-bdab-917bec4c3c42\") " pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:37:48.994126 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866547 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c217b92-49ef-4253-99f9-36dd34352d4f-tmp\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:48.994126 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866562 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-host-cni-bin\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.994126 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866571 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-host-cni-netd\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.994126 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866590 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-cnibin\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.994126 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866607 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8d27f916-07f4-4432-bd72-f492d1284220-ovnkube-script-lib\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.994126 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866635 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-multus-cni-dir\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.994126 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866664 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-host-run-k8s-cni-cncf-io\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.995111 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866692 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-host-var-lib-kubelet\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.995111 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866717 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-host-run-k8s-cni-cncf-io\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.995111 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866717 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-multus-cni-dir\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.995111 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866719 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-etc-kubernetes\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.995111 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866761 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-etc-kubernetes\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.995111 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866763 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-host-var-lib-kubelet\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.995111 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866782 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-etc-openvswitch\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.995111 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866853 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8d27f916-07f4-4432-bd72-f492d1284220-env-overrides\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.995111 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866808 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-etc-openvswitch\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.995111 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866883 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/14bdf73f-9051-47ef-8a74-4fe4b12c9e0e-registration-dir\") pod \"aws-ebs-csi-driver-node-x4vdb\" (UID: \"14bdf73f-9051-47ef-8a74-4fe4b12c9e0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4vdb" Jul 09 01:37:48.995111 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866930 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d06ec329-9c7d-418a-b019-385ecf29cc79-metrics-certs\") pod \"network-metrics-daemon-b2d6x\" (UID: \"d06ec329-9c7d-418a-b019-385ecf29cc79\") " pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:37:48.995111 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866952 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mszt4\" (UniqueName: \"kubernetes.io/projected/d06ec329-9c7d-418a-b019-385ecf29cc79-kube-api-access-mszt4\") pod \"network-metrics-daemon-b2d6x\" (UID: \"d06ec329-9c7d-418a-b019-385ecf29cc79\") " pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:37:48.995111 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.866973 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wrpr\" (UniqueName: \"kubernetes.io/projected/d5a732a0-f772-4ff8-ba3a-9583da4f8600-kube-api-access-2wrpr\") pod \"network-check-target-22lm4\" (UID: \"d5a732a0-f772-4ff8-ba3a-9583da4f8600\") " pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:37:48.995111 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867002 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-host-run-netns\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.995111 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867035 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-run-ovn\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.995111 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867065 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3289febf-366d-4f6b-857c-be94e8771fba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fkgtm\" (UID: \"3289febf-366d-4f6b-857c-be94e8771fba\") " pod="openshift-multus/multus-additional-cni-plugins-fkgtm" Jul 09 01:37:48.995111 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867100 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/872d30ee-57a3-4820-b761-38485e5bfcc0-host\") pod \"node-ca-zj4qk\" (UID: \"872d30ee-57a3-4820-b761-38485e5bfcc0\") " pod="openshift-image-registry/node-ca-zj4qk" Jul 09 01:37:48.995111 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:48.867102 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 01:37:48.997132 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867128 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-host-run-netns\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.997132 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867150 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-run-ovn\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.997132 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:48.867181 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d06ec329-9c7d-418a-b019-385ecf29cc79-metrics-certs podName:d06ec329-9c7d-418a-b019-385ecf29cc79 nodeName:}" failed. No retries permitted until 2026-07-09 01:37:49.367156216 +0000 UTC m=+2.028893700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d06ec329-9c7d-418a-b019-385ecf29cc79-metrics-certs") pod "network-metrics-daemon-b2d6x" (UID: "d06ec329-9c7d-418a-b019-385ecf29cc79") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 01:37:48.997132 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867211 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-etc-sysctl-d\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:48.997132 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867261 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-system-cni-dir\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.997132 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867300 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8d27f916-07f4-4432-bd72-f492d1284220-env-overrides\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.997132 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867303 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/96cec375-64d5-4eca-b8dd-fbcd6203396f-multus-daemon-config\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.997132 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867362 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-host-kubelet\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.997132 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867390 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-run-systemd\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.997132 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867398 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-system-cni-dir\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.997132 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867405 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-host-kubelet\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.997132 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867416 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-var-lib-openvswitch\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.997132 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867447 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-run-systemd\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.997132 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867460 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92964728-0018-4727-b36c-bf72a97aaeb8-host-slash\") pod \"iptables-alerter-nk9t8\" (UID: \"92964728-0018-4727-b36c-bf72a97aaeb8\") " pod="openshift-network-operator/iptables-alerter-nk9t8" Jul 09 01:37:48.997132 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867412 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8d27f916-07f4-4432-bd72-f492d1284220-ovnkube-script-lib\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.997132 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867467 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-var-lib-openvswitch\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.997132 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867481 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.997851 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867502 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8d27f916-07f4-4432-bd72-f492d1284220-ovn-node-metrics-cert\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.997851 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867555 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.997851 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867592 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8m4w\" (UniqueName: \"kubernetes.io/projected/8d27f916-07f4-4432-bd72-f492d1284220-kube-api-access-v8m4w\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.997851 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867632 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2a07af9d-8807-44f2-9185-2a4f5f57e0e3-hosts-file\") pod \"node-resolver-wwf2c\" (UID: \"2a07af9d-8807-44f2-9185-2a4f5f57e0e3\") " pod="openshift-dns/node-resolver-wwf2c" Jul 09 01:37:48.997851 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867649 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-var-lib-kubelet\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:48.997851 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867701 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-log-socket\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.997851 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867764 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-log-socket\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.997851 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867762 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-sys\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:48.997851 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867788 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 01:37:48.997851 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867799 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-lib-modules\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:48.997851 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867838 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-host\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:48.997851 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867882 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eef45e59-8530-47b9-bdab-917bec4c3c42-original-pull-secret\") pod \"global-pull-secret-syncer-6g7sx\" (UID: \"eef45e59-8530-47b9-bdab-917bec4c3c42\") " pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:37:48.997851 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867899 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/96cec375-64d5-4eca-b8dd-fbcd6203396f-cni-binary-copy\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.997851 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867918 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gskz\" (UniqueName: \"kubernetes.io/projected/96cec375-64d5-4eca-b8dd-fbcd6203396f-kube-api-access-6gskz\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.997851 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867947 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-systemd-units\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.997851 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867918 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/96cec375-64d5-4eca-b8dd-fbcd6203396f-multus-daemon-config\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.997851 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.867983 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz88t\" (UniqueName: \"kubernetes.io/projected/2a07af9d-8807-44f2-9185-2a4f5f57e0e3-kube-api-access-pz88t\") pod \"node-resolver-wwf2c\" (UID: \"2a07af9d-8807-44f2-9185-2a4f5f57e0e3\") " pod="openshift-dns/node-resolver-wwf2c" Jul 09 01:37:48.998577 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868019 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/14bdf73f-9051-47ef-8a74-4fe4b12c9e0e-socket-dir\") pod \"aws-ebs-csi-driver-node-x4vdb\" (UID: \"14bdf73f-9051-47ef-8a74-4fe4b12c9e0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4vdb" Jul 09 01:37:48.998577 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868072 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-etc-modprobe-d\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:48.998577 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:48.868088 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 01:37:48.998577 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868100 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-systemd-units\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.998577 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868102 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-multus-socket-dir-parent\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.998577 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:48.868166 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef45e59-8530-47b9-bdab-917bec4c3c42-original-pull-secret podName:eef45e59-8530-47b9-bdab-917bec4c3c42 nodeName:}" failed. No retries permitted until 2026-07-09 01:37:49.368138464 +0000 UTC m=+2.029875952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eef45e59-8530-47b9-bdab-917bec4c3c42-original-pull-secret") pod "global-pull-secret-syncer-6g7sx" (UID: "eef45e59-8530-47b9-bdab-917bec4c3c42") : object "kube-system"/"original-pull-secret" not registered Jul 09 01:37:48.998577 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868209 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-host-run-netns\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.998577 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868243 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a07af9d-8807-44f2-9185-2a4f5f57e0e3-tmp-dir\") pod \"node-resolver-wwf2c\" (UID: \"2a07af9d-8807-44f2-9185-2a4f5f57e0e3\") " pod="openshift-dns/node-resolver-wwf2c" Jul 09 01:37:48.998577 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868276 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-host-run-netns\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.998577 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868275 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-multus-socket-dir-parent\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.998577 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868291 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-etc-sysconfig\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:48.998577 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868325 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-etc-sysctl-conf\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:48.998577 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868352 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-hostroot\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.998577 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868359 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/96cec375-64d5-4eca-b8dd-fbcd6203396f-cni-binary-copy\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.998577 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868372 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3289febf-366d-4f6b-857c-be94e8771fba-os-release\") pod \"multus-additional-cni-plugins-fkgtm\" (UID: \"3289febf-366d-4f6b-857c-be94e8771fba\") " pod="openshift-multus/multus-additional-cni-plugins-fkgtm" Jul 09 01:37:48.998577 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868393 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-etc-systemd\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:48.998577 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868421 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3289febf-366d-4f6b-857c-be94e8771fba-cni-binary-copy\") pod \"multus-additional-cni-plugins-fkgtm\" (UID: \"3289febf-366d-4f6b-857c-be94e8771fba\") " pod="openshift-multus/multus-additional-cni-plugins-fkgtm" Jul 09 01:37:48.999160 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868426 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-hostroot\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.999160 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868445 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-os-release\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.999160 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868469 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-host-slash\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.999160 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868491 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rztdh\" (UniqueName: \"kubernetes.io/projected/3289febf-366d-4f6b-857c-be94e8771fba-kube-api-access-rztdh\") pod \"multus-additional-cni-plugins-fkgtm\" (UID: \"3289febf-366d-4f6b-857c-be94e8771fba\") " pod="openshift-multus/multus-additional-cni-plugins-fkgtm" Jul 09 01:37:48.999160 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868516 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-node-log\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.999160 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868527 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-os-release\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.999160 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868535 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-host-slash\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.999160 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868538 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-host-run-ovn-kubernetes\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.999160 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868559 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-node-log\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.999160 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868569 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-host-run-ovn-kubernetes\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.999160 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868583 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0c28c3d4-f26a-4fb6-906a-32a30f09239e-agent-certs\") pod \"konnectivity-agent-c6ppx\" (UID: \"0c28c3d4-f26a-4fb6-906a-32a30f09239e\") " pod="kube-system/konnectivity-agent-c6ppx" Jul 09 01:37:48.999160 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868606 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-host-run-multus-certs\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.999160 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868634 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-host-run-multus-certs\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.999160 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868721 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/14bdf73f-9051-47ef-8a74-4fe4b12c9e0e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x4vdb\" (UID: \"14bdf73f-9051-47ef-8a74-4fe4b12c9e0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4vdb" Jul 09 01:37:48.999160 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868739 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/14bdf73f-9051-47ef-8a74-4fe4b12c9e0e-etc-selinux\") pod \"aws-ebs-csi-driver-node-x4vdb\" (UID: \"14bdf73f-9051-47ef-8a74-4fe4b12c9e0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4vdb" Jul 09 01:37:48.999160 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868754 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/14bdf73f-9051-47ef-8a74-4fe4b12c9e0e-sys-fs\") pod \"aws-ebs-csi-driver-node-x4vdb\" (UID: \"14bdf73f-9051-47ef-8a74-4fe4b12c9e0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4vdb" Jul 09 01:37:48.999160 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868771 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0c28c3d4-f26a-4fb6-906a-32a30f09239e-konnectivity-ca\") pod \"konnectivity-agent-c6ppx\" (UID: \"0c28c3d4-f26a-4fb6-906a-32a30f09239e\") " pod="kube-system/konnectivity-agent-c6ppx" Jul 09 01:37:48.999877 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868788 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-multus-conf-dir\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.999877 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868804 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76vcf\" (UniqueName: \"kubernetes.io/projected/92964728-0018-4727-b36c-bf72a97aaeb8-kube-api-access-76vcf\") pod \"iptables-alerter-nk9t8\" (UID: \"92964728-0018-4727-b36c-bf72a97aaeb8\") " pod="openshift-network-operator/iptables-alerter-nk9t8" Jul 09 01:37:48.999877 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868824 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-etc-kubernetes\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:48.999877 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868855 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4c217b92-49ef-4253-99f9-36dd34352d4f-etc-tuned\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:48.999877 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868856 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-multus-conf-dir\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.999877 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868889 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qst5b\" (UniqueName: \"kubernetes.io/projected/4c217b92-49ef-4253-99f9-36dd34352d4f-kube-api-access-qst5b\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:48.999877 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868918 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-run-openvswitch\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.999877 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868946 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3289febf-366d-4f6b-857c-be94e8771fba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fkgtm\" (UID: \"3289febf-366d-4f6b-857c-be94e8771fba\") " pod="openshift-multus/multus-additional-cni-plugins-fkgtm" Jul 09 01:37:48.999877 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868994 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/92964728-0018-4727-b36c-bf72a97aaeb8-iptables-alerter-script\") pod \"iptables-alerter-nk9t8\" (UID: \"92964728-0018-4727-b36c-bf72a97aaeb8\") " pod="openshift-network-operator/iptables-alerter-nk9t8" Jul 09 01:37:48.999877 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.868996 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d27f916-07f4-4432-bd72-f492d1284220-run-openvswitch\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:48.999877 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.869036 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gxdm\" (UniqueName: \"kubernetes.io/projected/872d30ee-57a3-4820-b761-38485e5bfcc0-kube-api-access-7gxdm\") pod \"node-ca-zj4qk\" (UID: \"872d30ee-57a3-4820-b761-38485e5bfcc0\") " pod="openshift-image-registry/node-ca-zj4qk" Jul 09 01:37:48.999877 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.869072 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3289febf-366d-4f6b-857c-be94e8771fba-system-cni-dir\") pod \"multus-additional-cni-plugins-fkgtm\" (UID: \"3289febf-366d-4f6b-857c-be94e8771fba\") " pod="openshift-multus/multus-additional-cni-plugins-fkgtm" Jul 09 01:37:48.999877 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.869097 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3289febf-366d-4f6b-857c-be94e8771fba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fkgtm\" (UID: \"3289febf-366d-4f6b-857c-be94e8771fba\") " pod="openshift-multus/multus-additional-cni-plugins-fkgtm" Jul 09 01:37:48.999877 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.869123 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-run\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:48.999877 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.869151 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-host-var-lib-cni-multus\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:48.999877 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.869177 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8d27f916-07f4-4432-bd72-f492d1284220-ovnkube-config\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:49.000455 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.869200 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/14bdf73f-9051-47ef-8a74-4fe4b12c9e0e-device-dir\") pod \"aws-ebs-csi-driver-node-x4vdb\" (UID: \"14bdf73f-9051-47ef-8a74-4fe4b12c9e0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4vdb" Jul 09 01:37:49.000455 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.869225 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7h2p\" (UniqueName: \"kubernetes.io/projected/14bdf73f-9051-47ef-8a74-4fe4b12c9e0e-kube-api-access-s7h2p\") pod \"aws-ebs-csi-driver-node-x4vdb\" (UID: \"14bdf73f-9051-47ef-8a74-4fe4b12c9e0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4vdb" Jul 09 01:37:49.000455 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.869255 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/96cec375-64d5-4eca-b8dd-fbcd6203396f-host-var-lib-cni-multus\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:49.000455 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.869325 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0c28c3d4-f26a-4fb6-906a-32a30f09239e-konnectivity-ca\") pod \"konnectivity-agent-c6ppx\" (UID: \"0c28c3d4-f26a-4fb6-906a-32a30f09239e\") " pod="kube-system/konnectivity-agent-c6ppx" Jul 09 01:37:49.000455 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.869628 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8d27f916-07f4-4432-bd72-f492d1284220-ovnkube-config\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:49.000455 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.872758 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8d27f916-07f4-4432-bd72-f492d1284220-ovn-node-metrics-cert\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:49.000455 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.878882 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0c28c3d4-f26a-4fb6-906a-32a30f09239e-agent-certs\") pod \"konnectivity-agent-c6ppx\" (UID: \"0c28c3d4-f26a-4fb6-906a-32a30f09239e\") " pod="kube-system/konnectivity-agent-c6ppx" Jul 09 01:37:49.000455 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:48.879741 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 01:37:49.000455 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:48.879762 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 01:37:49.000455 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:48.879775 2564 projected.go:196] Error preparing data for projected volume kube-api-access-2wrpr for pod openshift-network-diagnostics/network-check-target-22lm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 01:37:49.000455 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:48.879853 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5a732a0-f772-4ff8-ba3a-9583da4f8600-kube-api-access-2wrpr podName:d5a732a0-f772-4ff8-ba3a-9583da4f8600 nodeName:}" failed. No retries permitted until 2026-07-09 01:37:49.379834975 +0000 UTC m=+2.041572464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2wrpr" (UniqueName: "kubernetes.io/projected/d5a732a0-f772-4ff8-ba3a-9583da4f8600-kube-api-access-2wrpr") pod "network-check-target-22lm4" (UID: "d5a732a0-f772-4ff8-ba3a-9583da4f8600") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 01:37:49.000455 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.882410 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gskz\" (UniqueName: \"kubernetes.io/projected/96cec375-64d5-4eca-b8dd-fbcd6203396f-kube-api-access-6gskz\") pod \"multus-6c85z\" (UID: \"96cec375-64d5-4eca-b8dd-fbcd6203396f\") " pod="openshift-multus/multus-6c85z" Jul 09 01:37:49.000455 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.882511 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8m4w\" (UniqueName: \"kubernetes.io/projected/8d27f916-07f4-4432-bd72-f492d1284220-kube-api-access-v8m4w\") pod \"ovnkube-node-ntptr\" (UID: \"8d27f916-07f4-4432-bd72-f492d1284220\") " pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:49.000455 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.882872 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mszt4\" (UniqueName: \"kubernetes.io/projected/d06ec329-9c7d-418a-b019-385ecf29cc79-kube-api-access-mszt4\") pod \"network-metrics-daemon-b2d6x\" (UID: \"d06ec329-9c7d-418a-b019-385ecf29cc79\") " pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:37:49.000455 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.969790 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3289febf-366d-4f6b-857c-be94e8771fba-system-cni-dir\") pod \"multus-additional-cni-plugins-fkgtm\" (UID: \"3289febf-366d-4f6b-857c-be94e8771fba\") " pod="openshift-multus/multus-additional-cni-plugins-fkgtm" Jul 09 01:37:49.000455 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.969832 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3289febf-366d-4f6b-857c-be94e8771fba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fkgtm\" (UID: \"3289febf-366d-4f6b-857c-be94e8771fba\") " pod="openshift-multus/multus-additional-cni-plugins-fkgtm" Jul 09 01:37:49.000455 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.969849 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-run\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:49.001014 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.969917 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-run\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:49.001014 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.969917 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3289febf-366d-4f6b-857c-be94e8771fba-system-cni-dir\") pod \"multus-additional-cni-plugins-fkgtm\" (UID: \"3289febf-366d-4f6b-857c-be94e8771fba\") " pod="openshift-multus/multus-additional-cni-plugins-fkgtm" Jul 09 01:37:49.001014 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.969984 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/14bdf73f-9051-47ef-8a74-4fe4b12c9e0e-device-dir\") pod \"aws-ebs-csi-driver-node-x4vdb\" (UID: \"14bdf73f-9051-47ef-8a74-4fe4b12c9e0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4vdb" Jul 09 01:37:49.001014 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.970023 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7h2p\" (UniqueName: \"kubernetes.io/projected/14bdf73f-9051-47ef-8a74-4fe4b12c9e0e-kube-api-access-s7h2p\") pod \"aws-ebs-csi-driver-node-x4vdb\" (UID: \"14bdf73f-9051-47ef-8a74-4fe4b12c9e0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4vdb" Jul 09 01:37:49.001014 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.970028 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3289febf-366d-4f6b-857c-be94e8771fba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fkgtm\" (UID: \"3289febf-366d-4f6b-857c-be94e8771fba\") " pod="openshift-multus/multus-additional-cni-plugins-fkgtm" Jul 09 01:37:49.001014 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.970050 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3289febf-366d-4f6b-857c-be94e8771fba-cnibin\") pod \"multus-additional-cni-plugins-fkgtm\" (UID: \"3289febf-366d-4f6b-857c-be94e8771fba\") " pod="openshift-multus/multus-additional-cni-plugins-fkgtm" Jul 09 01:37:49.001014 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.970082 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/872d30ee-57a3-4820-b761-38485e5bfcc0-serviceca\") pod \"node-ca-zj4qk\" (UID: \"872d30ee-57a3-4820-b761-38485e5bfcc0\") " pod="openshift-image-registry/node-ca-zj4qk" Jul 09 01:37:49.001014 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.970076 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/14bdf73f-9051-47ef-8a74-4fe4b12c9e0e-device-dir\") pod \"aws-ebs-csi-driver-node-x4vdb\" (UID: \"14bdf73f-9051-47ef-8a74-4fe4b12c9e0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4vdb" Jul 09 01:37:49.001014 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.970125 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c217b92-49ef-4253-99f9-36dd34352d4f-tmp\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:49.001014 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.970152 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3289febf-366d-4f6b-857c-be94e8771fba-cnibin\") pod \"multus-additional-cni-plugins-fkgtm\" (UID: \"3289febf-366d-4f6b-857c-be94e8771fba\") " pod="openshift-multus/multus-additional-cni-plugins-fkgtm" Jul 09 01:37:49.001014 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.970179 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/14bdf73f-9051-47ef-8a74-4fe4b12c9e0e-registration-dir\") pod \"aws-ebs-csi-driver-node-x4vdb\" (UID: \"14bdf73f-9051-47ef-8a74-4fe4b12c9e0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4vdb" Jul 09 01:37:49.001014 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.970237 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3289febf-366d-4f6b-857c-be94e8771fba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fkgtm\" (UID: \"3289febf-366d-4f6b-857c-be94e8771fba\") " pod="openshift-multus/multus-additional-cni-plugins-fkgtm" Jul 09 01:37:49.001014 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.970708 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/872d30ee-57a3-4820-b761-38485e5bfcc0-host\") pod \"node-ca-zj4qk\" (UID: \"872d30ee-57a3-4820-b761-38485e5bfcc0\") " pod="openshift-image-registry/node-ca-zj4qk" Jul 09 01:37:49.001014 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.970757 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-etc-sysctl-d\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:49.001014 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.970802 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92964728-0018-4727-b36c-bf72a97aaeb8-host-slash\") pod \"iptables-alerter-nk9t8\" (UID: \"92964728-0018-4727-b36c-bf72a97aaeb8\") " pod="openshift-network-operator/iptables-alerter-nk9t8" Jul 09 01:37:49.001014 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.970837 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/14bdf73f-9051-47ef-8a74-4fe4b12c9e0e-registration-dir\") pod \"aws-ebs-csi-driver-node-x4vdb\" (UID: \"14bdf73f-9051-47ef-8a74-4fe4b12c9e0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4vdb" Jul 09 01:37:49.001014 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.970859 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2a07af9d-8807-44f2-9185-2a4f5f57e0e3-hosts-file\") pod \"node-resolver-wwf2c\" (UID: \"2a07af9d-8807-44f2-9185-2a4f5f57e0e3\") " pod="openshift-dns/node-resolver-wwf2c" Jul 09 01:37:49.001612 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.970912 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-var-lib-kubelet\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:49.001612 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.970953 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2a07af9d-8807-44f2-9185-2a4f5f57e0e3-hosts-file\") pod \"node-resolver-wwf2c\" (UID: \"2a07af9d-8807-44f2-9185-2a4f5f57e0e3\") " pod="openshift-dns/node-resolver-wwf2c" Jul 09 01:37:49.001612 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.971024 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-var-lib-kubelet\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:49.001612 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.971029 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/872d30ee-57a3-4820-b761-38485e5bfcc0-host\") pod \"node-ca-zj4qk\" (UID: \"872d30ee-57a3-4820-b761-38485e5bfcc0\") " pod="openshift-image-registry/node-ca-zj4qk" Jul 09 01:37:49.001612 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.971085 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-sys\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:49.001612 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.971116 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/872d30ee-57a3-4820-b761-38485e5bfcc0-serviceca\") pod \"node-ca-zj4qk\" (UID: \"872d30ee-57a3-4820-b761-38485e5bfcc0\") " pod="openshift-image-registry/node-ca-zj4qk" Jul 09 01:37:49.001612 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.970958 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-sys\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:49.001612 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.971138 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92964728-0018-4727-b36c-bf72a97aaeb8-host-slash\") pod \"iptables-alerter-nk9t8\" (UID: \"92964728-0018-4727-b36c-bf72a97aaeb8\") " pod="openshift-network-operator/iptables-alerter-nk9t8" Jul 09 01:37:49.001612 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.971189 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-etc-sysctl-d\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:49.001612 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.971201 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-lib-modules\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:49.001612 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.971226 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3289febf-366d-4f6b-857c-be94e8771fba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fkgtm\" (UID: \"3289febf-366d-4f6b-857c-be94e8771fba\") " pod="openshift-multus/multus-additional-cni-plugins-fkgtm" Jul 09 01:37:49.001612 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.971237 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-host\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:49.001612 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.971325 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-host\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:49.001612 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.971357 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-lib-modules\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:49.001612 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.971421 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz88t\" (UniqueName: \"kubernetes.io/projected/2a07af9d-8807-44f2-9185-2a4f5f57e0e3-kube-api-access-pz88t\") pod \"node-resolver-wwf2c\" (UID: \"2a07af9d-8807-44f2-9185-2a4f5f57e0e3\") " pod="openshift-dns/node-resolver-wwf2c" Jul 09 01:37:49.001612 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.971465 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/14bdf73f-9051-47ef-8a74-4fe4b12c9e0e-socket-dir\") pod \"aws-ebs-csi-driver-node-x4vdb\" (UID: \"14bdf73f-9051-47ef-8a74-4fe4b12c9e0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4vdb" Jul 09 01:37:49.001612 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.971496 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-etc-modprobe-d\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:49.001612 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.971538 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a07af9d-8807-44f2-9185-2a4f5f57e0e3-tmp-dir\") pod \"node-resolver-wwf2c\" (UID: \"2a07af9d-8807-44f2-9185-2a4f5f57e0e3\") " pod="openshift-dns/node-resolver-wwf2c" Jul 09 01:37:49.002183 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.971571 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-etc-sysconfig\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:49.002183 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.971605 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-etc-sysctl-conf\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:49.002183 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.971632 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3289febf-366d-4f6b-857c-be94e8771fba-os-release\") pod \"multus-additional-cni-plugins-fkgtm\" (UID: \"3289febf-366d-4f6b-857c-be94e8771fba\") " pod="openshift-multus/multus-additional-cni-plugins-fkgtm" Jul 09 01:37:49.002183 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.971665 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-etc-systemd\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:49.002183 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.971699 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3289febf-366d-4f6b-857c-be94e8771fba-cni-binary-copy\") pod \"multus-additional-cni-plugins-fkgtm\" (UID: \"3289febf-366d-4f6b-857c-be94e8771fba\") " pod="openshift-multus/multus-additional-cni-plugins-fkgtm" Jul 09 01:37:49.002183 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.971740 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rztdh\" (UniqueName: \"kubernetes.io/projected/3289febf-366d-4f6b-857c-be94e8771fba-kube-api-access-rztdh\") pod \"multus-additional-cni-plugins-fkgtm\" (UID: \"3289febf-366d-4f6b-857c-be94e8771fba\") " pod="openshift-multus/multus-additional-cni-plugins-fkgtm" Jul 09 01:37:49.002183 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.971778 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/14bdf73f-9051-47ef-8a74-4fe4b12c9e0e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x4vdb\" (UID: \"14bdf73f-9051-47ef-8a74-4fe4b12c9e0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4vdb" Jul 09 01:37:49.002183 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.971803 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/14bdf73f-9051-47ef-8a74-4fe4b12c9e0e-etc-selinux\") pod \"aws-ebs-csi-driver-node-x4vdb\" (UID: \"14bdf73f-9051-47ef-8a74-4fe4b12c9e0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4vdb" Jul 09 01:37:49.002183 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.971835 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/14bdf73f-9051-47ef-8a74-4fe4b12c9e0e-sys-fs\") pod \"aws-ebs-csi-driver-node-x4vdb\" (UID: \"14bdf73f-9051-47ef-8a74-4fe4b12c9e0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4vdb" Jul 09 01:37:49.002183 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.971887 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76vcf\" (UniqueName: \"kubernetes.io/projected/92964728-0018-4727-b36c-bf72a97aaeb8-kube-api-access-76vcf\") pod \"iptables-alerter-nk9t8\" (UID: \"92964728-0018-4727-b36c-bf72a97aaeb8\") " pod="openshift-network-operator/iptables-alerter-nk9t8" Jul 09 01:37:49.002183 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.971920 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-etc-kubernetes\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:49.002183 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.971956 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4c217b92-49ef-4253-99f9-36dd34352d4f-etc-tuned\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:49.002183 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.971986 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qst5b\" (UniqueName: \"kubernetes.io/projected/4c217b92-49ef-4253-99f9-36dd34352d4f-kube-api-access-qst5b\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:49.002183 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.972016 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3289febf-366d-4f6b-857c-be94e8771fba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fkgtm\" (UID: \"3289febf-366d-4f6b-857c-be94e8771fba\") " pod="openshift-multus/multus-additional-cni-plugins-fkgtm" Jul 09 01:37:49.002183 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.972048 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/92964728-0018-4727-b36c-bf72a97aaeb8-iptables-alerter-script\") pod \"iptables-alerter-nk9t8\" (UID: \"92964728-0018-4727-b36c-bf72a97aaeb8\") " pod="openshift-network-operator/iptables-alerter-nk9t8" Jul 09 01:37:49.002183 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.972079 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gxdm\" (UniqueName: \"kubernetes.io/projected/872d30ee-57a3-4820-b761-38485e5bfcc0-kube-api-access-7gxdm\") pod \"node-ca-zj4qk\" (UID: \"872d30ee-57a3-4820-b761-38485e5bfcc0\") " pod="openshift-image-registry/node-ca-zj4qk" Jul 09 01:37:49.002183 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.972723 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/14bdf73f-9051-47ef-8a74-4fe4b12c9e0e-socket-dir\") pod \"aws-ebs-csi-driver-node-x4vdb\" (UID: \"14bdf73f-9051-47ef-8a74-4fe4b12c9e0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4vdb" Jul 09 01:37:49.002772 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.972833 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-etc-modprobe-d\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:49.002772 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.973117 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a07af9d-8807-44f2-9185-2a4f5f57e0e3-tmp-dir\") pod \"node-resolver-wwf2c\" (UID: \"2a07af9d-8807-44f2-9185-2a4f5f57e0e3\") " pod="openshift-dns/node-resolver-wwf2c" Jul 09 01:37:49.002772 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.973208 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-etc-sysconfig\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:49.002772 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.973359 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-etc-sysctl-conf\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:49.002772 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.973438 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3289febf-366d-4f6b-857c-be94e8771fba-os-release\") pod \"multus-additional-cni-plugins-fkgtm\" (UID: \"3289febf-366d-4f6b-857c-be94e8771fba\") " pod="openshift-multus/multus-additional-cni-plugins-fkgtm" Jul 09 01:37:49.002772 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.973462 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/14bdf73f-9051-47ef-8a74-4fe4b12c9e0e-sys-fs\") pod \"aws-ebs-csi-driver-node-x4vdb\" (UID: \"14bdf73f-9051-47ef-8a74-4fe4b12c9e0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4vdb" Jul 09 01:37:49.002772 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.973540 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-etc-systemd\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:49.002772 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.973720 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c217b92-49ef-4253-99f9-36dd34352d4f-etc-kubernetes\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:49.002772 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.974060 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3289febf-366d-4f6b-857c-be94e8771fba-cni-binary-copy\") pod \"multus-additional-cni-plugins-fkgtm\" (UID: \"3289febf-366d-4f6b-857c-be94e8771fba\") " pod="openshift-multus/multus-additional-cni-plugins-fkgtm" Jul 09 01:37:49.002772 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.974411 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/14bdf73f-9051-47ef-8a74-4fe4b12c9e0e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x4vdb\" (UID: \"14bdf73f-9051-47ef-8a74-4fe4b12c9e0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4vdb" Jul 09 01:37:49.002772 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.974525 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/14bdf73f-9051-47ef-8a74-4fe4b12c9e0e-etc-selinux\") pod \"aws-ebs-csi-driver-node-x4vdb\" (UID: \"14bdf73f-9051-47ef-8a74-4fe4b12c9e0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4vdb" Jul 09 01:37:49.002772 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.975456 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3289febf-366d-4f6b-857c-be94e8771fba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fkgtm\" (UID: \"3289febf-366d-4f6b-857c-be94e8771fba\") " pod="openshift-multus/multus-additional-cni-plugins-fkgtm" Jul 09 01:37:49.002772 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.975487 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/92964728-0018-4727-b36c-bf72a97aaeb8-iptables-alerter-script\") pod \"iptables-alerter-nk9t8\" (UID: \"92964728-0018-4727-b36c-bf72a97aaeb8\") " pod="openshift-network-operator/iptables-alerter-nk9t8" Jul 09 01:37:49.002772 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.978570 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4c217b92-49ef-4253-99f9-36dd34352d4f-etc-tuned\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:49.002772 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.984766 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c217b92-49ef-4253-99f9-36dd34352d4f-tmp\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:49.002772 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.986475 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76vcf\" (UniqueName: \"kubernetes.io/projected/92964728-0018-4727-b36c-bf72a97aaeb8-kube-api-access-76vcf\") pod \"iptables-alerter-nk9t8\" (UID: \"92964728-0018-4727-b36c-bf72a97aaeb8\") " pod="openshift-network-operator/iptables-alerter-nk9t8" Jul 09 01:37:49.002772 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.986562 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gxdm\" (UniqueName: \"kubernetes.io/projected/872d30ee-57a3-4820-b761-38485e5bfcc0-kube-api-access-7gxdm\") pod \"node-ca-zj4qk\" (UID: \"872d30ee-57a3-4820-b761-38485e5bfcc0\") " pod="openshift-image-registry/node-ca-zj4qk" Jul 09 01:37:49.003318 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.986659 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rztdh\" (UniqueName: \"kubernetes.io/projected/3289febf-366d-4f6b-857c-be94e8771fba-kube-api-access-rztdh\") pod \"multus-additional-cni-plugins-fkgtm\" (UID: \"3289febf-366d-4f6b-857c-be94e8771fba\") " pod="openshift-multus/multus-additional-cni-plugins-fkgtm" Jul 09 01:37:49.003318 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.986672 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz88t\" (UniqueName: \"kubernetes.io/projected/2a07af9d-8807-44f2-9185-2a4f5f57e0e3-kube-api-access-pz88t\") pod \"node-resolver-wwf2c\" (UID: \"2a07af9d-8807-44f2-9185-2a4f5f57e0e3\") " pod="openshift-dns/node-resolver-wwf2c" Jul 09 01:37:49.003318 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.986832 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qst5b\" (UniqueName: \"kubernetes.io/projected/4c217b92-49ef-4253-99f9-36dd34352d4f-kube-api-access-qst5b\") pod \"tuned-lvbc2\" (UID: \"4c217b92-49ef-4253-99f9-36dd34352d4f\") " pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:49.003318 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:48.987770 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7h2p\" (UniqueName: \"kubernetes.io/projected/14bdf73f-9051-47ef-8a74-4fe4b12c9e0e-kube-api-access-s7h2p\") pod \"aws-ebs-csi-driver-node-x4vdb\" (UID: \"14bdf73f-9051-47ef-8a74-4fe4b12c9e0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4vdb" Jul 09 01:37:49.137488 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:49.071135 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddf93b56ea4cef8bce741483c29945e3.slice/crio-4eac50043d1ff6ab7bd12268af7187585b8232c563e423b991c6a7555cf8e5b8 WatchSource:0}: Error finding container 4eac50043d1ff6ab7bd12268af7187585b8232c563e423b991c6a7555cf8e5b8: Status 404 returned error can't find the container with id 4eac50043d1ff6ab7bd12268af7187585b8232c563e423b991c6a7555cf8e5b8 Jul 09 01:37:49.137488 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:49.073705 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc1262adfd563bb047fb14c67b9868ad.slice/crio-0e360e8b6c789a018ddbfacbf9d800a16bfc4bb12a61f13421a91c382bcbf079 WatchSource:0}: Error finding container 0e360e8b6c789a018ddbfacbf9d800a16bfc4bb12a61f13421a91c382bcbf079: Status 404 returned error can't find the container with id 0e360e8b6c789a018ddbfacbf9d800a16bfc4bb12a61f13421a91c382bcbf079 Jul 09 01:37:49.137488 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:49.075708 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 01:37:49.137488 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:49.082881 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c6ppx" Jul 09 01:37:49.137488 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:49.093915 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c28c3d4_f26a_4fb6_906a_32a30f09239e.slice/crio-5c99d3f66a9e8272a23cd1bbf82b99f6878994cd721176b8e086fd2bf0d092d9 WatchSource:0}: Error finding container 5c99d3f66a9e8272a23cd1bbf82b99f6878994cd721176b8e086fd2bf0d092d9: Status 404 returned error can't find the container with id 5c99d3f66a9e8272a23cd1bbf82b99f6878994cd721176b8e086fd2bf0d092d9 Jul 09 01:37:49.137488 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:49.114972 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4vdb" Jul 09 01:37:49.137488 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:49.118980 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6c85z" Jul 09 01:37:49.137488 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:49.124430 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14bdf73f_9051_47ef_8a74_4fe4b12c9e0e.slice/crio-852bace09d23dd2a1515417a091c89d51110c0345d7dbd5e57403a37986a4da0 WatchSource:0}: Error finding container 852bace09d23dd2a1515417a091c89d51110c0345d7dbd5e57403a37986a4da0: Status 404 returned error can't find the container with id 852bace09d23dd2a1515417a091c89d51110c0345d7dbd5e57403a37986a4da0 Jul 09 01:37:49.137488 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:49.129336 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96cec375_64d5_4eca_b8dd_fbcd6203396f.slice/crio-0d331a52a7fd475220b29d32ea85bb6b979ac35f44148c73744fa7ededb75138 WatchSource:0}: Error finding container 0d331a52a7fd475220b29d32ea85bb6b979ac35f44148c73744fa7ededb75138: Status 404 returned error can't find the container with id 0d331a52a7fd475220b29d32ea85bb6b979ac35f44148c73744fa7ededb75138 Jul 09 01:37:49.142965 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:49.142706 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:37:49.142965 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:49.142805 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" Jul 09 01:37:49.255048 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:49.154230 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wwf2c" Jul 09 01:37:49.255048 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:49.155337 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d27f916_07f4_4432_bd72_f492d1284220.slice/crio-469d8a05d595a147a7ada4c87942931df043ff4c81ad5d911ba7374659e81d31 WatchSource:0}: Error finding container 469d8a05d595a147a7ada4c87942931df043ff4c81ad5d911ba7374659e81d31: Status 404 returned error can't find the container with id 469d8a05d595a147a7ada4c87942931df043ff4c81ad5d911ba7374659e81d31 Jul 09 01:37:49.255048 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:49.161146 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c217b92_49ef_4253_99f9_36dd34352d4f.slice/crio-d4f6149fb1c1fb314102b2a858204c9394243e360f0610561490023697320e25 WatchSource:0}: Error finding container d4f6149fb1c1fb314102b2a858204c9394243e360f0610561490023697320e25: Status 404 returned error can't find the container with id d4f6149fb1c1fb314102b2a858204c9394243e360f0610561490023697320e25 Jul 09 01:37:49.255048 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:49.163749 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zj4qk" Jul 09 01:37:49.255048 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:49.164031 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a07af9d_8807_44f2_9185_2a4f5f57e0e3.slice/crio-e1067d2df6638b940bb21e30584598accdc3673adffabc2819260f4c80459059 WatchSource:0}: Error finding container e1067d2df6638b940bb21e30584598accdc3673adffabc2819260f4c80459059: Status 404 returned error can't find the container with id e1067d2df6638b940bb21e30584598accdc3673adffabc2819260f4c80459059 Jul 09 01:37:49.255048 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:49.173462 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod872d30ee_57a3_4820_b761_38485e5bfcc0.slice/crio-ed16ef9d6c285839f42d5332bc371dee67fa14b551d880e9223071b769f506ca WatchSource:0}: Error finding container ed16ef9d6c285839f42d5332bc371dee67fa14b551d880e9223071b769f506ca: Status 404 returned error can't find the container with id ed16ef9d6c285839f42d5332bc371dee67fa14b551d880e9223071b769f506ca Jul 09 01:37:49.255048 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:49.179713 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fkgtm" Jul 09 01:37:49.255048 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:49.184003 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nk9t8" Jul 09 01:37:49.255048 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:49.188993 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3289febf_366d_4f6b_857c_be94e8771fba.slice/crio-f378b8dab75fc666dc3e089cf7b08993242d42ddeb94ad0fc0468e9941e5945b WatchSource:0}: Error finding container f378b8dab75fc666dc3e089cf7b08993242d42ddeb94ad0fc0468e9941e5945b: Status 404 returned error can't find the container with id f378b8dab75fc666dc3e089cf7b08993242d42ddeb94ad0fc0468e9941e5945b Jul 09 01:37:49.255048 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:37:49.192963 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92964728_0018_4727_b36c_bf72a97aaeb8.slice/crio-022e99e215b194f859876703975f1ba4f9fad937dd9f398ac6c5d2d4e3b88c38 WatchSource:0}: Error finding container 022e99e215b194f859876703975f1ba4f9fad937dd9f398ac6c5d2d4e3b88c38: Status 404 returned error can't find the container with id 022e99e215b194f859876703975f1ba4f9fad937dd9f398ac6c5d2d4e3b88c38 Jul 09 01:37:49.255048 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:49.194839 2564 kuberuntime_manager.go:1459] "Unhandled Error" err="container iptables-alerter start failed in pod iptables-alerter-nk9t8_openshift-network-operator(92964728-0018-4727-b36c-bf72a97aaeb8): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Jul 09 01:37:49.255048 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:49.194868 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"iptables-alerter\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-network-operator/iptables-alerter-nk9t8" podUID="92964728-0018-4727-b36c-bf72a97aaeb8" Jul 09 01:37:49.418154 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:49.374810 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d06ec329-9c7d-418a-b019-385ecf29cc79-metrics-certs\") pod \"network-metrics-daemon-b2d6x\" (UID: \"d06ec329-9c7d-418a-b019-385ecf29cc79\") " pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:37:49.418154 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:49.374858 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eef45e59-8530-47b9-bdab-917bec4c3c42-original-pull-secret\") pod \"global-pull-secret-syncer-6g7sx\" (UID: \"eef45e59-8530-47b9-bdab-917bec4c3c42\") " pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:37:49.418154 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:49.374959 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 01:37:49.418154 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:49.374970 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 01:37:49.418154 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:49.375022 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d06ec329-9c7d-418a-b019-385ecf29cc79-metrics-certs podName:d06ec329-9c7d-418a-b019-385ecf29cc79 nodeName:}" failed. No retries permitted until 2026-07-09 01:37:50.375007036 +0000 UTC m=+3.036744508 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d06ec329-9c7d-418a-b019-385ecf29cc79-metrics-certs") pod "network-metrics-daemon-b2d6x" (UID: "d06ec329-9c7d-418a-b019-385ecf29cc79") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 01:37:49.418154 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:49.375039 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef45e59-8530-47b9-bdab-917bec4c3c42-original-pull-secret podName:eef45e59-8530-47b9-bdab-917bec4c3c42 nodeName:}" failed. No retries permitted until 2026-07-09 01:37:50.375031956 +0000 UTC m=+3.036769449 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eef45e59-8530-47b9-bdab-917bec4c3c42-original-pull-secret") pod "global-pull-secret-syncer-6g7sx" (UID: "eef45e59-8530-47b9-bdab-917bec4c3c42") : object "kube-system"/"original-pull-secret" not registered Jul 09 01:37:49.560846 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:49.476232 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wrpr\" (UniqueName: \"kubernetes.io/projected/d5a732a0-f772-4ff8-ba3a-9583da4f8600-kube-api-access-2wrpr\") pod \"network-check-target-22lm4\" (UID: \"d5a732a0-f772-4ff8-ba3a-9583da4f8600\") " pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:37:49.560846 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:49.476368 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 01:37:49.560846 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:49.476392 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 01:37:49.560846 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:49.476406 2564 projected.go:196] Error preparing data for projected volume kube-api-access-2wrpr for pod openshift-network-diagnostics/network-check-target-22lm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 01:37:49.560846 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:49.476457 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5a732a0-f772-4ff8-ba3a-9583da4f8600-kube-api-access-2wrpr podName:d5a732a0-f772-4ff8-ba3a-9583da4f8600 nodeName:}" failed. No retries permitted until 2026-07-09 01:37:50.476443001 +0000 UTC m=+3.138180472 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wrpr" (UniqueName: "kubernetes.io/projected/d5a732a0-f772-4ff8-ba3a-9583da4f8600-kube-api-access-2wrpr") pod "network-check-target-22lm4" (UID: "d5a732a0-f772-4ff8-ba3a-9583da4f8600") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 01:37:49.822528 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:49.812216 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 01:32:49 +0000 UTC" deadline="2027-12-21 12:55:00.414524887 +0000 UTC" Jul 09 01:37:49.822528 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:49.812291 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12731h17m10.602238508s" Jul 09 01:37:49.890060 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:49.860634 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:37:49.890060 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:49.860766 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22lm4" podUID="d5a732a0-f772-4ff8-ba3a-9583da4f8600" Jul 09 01:37:49.890060 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:49.867782 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wwf2c" event={"ID":"2a07af9d-8807-44f2-9185-2a4f5f57e0e3","Type":"ContainerStarted","Data":"e1067d2df6638b940bb21e30584598accdc3673adffabc2819260f4c80459059"} Jul 09 01:37:49.890060 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:49.870395 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" event={"ID":"8d27f916-07f4-4432-bd72-f492d1284220","Type":"ContainerStarted","Data":"469d8a05d595a147a7ada4c87942931df043ff4c81ad5d911ba7374659e81d31"} Jul 09 01:37:49.890060 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:49.871957 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6c85z" event={"ID":"96cec375-64d5-4eca-b8dd-fbcd6203396f","Type":"ContainerStarted","Data":"0d331a52a7fd475220b29d32ea85bb6b979ac35f44148c73744fa7ededb75138"} Jul 09 01:37:49.890060 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:49.873469 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c6ppx" event={"ID":"0c28c3d4-f26a-4fb6-906a-32a30f09239e","Type":"ContainerStarted","Data":"5c99d3f66a9e8272a23cd1bbf82b99f6878994cd721176b8e086fd2bf0d092d9"} Jul 09 01:37:49.890060 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:49.874749 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkgtm" event={"ID":"3289febf-366d-4f6b-857c-be94e8771fba","Type":"ContainerStarted","Data":"f378b8dab75fc666dc3e089cf7b08993242d42ddeb94ad0fc0468e9941e5945b"} Jul 09 01:37:49.890060 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:49.876378 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" event={"ID":"4c217b92-49ef-4253-99f9-36dd34352d4f","Type":"ContainerStarted","Data":"d4f6149fb1c1fb314102b2a858204c9394243e360f0610561490023697320e25"} Jul 09 01:37:49.890060 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:49.877749 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4vdb" event={"ID":"14bdf73f-9051-47ef-8a74-4fe4b12c9e0e","Type":"ContainerStarted","Data":"852bace09d23dd2a1515417a091c89d51110c0345d7dbd5e57403a37986a4da0"} Jul 09 01:37:49.890060 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:49.879479 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-181.ec2.internal" event={"ID":"bc1262adfd563bb047fb14c67b9868ad","Type":"ContainerStarted","Data":"0e360e8b6c789a018ddbfacbf9d800a16bfc4bb12a61f13421a91c382bcbf079"} Jul 09 01:37:49.890060 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:49.880818 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-181.ec2.internal" event={"ID":"ddf93b56ea4cef8bce741483c29945e3","Type":"ContainerStarted","Data":"4eac50043d1ff6ab7bd12268af7187585b8232c563e423b991c6a7555cf8e5b8"} Jul 09 01:37:49.890060 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:49.882594 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nk9t8" event={"ID":"92964728-0018-4727-b36c-bf72a97aaeb8","Type":"ContainerStarted","Data":"022e99e215b194f859876703975f1ba4f9fad937dd9f398ac6c5d2d4e3b88c38"} Jul 09 01:37:49.890060 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:49.885699 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"iptables-alerter\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:28389dd118629aa9d7c2525202f3ad6359afb98b6a3bf7672cb1ecfae2418e23\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-network-operator/iptables-alerter-nk9t8" podUID="92964728-0018-4727-b36c-bf72a97aaeb8" Jul 09 01:37:49.901698 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:49.901210 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zj4qk" event={"ID":"872d30ee-57a3-4820-b761-38485e5bfcc0","Type":"ContainerStarted","Data":"ed16ef9d6c285839f42d5332bc371dee67fa14b551d880e9223071b769f506ca"} Jul 09 01:37:50.202112 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:50.201855 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 01:37:50.383197 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:50.383156 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d06ec329-9c7d-418a-b019-385ecf29cc79-metrics-certs\") pod \"network-metrics-daemon-b2d6x\" (UID: \"d06ec329-9c7d-418a-b019-385ecf29cc79\") " pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:37:50.383415 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:50.383235 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eef45e59-8530-47b9-bdab-917bec4c3c42-original-pull-secret\") pod \"global-pull-secret-syncer-6g7sx\" (UID: \"eef45e59-8530-47b9-bdab-917bec4c3c42\") " pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:37:50.383415 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:50.383378 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 01:37:50.383531 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:50.383438 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef45e59-8530-47b9-bdab-917bec4c3c42-original-pull-secret podName:eef45e59-8530-47b9-bdab-917bec4c3c42 nodeName:}" failed. No retries permitted until 2026-07-09 01:37:52.383418933 +0000 UTC m=+5.045156410 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eef45e59-8530-47b9-bdab-917bec4c3c42-original-pull-secret") pod "global-pull-secret-syncer-6g7sx" (UID: "eef45e59-8530-47b9-bdab-917bec4c3c42") : object "kube-system"/"original-pull-secret" not registered Jul 09 01:37:50.383857 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:50.383828 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 01:37:50.383937 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:50.383884 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d06ec329-9c7d-418a-b019-385ecf29cc79-metrics-certs podName:d06ec329-9c7d-418a-b019-385ecf29cc79 nodeName:}" failed. No retries permitted until 2026-07-09 01:37:52.383867666 +0000 UTC m=+5.045605155 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d06ec329-9c7d-418a-b019-385ecf29cc79-metrics-certs") pod "network-metrics-daemon-b2d6x" (UID: "d06ec329-9c7d-418a-b019-385ecf29cc79") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 01:37:50.484629 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:50.484544 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wrpr\" (UniqueName: \"kubernetes.io/projected/d5a732a0-f772-4ff8-ba3a-9583da4f8600-kube-api-access-2wrpr\") pod \"network-check-target-22lm4\" (UID: \"d5a732a0-f772-4ff8-ba3a-9583da4f8600\") " pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:37:50.484804 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:50.484718 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 01:37:50.484804 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:50.484742 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 01:37:50.484804 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:50.484754 2564 projected.go:196] Error preparing data for projected volume kube-api-access-2wrpr for pod openshift-network-diagnostics/network-check-target-22lm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 01:37:50.484978 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:50.484813 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5a732a0-f772-4ff8-ba3a-9583da4f8600-kube-api-access-2wrpr podName:d5a732a0-f772-4ff8-ba3a-9583da4f8600 nodeName:}" failed. No retries permitted until 2026-07-09 01:37:52.484794382 +0000 UTC m=+5.146531859 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wrpr" (UniqueName: "kubernetes.io/projected/d5a732a0-f772-4ff8-ba3a-9583da4f8600-kube-api-access-2wrpr") pod "network-check-target-22lm4" (UID: "d5a732a0-f772-4ff8-ba3a-9583da4f8600") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 01:37:50.612896 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:50.612534 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 01:37:50.813468 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:50.813341 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 01:32:49 +0000 UTC" deadline="2028-02-22 04:34:19.896139606 +0000 UTC" Jul 09 01:37:50.813468 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:50.813416 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14234h56m29.08272887s" Jul 09 01:37:50.860608 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:50.860574 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:37:50.861102 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:50.860731 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2d6x" podUID="d06ec329-9c7d-418a-b019-385ecf29cc79" Jul 09 01:37:50.861193 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:50.861152 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:37:50.861290 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:50.861249 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g7sx" podUID="eef45e59-8530-47b9-bdab-917bec4c3c42" Jul 09 01:37:51.863487 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:51.863457 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:37:51.864005 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:51.863586 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22lm4" podUID="d5a732a0-f772-4ff8-ba3a-9583da4f8600" Jul 09 01:37:52.403750 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:52.403700 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d06ec329-9c7d-418a-b019-385ecf29cc79-metrics-certs\") pod \"network-metrics-daemon-b2d6x\" (UID: \"d06ec329-9c7d-418a-b019-385ecf29cc79\") " pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:37:52.403950 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:52.403779 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eef45e59-8530-47b9-bdab-917bec4c3c42-original-pull-secret\") pod \"global-pull-secret-syncer-6g7sx\" (UID: \"eef45e59-8530-47b9-bdab-917bec4c3c42\") " pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:37:52.403950 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:52.403923 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 01:37:52.404075 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:52.403994 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef45e59-8530-47b9-bdab-917bec4c3c42-original-pull-secret podName:eef45e59-8530-47b9-bdab-917bec4c3c42 nodeName:}" failed. No retries permitted until 2026-07-09 01:37:56.403973937 +0000 UTC m=+9.065711431 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eef45e59-8530-47b9-bdab-917bec4c3c42-original-pull-secret") pod "global-pull-secret-syncer-6g7sx" (UID: "eef45e59-8530-47b9-bdab-917bec4c3c42") : object "kube-system"/"original-pull-secret" not registered Jul 09 01:37:52.404454 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:52.404432 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 01:37:52.404559 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:52.404501 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d06ec329-9c7d-418a-b019-385ecf29cc79-metrics-certs podName:d06ec329-9c7d-418a-b019-385ecf29cc79 nodeName:}" failed. No retries permitted until 2026-07-09 01:37:56.40448228 +0000 UTC m=+9.066219803 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d06ec329-9c7d-418a-b019-385ecf29cc79-metrics-certs") pod "network-metrics-daemon-b2d6x" (UID: "d06ec329-9c7d-418a-b019-385ecf29cc79") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 01:37:52.504452 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:52.504409 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wrpr\" (UniqueName: \"kubernetes.io/projected/d5a732a0-f772-4ff8-ba3a-9583da4f8600-kube-api-access-2wrpr\") pod \"network-check-target-22lm4\" (UID: \"d5a732a0-f772-4ff8-ba3a-9583da4f8600\") " pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:37:52.504614 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:52.504597 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 01:37:52.504692 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:52.504617 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 01:37:52.504692 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:52.504631 2564 projected.go:196] Error preparing data for projected volume kube-api-access-2wrpr for pod openshift-network-diagnostics/network-check-target-22lm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 01:37:52.504692 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:52.504691 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5a732a0-f772-4ff8-ba3a-9583da4f8600-kube-api-access-2wrpr podName:d5a732a0-f772-4ff8-ba3a-9583da4f8600 nodeName:}" failed. No retries permitted until 2026-07-09 01:37:56.504672856 +0000 UTC m=+9.166410330 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wrpr" (UniqueName: "kubernetes.io/projected/d5a732a0-f772-4ff8-ba3a-9583da4f8600-kube-api-access-2wrpr") pod "network-check-target-22lm4" (UID: "d5a732a0-f772-4ff8-ba3a-9583da4f8600") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 01:37:52.861060 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:52.860364 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:37:52.861060 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:52.860508 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2d6x" podUID="d06ec329-9c7d-418a-b019-385ecf29cc79" Jul 09 01:37:52.861060 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:52.860900 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:37:52.861060 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:52.861009 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g7sx" podUID="eef45e59-8530-47b9-bdab-917bec4c3c42" Jul 09 01:37:53.860833 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:53.860789 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:37:53.866567 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:53.861559 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22lm4" podUID="d5a732a0-f772-4ff8-ba3a-9583da4f8600" Jul 09 01:37:54.861247 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:54.861189 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:37:54.861700 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:54.861348 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2d6x" podUID="d06ec329-9c7d-418a-b019-385ecf29cc79" Jul 09 01:37:54.861700 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:54.861677 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:37:54.861843 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:54.861758 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g7sx" podUID="eef45e59-8530-47b9-bdab-917bec4c3c42" Jul 09 01:37:55.861061 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:55.861024 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:37:55.861209 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:55.861154 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22lm4" podUID="d5a732a0-f772-4ff8-ba3a-9583da4f8600" Jul 09 01:37:56.443260 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:56.443157 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d06ec329-9c7d-418a-b019-385ecf29cc79-metrics-certs\") pod \"network-metrics-daemon-b2d6x\" (UID: \"d06ec329-9c7d-418a-b019-385ecf29cc79\") " pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:37:56.443722 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:56.443296 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eef45e59-8530-47b9-bdab-917bec4c3c42-original-pull-secret\") pod \"global-pull-secret-syncer-6g7sx\" (UID: \"eef45e59-8530-47b9-bdab-917bec4c3c42\") " pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:37:56.443722 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:56.443331 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 01:37:56.443722 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:56.443398 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 01:37:56.443722 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:56.443409 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d06ec329-9c7d-418a-b019-385ecf29cc79-metrics-certs podName:d06ec329-9c7d-418a-b019-385ecf29cc79 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:04.443386431 +0000 UTC m=+17.105123903 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d06ec329-9c7d-418a-b019-385ecf29cc79-metrics-certs") pod "network-metrics-daemon-b2d6x" (UID: "d06ec329-9c7d-418a-b019-385ecf29cc79") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 01:37:56.443722 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:56.443468 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef45e59-8530-47b9-bdab-917bec4c3c42-original-pull-secret podName:eef45e59-8530-47b9-bdab-917bec4c3c42 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:04.443451873 +0000 UTC m=+17.105189358 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eef45e59-8530-47b9-bdab-917bec4c3c42-original-pull-secret") pod "global-pull-secret-syncer-6g7sx" (UID: "eef45e59-8530-47b9-bdab-917bec4c3c42") : object "kube-system"/"original-pull-secret" not registered Jul 09 01:37:56.544376 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:56.544287 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wrpr\" (UniqueName: \"kubernetes.io/projected/d5a732a0-f772-4ff8-ba3a-9583da4f8600-kube-api-access-2wrpr\") pod \"network-check-target-22lm4\" (UID: \"d5a732a0-f772-4ff8-ba3a-9583da4f8600\") " pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:37:56.544530 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:56.544445 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 01:37:56.544530 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:56.544467 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 01:37:56.544530 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:56.544479 2564 projected.go:196] Error preparing data for projected volume kube-api-access-2wrpr for pod openshift-network-diagnostics/network-check-target-22lm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 01:37:56.544709 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:56.544534 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5a732a0-f772-4ff8-ba3a-9583da4f8600-kube-api-access-2wrpr podName:d5a732a0-f772-4ff8-ba3a-9583da4f8600 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:04.544515807 +0000 UTC m=+17.206253283 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wrpr" (UniqueName: "kubernetes.io/projected/d5a732a0-f772-4ff8-ba3a-9583da4f8600-kube-api-access-2wrpr") pod "network-check-target-22lm4" (UID: "d5a732a0-f772-4ff8-ba3a-9583da4f8600") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 01:37:56.860709 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:56.860623 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:37:56.860709 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:56.860651 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:37:56.860910 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:56.860757 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2d6x" podUID="d06ec329-9c7d-418a-b019-385ecf29cc79" Jul 09 01:37:56.860910 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:56.860883 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g7sx" podUID="eef45e59-8530-47b9-bdab-917bec4c3c42" Jul 09 01:37:57.861704 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:57.861668 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:37:57.862196 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:57.861785 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22lm4" podUID="d5a732a0-f772-4ff8-ba3a-9583da4f8600" Jul 09 01:37:58.861344 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:58.861270 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:37:58.861344 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:58.861314 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:37:58.861578 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:58.861396 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g7sx" podUID="eef45e59-8530-47b9-bdab-917bec4c3c42" Jul 09 01:37:58.861578 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:58.861558 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2d6x" podUID="d06ec329-9c7d-418a-b019-385ecf29cc79" Jul 09 01:37:59.861882 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:37:59.861417 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:37:59.861882 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:37:59.861542 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22lm4" podUID="d5a732a0-f772-4ff8-ba3a-9583da4f8600" Jul 09 01:38:00.860690 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:00.860420 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:38:00.860874 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:00.860717 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g7sx" podUID="eef45e59-8530-47b9-bdab-917bec4c3c42" Jul 09 01:38:00.860970 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:00.860539 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:38:00.861134 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:00.861111 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2d6x" podUID="d06ec329-9c7d-418a-b019-385ecf29cc79" Jul 09 01:38:00.956378 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:00.956340 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" event={"ID":"4c217b92-49ef-4253-99f9-36dd34352d4f","Type":"ContainerStarted","Data":"8090ea539f3bd9dd44a6293f5f0270bd006150f7c737f5f220a44f7da0f1b0aa"} Jul 09 01:38:00.985633 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:00.985085 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lvbc2" podStartSLOduration=1.45194393 podStartE2EDuration="12.985067218s" totalImagesPullingTime="11.533123288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:37:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:00.972485431 +0000 UTC m=+13.634222924" watchObservedRunningTime="2026-07-09 01:38:00.985067218 +0000 UTC m=+13.646804711" Jul 09 01:38:00.985633 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:00.985513 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-181.ec2.internal" podStartSLOduration=11.985500737 podStartE2EDuration="11.985500737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:37:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:00.984790629 +0000 UTC m=+13.646528122" watchObservedRunningTime="2026-07-09 01:38:00.985500737 +0000 UTC m=+13.647238230" Jul 09 01:38:01.861576 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:01.861547 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:38:01.861758 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:01.861670 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22lm4" podUID="d5a732a0-f772-4ff8-ba3a-9583da4f8600" Jul 09 01:38:01.962396 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:01.962354 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-181.ec2.internal" event={"ID":"bc1262adfd563bb047fb14c67b9868ad","Type":"ContainerStarted","Data":"f852070b8e9491c9b2655a9370007c15f9ab1272111827cbb483d66b656124dc"} Jul 09 01:38:02.861334 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:02.861120 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:38:02.861334 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:02.861176 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:38:02.861334 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:02.861290 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2d6x" podUID="d06ec329-9c7d-418a-b019-385ecf29cc79" Jul 09 01:38:02.861604 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:02.861424 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g7sx" podUID="eef45e59-8530-47b9-bdab-917bec4c3c42" Jul 09 01:38:02.965790 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:02.965751 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4vdb" event={"ID":"14bdf73f-9051-47ef-8a74-4fe4b12c9e0e","Type":"ContainerStarted","Data":"dd3a568feac856135451d6f3ec1edfbcaf9a7d11053deabf34b61d1575e7750f"} Jul 09 01:38:02.967583 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:02.967550 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-181.ec2.internal" event={"ID":"ddf93b56ea4cef8bce741483c29945e3","Type":"ContainerStarted","Data":"97c1a7e4275d82f6ac143fbb8cec257df902efab21bcde10bae3f7a0ed9c93aa"} Jul 09 01:38:02.971300 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:02.971270 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zj4qk" event={"ID":"872d30ee-57a3-4820-b761-38485e5bfcc0","Type":"ContainerStarted","Data":"e04acbecb01c8b5f33780269ef40623066e73884d7efd7215cccc4cc507995b4"} Jul 09 01:38:02.972989 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:02.972965 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wwf2c" event={"ID":"2a07af9d-8807-44f2-9185-2a4f5f57e0e3","Type":"ContainerStarted","Data":"3411e9e593f807fed3ec4051e9b0ad254910f88e2d0b46c468364531df618968"} Jul 09 01:38:02.974631 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:02.974604 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c6ppx" event={"ID":"0c28c3d4-f26a-4fb6-906a-32a30f09239e","Type":"ContainerStarted","Data":"bb89096e8d294f84bbb2beccb7db58323e3fee373689e2ff9b0d4fdd32b61295"} Jul 09 01:38:02.976282 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:02.976257 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkgtm" event={"ID":"3289febf-366d-4f6b-857c-be94e8771fba","Type":"ContainerStarted","Data":"99d1b4528fb38fbadb986891babf0bd17797d0c0826c473cf30150ab6db6b110"} Jul 09 01:38:03.012270 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:03.011801 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-c6ppx" podStartSLOduration=3.411565748 podStartE2EDuration="15.011784416s" totalImagesPullingTime="11.600218668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:37:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:03.011567909 +0000 UTC m=+15.673305401" watchObservedRunningTime="2026-07-09 01:38:03.011784416 +0000 UTC m=+15.673521909" Jul 09 01:38:03.024989 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:03.024930 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wwf2c" podStartSLOduration=3.496355672 podStartE2EDuration="15.024909631s" totalImagesPullingTime="11.528553959s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:37:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:03.024614082 +0000 UTC m=+15.686351575" watchObservedRunningTime="2026-07-09 01:38:03.024909631 +0000 UTC m=+15.686647122" Jul 09 01:38:03.038023 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:03.037949 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zj4qk" podStartSLOduration=3.515424923 podStartE2EDuration="15.03793535s" totalImagesPullingTime="11.522510427s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:37:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:03.03746458 +0000 UTC m=+15.699202072" watchObservedRunningTime="2026-07-09 01:38:03.03793535 +0000 UTC m=+15.699672842" Jul 09 01:38:03.861445 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:03.861409 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:38:03.861634 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:03.861531 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22lm4" podUID="d5a732a0-f772-4ff8-ba3a-9583da4f8600" Jul 09 01:38:04.511099 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:04.511060 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eef45e59-8530-47b9-bdab-917bec4c3c42-original-pull-secret\") pod \"global-pull-secret-syncer-6g7sx\" (UID: \"eef45e59-8530-47b9-bdab-917bec4c3c42\") " pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:38:04.511590 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:04.511147 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d06ec329-9c7d-418a-b019-385ecf29cc79-metrics-certs\") pod \"network-metrics-daemon-b2d6x\" (UID: \"d06ec329-9c7d-418a-b019-385ecf29cc79\") " pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:38:04.511590 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:04.511206 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 01:38:04.511590 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:04.511277 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef45e59-8530-47b9-bdab-917bec4c3c42-original-pull-secret podName:eef45e59-8530-47b9-bdab-917bec4c3c42 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:20.511263048 +0000 UTC m=+33.173000540 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eef45e59-8530-47b9-bdab-917bec4c3c42-original-pull-secret") pod "global-pull-secret-syncer-6g7sx" (UID: "eef45e59-8530-47b9-bdab-917bec4c3c42") : object "kube-system"/"original-pull-secret" not registered Jul 09 01:38:04.511590 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:04.511288 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 01:38:04.511590 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:04.511334 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d06ec329-9c7d-418a-b019-385ecf29cc79-metrics-certs podName:d06ec329-9c7d-418a-b019-385ecf29cc79 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:20.511319953 +0000 UTC m=+33.173057426 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d06ec329-9c7d-418a-b019-385ecf29cc79-metrics-certs") pod "network-metrics-daemon-b2d6x" (UID: "d06ec329-9c7d-418a-b019-385ecf29cc79") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 01:38:04.612371 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:04.612332 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wrpr\" (UniqueName: \"kubernetes.io/projected/d5a732a0-f772-4ff8-ba3a-9583da4f8600-kube-api-access-2wrpr\") pod \"network-check-target-22lm4\" (UID: \"d5a732a0-f772-4ff8-ba3a-9583da4f8600\") " pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:38:04.612551 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:04.612494 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 01:38:04.612551 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:04.612514 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 01:38:04.612551 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:04.612528 2564 projected.go:196] Error preparing data for projected volume kube-api-access-2wrpr for pod openshift-network-diagnostics/network-check-target-22lm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 01:38:04.612699 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:04.612587 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5a732a0-f772-4ff8-ba3a-9583da4f8600-kube-api-access-2wrpr podName:d5a732a0-f772-4ff8-ba3a-9583da4f8600 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:20.612569933 +0000 UTC m=+33.274307416 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wrpr" (UniqueName: "kubernetes.io/projected/d5a732a0-f772-4ff8-ba3a-9583da4f8600-kube-api-access-2wrpr") pod "network-check-target-22lm4" (UID: "d5a732a0-f772-4ff8-ba3a-9583da4f8600") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 01:38:04.860943 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:04.860856 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:38:04.861127 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:04.860870 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:38:04.861127 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:04.860992 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2d6x" podUID="d06ec329-9c7d-418a-b019-385ecf29cc79" Jul 09 01:38:04.861127 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:04.861053 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g7sx" podUID="eef45e59-8530-47b9-bdab-917bec4c3c42" Jul 09 01:38:05.860534 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:05.860497 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:38:05.860936 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:05.860624 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22lm4" podUID="d5a732a0-f772-4ff8-ba3a-9583da4f8600" Jul 09 01:38:05.983746 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:05.983703 2564 generic.go:356] "Generic (PLEG): container finished" podID="3289febf-366d-4f6b-857c-be94e8771fba" containerID="99d1b4528fb38fbadb986891babf0bd17797d0c0826c473cf30150ab6db6b110" exitCode=0 Jul 09 01:38:05.983915 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:05.983778 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkgtm" event={"ID":"3289febf-366d-4f6b-857c-be94e8771fba","Type":"ContainerDied","Data":"99d1b4528fb38fbadb986891babf0bd17797d0c0826c473cf30150ab6db6b110"} Jul 09 01:38:05.987280 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:05.986580 2564 generic.go:356] "Generic (PLEG): container finished" podID="ddf93b56ea4cef8bce741483c29945e3" containerID="97c1a7e4275d82f6ac143fbb8cec257df902efab21bcde10bae3f7a0ed9c93aa" exitCode=0 Jul 09 01:38:05.987280 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:05.986667 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-181.ec2.internal" event={"ID":"ddf93b56ea4cef8bce741483c29945e3","Type":"ContainerDied","Data":"97c1a7e4275d82f6ac143fbb8cec257df902efab21bcde10bae3f7a0ed9c93aa"} Jul 09 01:38:06.751670 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:06.751640 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-c6ppx" Jul 09 01:38:06.752386 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:06.752361 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-c6ppx" Jul 09 01:38:06.861006 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:06.860972 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:38:06.861486 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:06.861109 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g7sx" podUID="eef45e59-8530-47b9-bdab-917bec4c3c42" Jul 09 01:38:06.861486 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:06.861172 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:38:06.861486 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:06.861305 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2d6x" podUID="d06ec329-9c7d-418a-b019-385ecf29cc79" Jul 09 01:38:07.861523 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:07.861297 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:38:07.861992 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:07.861617 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22lm4" podUID="d5a732a0-f772-4ff8-ba3a-9583da4f8600" Jul 09 01:38:08.860580 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:08.860556 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:38:08.860580 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:08.860579 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:38:08.860826 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:08.860655 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g7sx" podUID="eef45e59-8530-47b9-bdab-917bec4c3c42" Jul 09 01:38:08.860826 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:08.860798 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2d6x" podUID="d06ec329-9c7d-418a-b019-385ecf29cc79" Jul 09 01:38:09.860898 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:09.860867 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:38:09.861373 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:09.860982 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22lm4" podUID="d5a732a0-f772-4ff8-ba3a-9583da4f8600" Jul 09 01:38:10.362521 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:10.362368 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 01:38:10.468810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:10.468282 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-c6ppx" Jul 09 01:38:10.468810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:10.468414 2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 01:38:10.469162 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:10.469061 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-c6ppx" Jul 09 01:38:10.853243 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:10.853139 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T01:38:10.362527099Z","UUID":"339bbe7b-725d-4a38-b4c8-e23bb97fcc95","Handler":null,"Name":"","Endpoint":""} Jul 09 01:38:10.855147 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:10.855124 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 01:38:10.855306 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:10.855167 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 01:38:10.860520 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:10.860500 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:38:10.860631 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:10.860500 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:38:10.860696 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:10.860629 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2d6x" podUID="d06ec329-9c7d-418a-b019-385ecf29cc79" Jul 09 01:38:10.860696 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:10.860682 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g7sx" podUID="eef45e59-8530-47b9-bdab-917bec4c3c42" Jul 09 01:38:10.999609 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:10.999575 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" event={"ID":"8d27f916-07f4-4432-bd72-f492d1284220","Type":"ContainerStarted","Data":"dd25cfefa335f0d79a7be5527b0348ef39cb8eb87a374018f41750c5b75a87c6"} Jul 09 01:38:11.000466 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:10.999649 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" event={"ID":"8d27f916-07f4-4432-bd72-f492d1284220","Type":"ContainerStarted","Data":"aae61e478b50a5b70db683e1e5e50b9a1f8bd4075c975f8ad16ae07c3bfe9b6a"} Jul 09 01:38:11.000466 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:10.999692 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" event={"ID":"8d27f916-07f4-4432-bd72-f492d1284220","Type":"ContainerStarted","Data":"7825b88cde22367aee43c494aeba585e4d0994441f995854f97aae86369b3349"} Jul 09 01:38:11.000466 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:10.999750 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" event={"ID":"8d27f916-07f4-4432-bd72-f492d1284220","Type":"ContainerStarted","Data":"d87083d0e49703b71669a08b3c83ebed337b14c82212e24d7770d6d7b6d3088b"} Jul 09 01:38:11.000466 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:10.999798 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" event={"ID":"8d27f916-07f4-4432-bd72-f492d1284220","Type":"ContainerStarted","Data":"af03a70627b861addaee2e1b10de37ba5bdfdb159bb5bf4b86777295f1ce7bad"} Jul 09 01:38:11.000466 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:10.999844 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" event={"ID":"8d27f916-07f4-4432-bd72-f492d1284220","Type":"ContainerStarted","Data":"c4a90d9661c88ef245a0e1b3070b397eae3990f95b29ad8825acbfd6730c2a35"} Jul 09 01:38:11.001137 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:11.001111 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6c85z" event={"ID":"96cec375-64d5-4eca-b8dd-fbcd6203396f","Type":"ContainerStarted","Data":"41b7fcd7d6b17bc9b12ea775284410e2964289868aa6c1b70cb01118ff008e78"} Jul 09 01:38:11.003287 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:11.003266 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4vdb" event={"ID":"14bdf73f-9051-47ef-8a74-4fe4b12c9e0e","Type":"ContainerStarted","Data":"ebe5e06b1f5e64fe73ec0094e8f1a74dc4ff630a7e12453e2df650f72eaf8dee"} Jul 09 01:38:11.005204 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:11.005181 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-181.ec2.internal" event={"ID":"ddf93b56ea4cef8bce741483c29945e3","Type":"ContainerStarted","Data":"3f8df3d99112e81993827918136d80789136520ca01e521962c7d9f3daddd8c2"} Jul 09 01:38:11.018056 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:11.018010 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6c85z" podStartSLOduration=2.007793488 podStartE2EDuration="23.017996513s" totalImagesPullingTime="21.010203025s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:37:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:11.017631975 +0000 UTC m=+23.679369477" watchObservedRunningTime="2026-07-09 01:38:11.017996513 +0000 UTC m=+23.679734005" Jul 09 01:38:11.033611 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:11.033523 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-181.ec2.internal" podStartSLOduration=22.033505077 podStartE2EDuration="22.033505077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:37:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:11.032593618 +0000 UTC m=+23.694331111" watchObservedRunningTime="2026-07-09 01:38:11.033505077 +0000 UTC m=+23.695242570" Jul 09 01:38:11.861221 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:11.861155 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:38:11.861387 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:11.861266 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22lm4" podUID="d5a732a0-f772-4ff8-ba3a-9583da4f8600" Jul 09 01:38:12.008726 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:12.008695 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nk9t8" event={"ID":"92964728-0018-4727-b36c-bf72a97aaeb8","Type":"ContainerStarted","Data":"5b9d2e17f95323d976c27f3c704d1a280c2ae45a3d0367b53239f481618ac8d5"} Jul 09 01:38:12.022336 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:12.022295 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nk9t8" podStartSLOduration=24.022283154 podStartE2EDuration="24.022283154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:37:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-09 01:38:12.022147085 +0000 UTC m=+24.683884577" watchObservedRunningTime="2026-07-09 01:38:12.022283154 +0000 UTC m=+24.684020645" Jul 09 01:38:12.861087 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:12.861058 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:38:12.861277 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:12.861070 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:38:12.861277 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:12.861191 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g7sx" podUID="eef45e59-8530-47b9-bdab-917bec4c3c42" Jul 09 01:38:12.861392 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:12.861285 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2d6x" podUID="d06ec329-9c7d-418a-b019-385ecf29cc79" Jul 09 01:38:13.013438 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:13.013356 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4vdb" event={"ID":"14bdf73f-9051-47ef-8a74-4fe4b12c9e0e","Type":"ContainerStarted","Data":"11b52bab11f84114e13e6279852ab18767e9b1db7e3e4f3095b6ea57985dd33a"} Jul 09 01:38:13.016966 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:13.016940 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" event={"ID":"8d27f916-07f4-4432-bd72-f492d1284220","Type":"ContainerStarted","Data":"4ada2a20d84a4df7844655f5d8d270559271a0238964f4ee400b2db65cdc56ae"} Jul 09 01:38:13.030897 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:13.030857 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4vdb" podStartSLOduration=3.792361604 podStartE2EDuration="25.030843641s" totalImagesPullingTime="21.238482037s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:37:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:13.030622942 +0000 UTC m=+25.692360434" watchObservedRunningTime="2026-07-09 01:38:13.030843641 +0000 UTC m=+25.692581132" Jul 09 01:38:13.860741 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:13.860709 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:38:13.860905 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:13.860853 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22lm4" podUID="d5a732a0-f772-4ff8-ba3a-9583da4f8600" Jul 09 01:38:14.861312 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:14.861048 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:38:14.861691 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:14.861087 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:38:14.861691 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:14.861429 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g7sx" podUID="eef45e59-8530-47b9-bdab-917bec4c3c42" Jul 09 01:38:14.861691 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:14.861473 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2d6x" podUID="d06ec329-9c7d-418a-b019-385ecf29cc79" Jul 09 01:38:15.860707 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:15.860661 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:38:15.860876 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:15.860829 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22lm4" podUID="d5a732a0-f772-4ff8-ba3a-9583da4f8600" Jul 09 01:38:16.861207 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:16.860963 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:38:16.861207 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:16.860963 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:38:16.861899 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:16.861248 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g7sx" podUID="eef45e59-8530-47b9-bdab-917bec4c3c42" Jul 09 01:38:16.861899 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:16.861300 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2d6x" podUID="d06ec329-9c7d-418a-b019-385ecf29cc79" Jul 09 01:38:17.029384 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:17.029354 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" event={"ID":"8d27f916-07f4-4432-bd72-f492d1284220","Type":"ContainerStarted","Data":"1cedf80de4676db8d4c8faaac3a1c4bf4c02b5c6d44ac497ff904a444a3088a9"} Jul 09 01:38:17.029621 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:17.029603 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:38:17.031181 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:17.031156 2564 generic.go:356] "Generic (PLEG): container finished" podID="3289febf-366d-4f6b-857c-be94e8771fba" containerID="781a041077e373449684149af4dd5b326add95a57e147172ebbbb81952d04097" exitCode=0 Jul 09 01:38:17.031279 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:17.031198 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkgtm" event={"ID":"3289febf-366d-4f6b-857c-be94e8771fba","Type":"ContainerDied","Data":"781a041077e373449684149af4dd5b326add95a57e147172ebbbb81952d04097"} Jul 09 01:38:17.044736 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:17.044716 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:38:17.060398 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:17.060354 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" podStartSLOduration=7.997320654 podStartE2EDuration="29.060340403s" totalImagesPullingTime="21.063019749s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:37:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:17.059901301 +0000 UTC m=+29.721638794" watchObservedRunningTime="2026-07-09 01:38:17.060340403 +0000 UTC m=+29.722077894" Jul 09 01:38:17.861883 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:17.861850 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:38:17.862227 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:17.861964 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22lm4" podUID="d5a732a0-f772-4ff8-ba3a-9583da4f8600" Jul 09 01:38:18.034454 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:18.034421 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:38:18.034629 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:18.034500 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:38:18.051768 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:18.051741 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:38:18.305365 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:18.305339 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6g7sx"] Jul 09 01:38:18.305485 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:18.305458 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:38:18.305586 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:18.305566 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g7sx" podUID="eef45e59-8530-47b9-bdab-917bec4c3c42" Jul 09 01:38:18.308792 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:18.308765 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-22lm4"] Jul 09 01:38:18.308890 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:18.308851 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:38:18.308960 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:18.308941 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22lm4" podUID="d5a732a0-f772-4ff8-ba3a-9583da4f8600" Jul 09 01:38:18.309412 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:18.309392 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b2d6x"] Jul 09 01:38:18.309488 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:18.309475 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:38:18.309575 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:18.309556 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2d6x" podUID="d06ec329-9c7d-418a-b019-385ecf29cc79" Jul 09 01:38:19.038084 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:19.038054 2564 generic.go:356] "Generic (PLEG): container finished" podID="3289febf-366d-4f6b-857c-be94e8771fba" containerID="0e7e3f55543940493c37ce8593ee96c83d7247679ba48de5c20fcc38d22f3c32" exitCode=0 Jul 09 01:38:19.038442 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:19.038131 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkgtm" event={"ID":"3289febf-366d-4f6b-857c-be94e8771fba","Type":"ContainerDied","Data":"0e7e3f55543940493c37ce8593ee96c83d7247679ba48de5c20fcc38d22f3c32"} Jul 09 01:38:19.861397 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:19.861324 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:38:19.861537 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:19.861329 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:38:19.861537 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:19.861454 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g7sx" podUID="eef45e59-8530-47b9-bdab-917bec4c3c42" Jul 09 01:38:19.861640 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:19.861546 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2d6x" podUID="d06ec329-9c7d-418a-b019-385ecf29cc79" Jul 09 01:38:19.861640 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:19.861332 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:38:19.861732 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:19.861649 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22lm4" podUID="d5a732a0-f772-4ff8-ba3a-9583da4f8600" Jul 09 01:38:20.529617 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:20.529448 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eef45e59-8530-47b9-bdab-917bec4c3c42-original-pull-secret\") pod \"global-pull-secret-syncer-6g7sx\" (UID: \"eef45e59-8530-47b9-bdab-917bec4c3c42\") " pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:38:20.529900 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:20.529655 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d06ec329-9c7d-418a-b019-385ecf29cc79-metrics-certs\") pod \"network-metrics-daemon-b2d6x\" (UID: \"d06ec329-9c7d-418a-b019-385ecf29cc79\") " pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:38:20.529900 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:20.529593 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 01:38:20.529900 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:20.529741 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef45e59-8530-47b9-bdab-917bec4c3c42-original-pull-secret podName:eef45e59-8530-47b9-bdab-917bec4c3c42 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:52.529724705 +0000 UTC m=+65.191462191 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eef45e59-8530-47b9-bdab-917bec4c3c42-original-pull-secret") pod "global-pull-secret-syncer-6g7sx" (UID: "eef45e59-8530-47b9-bdab-917bec4c3c42") : object "kube-system"/"original-pull-secret" not registered Jul 09 01:38:20.529900 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:20.529741 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 01:38:20.529900 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:20.529781 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d06ec329-9c7d-418a-b019-385ecf29cc79-metrics-certs podName:d06ec329-9c7d-418a-b019-385ecf29cc79 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:52.529770264 +0000 UTC m=+65.191507738 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d06ec329-9c7d-418a-b019-385ecf29cc79-metrics-certs") pod "network-metrics-daemon-b2d6x" (UID: "d06ec329-9c7d-418a-b019-385ecf29cc79") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 01:38:20.630973 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:20.630890 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wrpr\" (UniqueName: \"kubernetes.io/projected/d5a732a0-f772-4ff8-ba3a-9583da4f8600-kube-api-access-2wrpr\") pod \"network-check-target-22lm4\" (UID: \"d5a732a0-f772-4ff8-ba3a-9583da4f8600\") " pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:38:20.631099 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:20.631062 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 01:38:20.631099 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:20.631079 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 01:38:20.631099 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:20.631089 2564 projected.go:196] Error preparing data for projected volume kube-api-access-2wrpr for pod openshift-network-diagnostics/network-check-target-22lm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 01:38:20.631195 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:20.631142 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5a732a0-f772-4ff8-ba3a-9583da4f8600-kube-api-access-2wrpr podName:d5a732a0-f772-4ff8-ba3a-9583da4f8600 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:52.631125429 +0000 UTC m=+65.292862913 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wrpr" (UniqueName: "kubernetes.io/projected/d5a732a0-f772-4ff8-ba3a-9583da4f8600-kube-api-access-2wrpr") pod "network-check-target-22lm4" (UID: "d5a732a0-f772-4ff8-ba3a-9583da4f8600") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 01:38:21.044074 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:21.044042 2564 generic.go:356] "Generic (PLEG): container finished" podID="3289febf-366d-4f6b-857c-be94e8771fba" containerID="6f2e7b143ca40193c451fa2027344c680642bbfe4463a01f1c7f21726a751ea7" exitCode=0 Jul 09 01:38:21.044255 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:21.044086 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkgtm" event={"ID":"3289febf-366d-4f6b-857c-be94e8771fba","Type":"ContainerDied","Data":"6f2e7b143ca40193c451fa2027344c680642bbfe4463a01f1c7f21726a751ea7"} Jul 09 01:38:21.861298 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:21.861213 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:38:21.861717 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:21.861213 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:38:21.861717 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:21.861331 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2d6x" podUID="d06ec329-9c7d-418a-b019-385ecf29cc79" Jul 09 01:38:21.861717 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:21.861385 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6g7sx" podUID="eef45e59-8530-47b9-bdab-917bec4c3c42" Jul 09 01:38:21.861717 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:21.861213 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:38:21.861717 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:21.861452 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-22lm4" podUID="d5a732a0-f772-4ff8-ba3a-9583da4f8600" Jul 09 01:38:23.172547 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.172514 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-181.ec2.internal" event="NodeReady" Jul 09 01:38:23.173113 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.172679 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 01:38:23.207090 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.207059 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9z9g5"] Jul 09 01:38:23.211064 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.211043 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9z9g5" Jul 09 01:38:23.212452 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.212431 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p5xcw"] Jul 09 01:38:23.214022 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.213382 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 09 01:38:23.214022 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.213410 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 09 01:38:23.214022 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.213842 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 09 01:38:23.214823 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.214052 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 09 01:38:23.215117 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.215085 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-p928l\"" Jul 09 01:38:23.216634 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.216105 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-56f4fc4775-qvb8g"] Jul 09 01:38:23.216774 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.216754 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p5xcw" Jul 09 01:38:23.218825 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.218806 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 09 01:38:23.218924 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.218826 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 09 01:38:23.218985 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.218927 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jm8rq\"" Jul 09 01:38:23.219557 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.219540 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rxlj9"] Jul 09 01:38:23.219678 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.219661 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:23.221022 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.220972 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 09 01:38:23.221916 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.221625 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 01:38:23.221916 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.221736 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wqnbs\"" Jul 09 01:38:23.222932 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.222258 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 01:38:23.222932 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.222573 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 01:38:23.223075 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.223058 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-h8pb8"] Jul 09 01:38:23.223273 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.223258 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rxlj9" Jul 09 01:38:23.225947 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.225705 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 09 01:38:23.225947 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.225706 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6klll\"" Jul 09 01:38:23.225947 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.225804 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 09 01:38:23.226492 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.226454 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-b7cdbb4c5-nksgs"] Jul 09 01:38:23.226846 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.226803 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-h8pb8" Jul 09 01:38:23.227642 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.227622 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 01:38:23.228626 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.228604 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 09 01:38:23.228889 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.228872 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 09 01:38:23.229285 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.229267 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 01:38:23.229366 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.229290 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 01:38:23.229366 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.229275 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-vtlvc\"" Jul 09 01:38:23.230747 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.230725 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ckzls"] Jul 09 01:38:23.231362 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.230917 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:23.234589 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.233511 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 01:38:23.234589 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.234073 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-x69mf\"" Jul 09 01:38:23.238305 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.236675 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-99rjb"] Jul 09 01:38:23.245067 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.244274 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 09 01:38:23.245067 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.244406 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 09 01:38:23.245682 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.245658 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 09 01:38:23.246011 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.245994 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ckzls" Jul 09 01:38:23.246405 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.246382 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 01:38:23.246743 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.246705 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 09 01:38:23.247186 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.247167 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9z9g5"] Jul 09 01:38:23.247329 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.247314 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-99rjb" Jul 09 01:38:23.247456 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.247443 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-h8pb8"] Jul 09 01:38:23.247567 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.247550 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p5xcw"] Jul 09 01:38:23.247678 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.247658 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ckzls"] Jul 09 01:38:23.248198 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.248178 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-99rjb"] Jul 09 01:38:23.248705 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.248684 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-grrgr\"" Jul 09 01:38:23.248801 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.248765 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 01:38:23.249853 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.249092 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 09 01:38:23.249853 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.249080 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qpvvm"] Jul 09 01:38:23.249853 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.249292 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 09 01:38:23.249853 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.249562 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 01:38:23.249853 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.249664 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 09 01:38:23.250529 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.250512 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 09 01:38:23.251110 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.251068 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 09 01:38:23.251920 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.251898 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-w98gr\"" Jul 09 01:38:23.252392 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.251460 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 09 01:38:23.252392 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.251287 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 09 01:38:23.252557 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.252544 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-7gfhk"] Jul 09 01:38:23.253151 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.253098 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qpvvm" Jul 09 01:38:23.255523 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.255499 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 01:38:23.255618 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.255583 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n8xpm\"" Jul 09 01:38:23.255806 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.255788 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 01:38:23.255944 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.255790 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 01:38:23.256785 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.256767 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-q6qdb"] Jul 09 01:38:23.257450 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.257433 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-7gfhk" Jul 09 01:38:23.260619 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.260598 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 09 01:38:23.260953 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.260933 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 09 01:38:23.260953 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.260946 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 09 01:38:23.261111 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.260984 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-smgrj"] Jul 09 01:38:23.261219 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.261201 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-ptjkq\"" Jul 09 01:38:23.261471 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.261453 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 09 01:38:23.262078 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.262062 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-q6qdb" Jul 09 01:38:23.264600 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.264585 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fzl7v"] Jul 09 01:38:23.264985 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.264967 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zkhx9\"" Jul 09 01:38:23.265339 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.265322 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 01:38:23.265702 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.265686 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 01:38:23.266109 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.266094 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-smgrj" Jul 09 01:38:23.268569 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.268553 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 09 01:38:23.268929 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.268911 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 09 01:38:23.269528 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.269504 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-l5brk\"" Jul 09 01:38:23.270169 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.270149 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 09 01:38:23.270556 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.270524 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56f4fc4775-qvb8g"] Jul 09 01:38:23.270644 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.270560 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qpvvm"] Jul 09 01:38:23.270644 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.270583 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-smgrj"] Jul 09 01:38:23.270644 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.270602 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rxlj9"] Jul 09 01:38:23.270644 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.270618 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-7gfhk"] Jul 09 01:38:23.270644 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.270634 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fzl7v"] Jul 09 01:38:23.270899 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.270655 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-b7cdbb4c5-nksgs"] Jul 09 01:38:23.270899 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.270672 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-q6qdb"] Jul 09 01:38:23.270899 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.270688 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fzl7v" Jul 09 01:38:23.272582 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.272569 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 01:38:23.273007 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.272855 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s9n5n\"" Jul 09 01:38:23.273135 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.272861 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 01:38:23.353593 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.353563 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-ca-trust-extracted\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:23.353751 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.353602 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brgvk\" (UniqueName: \"kubernetes.io/projected/e61b2313-6b39-4068-95b6-dd2a95db5b1d-kube-api-access-brgvk\") pod \"service-ca-operator-5d46d9ffd4-99rjb\" (UID: \"e61b2313-6b39-4068-95b6-dd2a95db5b1d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-99rjb" Jul 09 01:38:23.353751 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.353626 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9a6b0c11-7b7c-460a-8a34-af1ac8d924a4-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-ckzls\" (UID: \"9a6b0c11-7b7c-460a-8a34-af1ac8d924a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ckzls" Jul 09 01:38:23.353751 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.353648 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7f36af6b-773c-49e1-a9ff-efbd797e59f7-stats-auth\") pod \"router-default-b7cdbb4c5-nksgs\" (UID: \"7f36af6b-773c-49e1-a9ff-efbd797e59f7\") " pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:23.353751 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.353701 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e36c83c0-d80b-4f03-957e-f8fa2186bc55-metrics-tls\") pod \"dns-default-fzl7v\" (UID: \"e36c83c0-d80b-4f03-957e-f8fa2186bc55\") " pod="openshift-dns/dns-default-fzl7v" Jul 09 01:38:23.353751 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.353740 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx6k6\" (UniqueName: \"kubernetes.io/projected/9a6b0c11-7b7c-460a-8a34-af1ac8d924a4-kube-api-access-sx6k6\") pod \"cluster-monitoring-operator-64786d9cbb-ckzls\" (UID: \"9a6b0c11-7b7c-460a-8a34-af1ac8d924a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ckzls" Jul 09 01:38:23.353963 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.353772 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3d8307ed-04c9-429e-a83c-7b24847e0a38-config\") pod \"console-operator-68b757fb67-7gfhk\" (UID: \"3d8307ed-04c9-429e-a83c-7b24847e0a38\") " pod="openshift-console-operator/console-operator-68b757fb67-7gfhk" Jul 09 01:38:23.353963 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.353801 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-tls\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:23.353963 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.353830 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e36c83c0-d80b-4f03-957e-f8fa2186bc55-tmp-dir\") pod \"dns-default-fzl7v\" (UID: \"e36c83c0-d80b-4f03-957e-f8fa2186bc55\") " pod="openshift-dns/dns-default-fzl7v" Jul 09 01:38:23.353963 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.353853 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7f36af6b-773c-49e1-a9ff-efbd797e59f7-default-certificate\") pod \"router-default-b7cdbb4c5-nksgs\" (UID: \"7f36af6b-773c-49e1-a9ff-efbd797e59f7\") " pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:23.353963 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.353885 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e36c83c0-d80b-4f03-957e-f8fa2186bc55-config-volume\") pod \"dns-default-fzl7v\" (UID: \"e36c83c0-d80b-4f03-957e-f8fa2186bc55\") " pod="openshift-dns/dns-default-fzl7v" Jul 09 01:38:23.353963 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.353908 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj559\" (UniqueName: \"kubernetes.io/projected/18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662-kube-api-access-wj559\") pod \"insights-operator-5c847dcfc4-h8pb8\" (UID: \"18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662\") " pod="openshift-insights/insights-operator-5c847dcfc4-h8pb8" Jul 09 01:38:23.353963 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.353944 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bbe2870c-05fa-44fd-9172-e556eb36c121-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-smgrj\" (UID: \"bbe2870c-05fa-44fd-9172-e556eb36c121\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-smgrj" Jul 09 01:38:23.354251 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.353987 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-h8pb8\" (UID: \"18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662\") " pod="openshift-insights/insights-operator-5c847dcfc4-h8pb8" Jul 09 01:38:23.354251 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.354023 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662-serving-cert\") pod \"insights-operator-5c847dcfc4-h8pb8\" (UID: \"18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662\") " pod="openshift-insights/insights-operator-5c847dcfc4-h8pb8" Jul 09 01:38:23.354251 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.354058 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/99942bcc-7a4f-4495-a1fe-7ce77a613b89-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-p5xcw\" (UID: \"99942bcc-7a4f-4495-a1fe-7ce77a613b89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p5xcw" Jul 09 01:38:23.354251 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.354120 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgxnj\" (UniqueName: \"kubernetes.io/projected/99942bcc-7a4f-4495-a1fe-7ce77a613b89-kube-api-access-vgxnj\") pod \"cluster-samples-operator-56fcf86bf-p5xcw\" (UID: \"99942bcc-7a4f-4495-a1fe-7ce77a613b89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p5xcw" Jul 09 01:38:23.354251 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.354144 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqp9k\" (UniqueName: \"kubernetes.io/projected/f827dc20-03eb-481b-98bd-52e34499e298-kube-api-access-xqp9k\") pod \"volume-data-source-validator-5d456fdbcd-rxlj9\" (UID: \"f827dc20-03eb-481b-98bd-52e34499e298\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rxlj9" Jul 09 01:38:23.354251 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.354165 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e61b2313-6b39-4068-95b6-dd2a95db5b1d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-99rjb\" (UID: \"e61b2313-6b39-4068-95b6-dd2a95db5b1d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-99rjb" Jul 09 01:38:23.354251 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.354180 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3d8307ed-04c9-429e-a83c-7b24847e0a38-serving-cert\") pod \"console-operator-68b757fb67-7gfhk\" (UID: \"3d8307ed-04c9-429e-a83c-7b24847e0a38\") " pod="openshift-console-operator/console-operator-68b757fb67-7gfhk" Jul 09 01:38:23.354251 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.354194 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f36af6b-773c-49e1-a9ff-efbd797e59f7-metrics-certs\") pod \"router-default-b7cdbb4c5-nksgs\" (UID: \"7f36af6b-773c-49e1-a9ff-efbd797e59f7\") " pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:23.354251 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.354214 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662-tmp\") pod \"insights-operator-5c847dcfc4-h8pb8\" (UID: \"18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662\") " pod="openshift-insights/insights-operator-5c847dcfc4-h8pb8" Jul 09 01:38:23.354673 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.354306 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-h8pb8\" (UID: \"18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662\") " pod="openshift-insights/insights-operator-5c847dcfc4-h8pb8" Jul 09 01:38:23.354673 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.354353 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvk6q\" (UniqueName: \"kubernetes.io/projected/e36c83c0-d80b-4f03-957e-f8fa2186bc55-kube-api-access-jvk6q\") pod \"dns-default-fzl7v\" (UID: \"e36c83c0-d80b-4f03-957e-f8fa2186bc55\") " pod="openshift-dns/dns-default-fzl7v" Jul 09 01:38:23.354673 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.354382 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwgms\" (UniqueName: \"kubernetes.io/projected/7f36af6b-773c-49e1-a9ff-efbd797e59f7-kube-api-access-bwgms\") pod \"router-default-b7cdbb4c5-nksgs\" (UID: \"7f36af6b-773c-49e1-a9ff-efbd797e59f7\") " pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:23.354673 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.354410 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv65b\" (UniqueName: \"kubernetes.io/projected/440a2154-c6ac-4974-86c3-e61735bfe17b-kube-api-access-fv65b\") pod \"ingress-canary-qpvvm\" (UID: \"440a2154-c6ac-4974-86c3-e61735bfe17b\") " pod="openshift-ingress-canary/ingress-canary-qpvvm" Jul 09 01:38:23.354673 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.354438 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5mxj\" (UniqueName: \"kubernetes.io/projected/3d8307ed-04c9-429e-a83c-7b24847e0a38-kube-api-access-f5mxj\") pod \"console-operator-68b757fb67-7gfhk\" (UID: \"3d8307ed-04c9-429e-a83c-7b24847e0a38\") " pod="openshift-console-operator/console-operator-68b757fb67-7gfhk" Jul 09 01:38:23.354673 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.354468 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5g5n\" (UniqueName: \"kubernetes.io/projected/fa5bc969-c6e4-4e77-a7e5-268e982bc0b4-kube-api-access-c5g5n\") pod \"kube-storage-version-migrator-operator-846bf668f7-9z9g5\" (UID: \"fa5bc969-c6e4-4e77-a7e5-268e982bc0b4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9z9g5" Jul 09 01:38:23.354673 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.354505 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-certificates\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:23.354673 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.354531 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-trusted-ca\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:23.354673 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.354568 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4ws7\" (UniqueName: \"kubernetes.io/projected/a95a7f22-fa64-492d-a8fb-b115d707eb17-kube-api-access-p4ws7\") pod \"network-check-source-989f8b8dc-q6qdb\" (UID: \"a95a7f22-fa64-492d-a8fb-b115d707eb17\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-q6qdb" Jul 09 01:38:23.354673 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.354598 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa5bc969-c6e4-4e77-a7e5-268e982bc0b4-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-9z9g5\" (UID: \"fa5bc969-c6e4-4e77-a7e5-268e982bc0b4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9z9g5" Jul 09 01:38:23.354673 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.354625 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e61b2313-6b39-4068-95b6-dd2a95db5b1d-config\") pod \"service-ca-operator-5d46d9ffd4-99rjb\" (UID: \"e61b2313-6b39-4068-95b6-dd2a95db5b1d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-99rjb" Jul 09 01:38:23.354673 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.354660 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbe2870c-05fa-44fd-9172-e556eb36c121-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-smgrj\" (UID: \"bbe2870c-05fa-44fd-9172-e556eb36c121\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-smgrj" Jul 09 01:38:23.355251 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.354714 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662-snapshots\") pod \"insights-operator-5c847dcfc4-h8pb8\" (UID: \"18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662\") " pod="openshift-insights/insights-operator-5c847dcfc4-h8pb8" Jul 09 01:38:23.355251 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.354758 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f36af6b-773c-49e1-a9ff-efbd797e59f7-service-ca-bundle\") pod \"router-default-b7cdbb4c5-nksgs\" (UID: \"7f36af6b-773c-49e1-a9ff-efbd797e59f7\") " pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:23.355251 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.354784 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a6b0c11-7b7c-460a-8a34-af1ac8d924a4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-ckzls\" (UID: \"9a6b0c11-7b7c-460a-8a34-af1ac8d924a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ckzls" Jul 09 01:38:23.355251 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.354807 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d8307ed-04c9-429e-a83c-7b24847e0a38-trusted-ca\") pod \"console-operator-68b757fb67-7gfhk\" (UID: \"3d8307ed-04c9-429e-a83c-7b24847e0a38\") " pod="openshift-console-operator/console-operator-68b757fb67-7gfhk" Jul 09 01:38:23.355251 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.354880 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-image-registry-private-configuration\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:23.355251 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.354955 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-installation-pull-secrets\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:23.355251 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.354986 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvw7w\" (UniqueName: \"kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-kube-api-access-tvw7w\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:23.355251 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.355011 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa5bc969-c6e4-4e77-a7e5-268e982bc0b4-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-9z9g5\" (UID: \"fa5bc969-c6e4-4e77-a7e5-268e982bc0b4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9z9g5" Jul 09 01:38:23.355251 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.355041 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-bound-sa-token\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:23.355251 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.355069 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/440a2154-c6ac-4974-86c3-e61735bfe17b-cert\") pod \"ingress-canary-qpvvm\" (UID: \"440a2154-c6ac-4974-86c3-e61735bfe17b\") " pod="openshift-ingress-canary/ingress-canary-qpvvm" Jul 09 01:38:23.456301 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.456269 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-installation-pull-secrets\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:23.456498 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.456314 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvw7w\" (UniqueName: \"kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-kube-api-access-tvw7w\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:23.456498 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.456340 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa5bc969-c6e4-4e77-a7e5-268e982bc0b4-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-9z9g5\" (UID: \"fa5bc969-c6e4-4e77-a7e5-268e982bc0b4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9z9g5" Jul 09 01:38:23.456498 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.456368 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-bound-sa-token\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:23.456498 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.456390 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/440a2154-c6ac-4974-86c3-e61735bfe17b-cert\") pod \"ingress-canary-qpvvm\" (UID: \"440a2154-c6ac-4974-86c3-e61735bfe17b\") " pod="openshift-ingress-canary/ingress-canary-qpvvm" Jul 09 01:38:23.456498 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.456415 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-ca-trust-extracted\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:23.456498 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.456447 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brgvk\" (UniqueName: \"kubernetes.io/projected/e61b2313-6b39-4068-95b6-dd2a95db5b1d-kube-api-access-brgvk\") pod \"service-ca-operator-5d46d9ffd4-99rjb\" (UID: \"e61b2313-6b39-4068-95b6-dd2a95db5b1d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-99rjb" Jul 09 01:38:23.456498 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.456478 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9a6b0c11-7b7c-460a-8a34-af1ac8d924a4-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-ckzls\" (UID: \"9a6b0c11-7b7c-460a-8a34-af1ac8d924a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ckzls" Jul 09 01:38:23.456868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.456509 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7f36af6b-773c-49e1-a9ff-efbd797e59f7-stats-auth\") pod \"router-default-b7cdbb4c5-nksgs\" (UID: \"7f36af6b-773c-49e1-a9ff-efbd797e59f7\") " pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:23.456868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.456540 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e36c83c0-d80b-4f03-957e-f8fa2186bc55-metrics-tls\") pod \"dns-default-fzl7v\" (UID: \"e36c83c0-d80b-4f03-957e-f8fa2186bc55\") " pod="openshift-dns/dns-default-fzl7v" Jul 09 01:38:23.456868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.456574 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx6k6\" (UniqueName: \"kubernetes.io/projected/9a6b0c11-7b7c-460a-8a34-af1ac8d924a4-kube-api-access-sx6k6\") pod \"cluster-monitoring-operator-64786d9cbb-ckzls\" (UID: \"9a6b0c11-7b7c-460a-8a34-af1ac8d924a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ckzls" Jul 09 01:38:23.456868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.456607 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3d8307ed-04c9-429e-a83c-7b24847e0a38-config\") pod \"console-operator-68b757fb67-7gfhk\" (UID: \"3d8307ed-04c9-429e-a83c-7b24847e0a38\") " pod="openshift-console-operator/console-operator-68b757fb67-7gfhk" Jul 09 01:38:23.456868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.456644 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-tls\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:23.456868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.456671 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e36c83c0-d80b-4f03-957e-f8fa2186bc55-tmp-dir\") pod \"dns-default-fzl7v\" (UID: \"e36c83c0-d80b-4f03-957e-f8fa2186bc55\") " pod="openshift-dns/dns-default-fzl7v" Jul 09 01:38:23.456868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.456696 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7f36af6b-773c-49e1-a9ff-efbd797e59f7-default-certificate\") pod \"router-default-b7cdbb4c5-nksgs\" (UID: \"7f36af6b-773c-49e1-a9ff-efbd797e59f7\") " pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:23.456868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.456726 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e36c83c0-d80b-4f03-957e-f8fa2186bc55-config-volume\") pod \"dns-default-fzl7v\" (UID: \"e36c83c0-d80b-4f03-957e-f8fa2186bc55\") " pod="openshift-dns/dns-default-fzl7v" Jul 09 01:38:23.456868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.456754 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj559\" (UniqueName: \"kubernetes.io/projected/18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662-kube-api-access-wj559\") pod \"insights-operator-5c847dcfc4-h8pb8\" (UID: \"18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662\") " pod="openshift-insights/insights-operator-5c847dcfc4-h8pb8" Jul 09 01:38:23.456868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.456783 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bbe2870c-05fa-44fd-9172-e556eb36c121-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-smgrj\" (UID: \"bbe2870c-05fa-44fd-9172-e556eb36c121\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-smgrj" Jul 09 01:38:23.456868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.456816 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-h8pb8\" (UID: \"18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662\") " pod="openshift-insights/insights-operator-5c847dcfc4-h8pb8" Jul 09 01:38:23.456868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.456849 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662-serving-cert\") pod \"insights-operator-5c847dcfc4-h8pb8\" (UID: \"18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662\") " pod="openshift-insights/insights-operator-5c847dcfc4-h8pb8" Jul 09 01:38:23.457504 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.456877 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/99942bcc-7a4f-4495-a1fe-7ce77a613b89-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-p5xcw\" (UID: \"99942bcc-7a4f-4495-a1fe-7ce77a613b89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p5xcw" Jul 09 01:38:23.457504 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.456930 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgxnj\" (UniqueName: \"kubernetes.io/projected/99942bcc-7a4f-4495-a1fe-7ce77a613b89-kube-api-access-vgxnj\") pod \"cluster-samples-operator-56fcf86bf-p5xcw\" (UID: \"99942bcc-7a4f-4495-a1fe-7ce77a613b89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p5xcw" Jul 09 01:38:23.457504 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.456951 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-ca-trust-extracted\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:23.457504 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.456957 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqp9k\" (UniqueName: \"kubernetes.io/projected/f827dc20-03eb-481b-98bd-52e34499e298-kube-api-access-xqp9k\") pod \"volume-data-source-validator-5d456fdbcd-rxlj9\" (UID: \"f827dc20-03eb-481b-98bd-52e34499e298\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rxlj9" Jul 09 01:38:23.457504 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.457007 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e61b2313-6b39-4068-95b6-dd2a95db5b1d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-99rjb\" (UID: \"e61b2313-6b39-4068-95b6-dd2a95db5b1d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-99rjb" Jul 09 01:38:23.457504 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.457032 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3d8307ed-04c9-429e-a83c-7b24847e0a38-serving-cert\") pod \"console-operator-68b757fb67-7gfhk\" (UID: \"3d8307ed-04c9-429e-a83c-7b24847e0a38\") " pod="openshift-console-operator/console-operator-68b757fb67-7gfhk" Jul 09 01:38:23.457504 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.457054 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f36af6b-773c-49e1-a9ff-efbd797e59f7-metrics-certs\") pod \"router-default-b7cdbb4c5-nksgs\" (UID: \"7f36af6b-773c-49e1-a9ff-efbd797e59f7\") " pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:23.457504 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.457081 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662-tmp\") pod \"insights-operator-5c847dcfc4-h8pb8\" (UID: \"18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662\") " pod="openshift-insights/insights-operator-5c847dcfc4-h8pb8" Jul 09 01:38:23.457504 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.457128 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-h8pb8\" (UID: \"18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662\") " pod="openshift-insights/insights-operator-5c847dcfc4-h8pb8" Jul 09 01:38:23.457504 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.457157 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvk6q\" (UniqueName: \"kubernetes.io/projected/e36c83c0-d80b-4f03-957e-f8fa2186bc55-kube-api-access-jvk6q\") pod \"dns-default-fzl7v\" (UID: \"e36c83c0-d80b-4f03-957e-f8fa2186bc55\") " pod="openshift-dns/dns-default-fzl7v" Jul 09 01:38:23.457504 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.457179 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwgms\" (UniqueName: \"kubernetes.io/projected/7f36af6b-773c-49e1-a9ff-efbd797e59f7-kube-api-access-bwgms\") pod \"router-default-b7cdbb4c5-nksgs\" (UID: \"7f36af6b-773c-49e1-a9ff-efbd797e59f7\") " pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:23.457504 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.457206 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv65b\" (UniqueName: \"kubernetes.io/projected/440a2154-c6ac-4974-86c3-e61735bfe17b-kube-api-access-fv65b\") pod \"ingress-canary-qpvvm\" (UID: \"440a2154-c6ac-4974-86c3-e61735bfe17b\") " pod="openshift-ingress-canary/ingress-canary-qpvvm" Jul 09 01:38:23.457504 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.457261 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5mxj\" (UniqueName: \"kubernetes.io/projected/3d8307ed-04c9-429e-a83c-7b24847e0a38-kube-api-access-f5mxj\") pod \"console-operator-68b757fb67-7gfhk\" (UID: \"3d8307ed-04c9-429e-a83c-7b24847e0a38\") " pod="openshift-console-operator/console-operator-68b757fb67-7gfhk" Jul 09 01:38:23.457504 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.457292 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5g5n\" (UniqueName: \"kubernetes.io/projected/fa5bc969-c6e4-4e77-a7e5-268e982bc0b4-kube-api-access-c5g5n\") pod \"kube-storage-version-migrator-operator-846bf668f7-9z9g5\" (UID: \"fa5bc969-c6e4-4e77-a7e5-268e982bc0b4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9z9g5" Jul 09 01:38:23.457504 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.457325 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-certificates\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:23.457504 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.457349 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-trusted-ca\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:23.458327 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.457376 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4ws7\" (UniqueName: \"kubernetes.io/projected/a95a7f22-fa64-492d-a8fb-b115d707eb17-kube-api-access-p4ws7\") pod \"network-check-source-989f8b8dc-q6qdb\" (UID: \"a95a7f22-fa64-492d-a8fb-b115d707eb17\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-q6qdb" Jul 09 01:38:23.458327 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.457403 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa5bc969-c6e4-4e77-a7e5-268e982bc0b4-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-9z9g5\" (UID: \"fa5bc969-c6e4-4e77-a7e5-268e982bc0b4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9z9g5" Jul 09 01:38:23.458327 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.457434 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e61b2313-6b39-4068-95b6-dd2a95db5b1d-config\") pod \"service-ca-operator-5d46d9ffd4-99rjb\" (UID: \"e61b2313-6b39-4068-95b6-dd2a95db5b1d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-99rjb" Jul 09 01:38:23.458327 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.457462 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbe2870c-05fa-44fd-9172-e556eb36c121-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-smgrj\" (UID: \"bbe2870c-05fa-44fd-9172-e556eb36c121\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-smgrj" Jul 09 01:38:23.458327 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.457482 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e36c83c0-d80b-4f03-957e-f8fa2186bc55-config-volume\") pod \"dns-default-fzl7v\" (UID: \"e36c83c0-d80b-4f03-957e-f8fa2186bc55\") " pod="openshift-dns/dns-default-fzl7v" Jul 09 01:38:23.458327 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.457493 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662-snapshots\") pod \"insights-operator-5c847dcfc4-h8pb8\" (UID: \"18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662\") " pod="openshift-insights/insights-operator-5c847dcfc4-h8pb8" Jul 09 01:38:23.458327 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:23.457640 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 01:38:23.458327 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:23.457714 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 01:38:23.458327 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:23.457828 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbe2870c-05fa-44fd-9172-e556eb36c121-networking-console-plugin-cert podName:bbe2870c-05fa-44fd-9172-e556eb36c121 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:23.957809097 +0000 UTC m=+36.619546589 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bbe2870c-05fa-44fd-9172-e556eb36c121-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-smgrj" (UID: "bbe2870c-05fa-44fd-9172-e556eb36c121") : secret "networking-console-plugin-cert" not found Jul 09 01:38:23.458327 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.457916 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9a6b0c11-7b7c-460a-8a34-af1ac8d924a4-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-ckzls\" (UID: \"9a6b0c11-7b7c-460a-8a34-af1ac8d924a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ckzls" Jul 09 01:38:23.458327 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.457982 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f36af6b-773c-49e1-a9ff-efbd797e59f7-service-ca-bundle\") pod \"router-default-b7cdbb4c5-nksgs\" (UID: \"7f36af6b-773c-49e1-a9ff-efbd797e59f7\") " pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:23.458327 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.458017 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a6b0c11-7b7c-460a-8a34-af1ac8d924a4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-ckzls\" (UID: \"9a6b0c11-7b7c-460a-8a34-af1ac8d924a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ckzls" Jul 09 01:38:23.458327 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.458047 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d8307ed-04c9-429e-a83c-7b24847e0a38-trusted-ca\") pod \"console-operator-68b757fb67-7gfhk\" (UID: \"3d8307ed-04c9-429e-a83c-7b24847e0a38\") " pod="openshift-console-operator/console-operator-68b757fb67-7gfhk" Jul 09 01:38:23.458327 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.458082 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-image-registry-private-configuration\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:23.458327 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.458163 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e61b2313-6b39-4068-95b6-dd2a95db5b1d-config\") pod \"service-ca-operator-5d46d9ffd4-99rjb\" (UID: \"e61b2313-6b39-4068-95b6-dd2a95db5b1d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-99rjb" Jul 09 01:38:23.459014 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.458462 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662-snapshots\") pod \"insights-operator-5c847dcfc4-h8pb8\" (UID: \"18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662\") " pod="openshift-insights/insights-operator-5c847dcfc4-h8pb8" Jul 09 01:38:23.459014 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:23.458774 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 01:38:23.459014 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:23.458791 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56f4fc4775-qvb8g: secret "image-registry-tls" not found Jul 09 01:38:23.459014 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:23.458849 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-tls podName:4543d666-8d9f-4e5a-9cd1-e1b504aca20d nodeName:}" failed. No retries permitted until 2026-07-09 01:38:23.958833432 +0000 UTC m=+36.620570928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-tls") pod "image-registry-56f4fc4775-qvb8g" (UID: "4543d666-8d9f-4e5a-9cd1-e1b504aca20d") : secret "image-registry-tls" not found Jul 09 01:38:23.459014 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.458886 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bbe2870c-05fa-44fd-9172-e556eb36c121-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-smgrj\" (UID: \"bbe2870c-05fa-44fd-9172-e556eb36c121\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-smgrj" Jul 09 01:38:23.459014 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.458953 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-h8pb8\" (UID: \"18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662\") " pod="openshift-insights/insights-operator-5c847dcfc4-h8pb8" Jul 09 01:38:23.459014 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.459002 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3d8307ed-04c9-429e-a83c-7b24847e0a38-config\") pod \"console-operator-68b757fb67-7gfhk\" (UID: \"3d8307ed-04c9-429e-a83c-7b24847e0a38\") " pod="openshift-console-operator/console-operator-68b757fb67-7gfhk" Jul 09 01:38:23.459404 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.459085 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e36c83c0-d80b-4f03-957e-f8fa2186bc55-tmp-dir\") pod \"dns-default-fzl7v\" (UID: \"e36c83c0-d80b-4f03-957e-f8fa2186bc55\") " pod="openshift-dns/dns-default-fzl7v" Jul 09 01:38:23.459404 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:23.459096 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e36c83c0-d80b-4f03-957e-f8fa2186bc55-metrics-tls podName:e36c83c0-d80b-4f03-957e-f8fa2186bc55 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:23.959082306 +0000 UTC m=+36.620819777 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e36c83c0-d80b-4f03-957e-f8fa2186bc55-metrics-tls") pod "dns-default-fzl7v" (UID: "e36c83c0-d80b-4f03-957e-f8fa2186bc55") : secret "dns-default-metrics-tls" not found Jul 09 01:38:23.459404 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.459202 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662-tmp\") pod \"insights-operator-5c847dcfc4-h8pb8\" (UID: \"18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662\") " pod="openshift-insights/insights-operator-5c847dcfc4-h8pb8" Jul 09 01:38:23.461287 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.459848 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-certificates\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:23.461287 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:23.460137 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 01:38:23.461287 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:23.460209 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a6b0c11-7b7c-460a-8a34-af1ac8d924a4-cluster-monitoring-operator-tls podName:9a6b0c11-7b7c-460a-8a34-af1ac8d924a4 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:23.960183536 +0000 UTC m=+36.621921013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9a6b0c11-7b7c-460a-8a34-af1ac8d924a4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-ckzls" (UID: "9a6b0c11-7b7c-460a-8a34-af1ac8d924a4") : secret "cluster-monitoring-operator-tls" not found Jul 09 01:38:23.461287 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:23.460291 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 01:38:23.461287 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:23.460331 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99942bcc-7a4f-4495-a1fe-7ce77a613b89-samples-operator-tls podName:99942bcc-7a4f-4495-a1fe-7ce77a613b89 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:23.960318365 +0000 UTC m=+36.622055835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/99942bcc-7a4f-4495-a1fe-7ce77a613b89-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-p5xcw" (UID: "99942bcc-7a4f-4495-a1fe-7ce77a613b89") : secret "samples-operator-tls" not found Jul 09 01:38:23.461287 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.460734 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-trusted-ca\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:23.461287 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.460811 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-h8pb8\" (UID: \"18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662\") " pod="openshift-insights/insights-operator-5c847dcfc4-h8pb8" Jul 09 01:38:23.461287 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:23.460934 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 01:38:23.461287 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:23.460992 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f36af6b-773c-49e1-a9ff-efbd797e59f7-metrics-certs podName:7f36af6b-773c-49e1-a9ff-efbd797e59f7 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:23.960976195 +0000 UTC m=+36.622713668 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f36af6b-773c-49e1-a9ff-efbd797e59f7-metrics-certs") pod "router-default-b7cdbb4c5-nksgs" (UID: "7f36af6b-773c-49e1-a9ff-efbd797e59f7") : secret "router-metrics-certs-default" not found Jul 09 01:38:23.461823 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:23.461788 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f36af6b-773c-49e1-a9ff-efbd797e59f7-service-ca-bundle podName:7f36af6b-773c-49e1-a9ff-efbd797e59f7 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:23.961772361 +0000 UTC m=+36.623509834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7f36af6b-773c-49e1-a9ff-efbd797e59f7-service-ca-bundle") pod "router-default-b7cdbb4c5-nksgs" (UID: "7f36af6b-773c-49e1-a9ff-efbd797e59f7") : configmap references non-existent config key: service-ca.crt Jul 09 01:38:23.461892 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.461865 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d8307ed-04c9-429e-a83c-7b24847e0a38-trusted-ca\") pod \"console-operator-68b757fb67-7gfhk\" (UID: \"3d8307ed-04c9-429e-a83c-7b24847e0a38\") " pod="openshift-console-operator/console-operator-68b757fb67-7gfhk" Jul 09 01:38:23.462034 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.461989 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa5bc969-c6e4-4e77-a7e5-268e982bc0b4-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-9z9g5\" (UID: \"fa5bc969-c6e4-4e77-a7e5-268e982bc0b4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9z9g5" Jul 09 01:38:23.462181 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.462153 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-image-registry-private-configuration\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:23.462281 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.462168 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa5bc969-c6e4-4e77-a7e5-268e982bc0b4-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-9z9g5\" (UID: \"fa5bc969-c6e4-4e77-a7e5-268e982bc0b4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9z9g5" Jul 09 01:38:23.462383 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.462363 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/440a2154-c6ac-4974-86c3-e61735bfe17b-cert\") pod \"ingress-canary-qpvvm\" (UID: \"440a2154-c6ac-4974-86c3-e61735bfe17b\") " pod="openshift-ingress-canary/ingress-canary-qpvvm" Jul 09 01:38:23.462734 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.462706 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3d8307ed-04c9-429e-a83c-7b24847e0a38-serving-cert\") pod \"console-operator-68b757fb67-7gfhk\" (UID: \"3d8307ed-04c9-429e-a83c-7b24847e0a38\") " pod="openshift-console-operator/console-operator-68b757fb67-7gfhk" Jul 09 01:38:23.462833 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.462816 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-installation-pull-secrets\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:23.463394 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.463373 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7f36af6b-773c-49e1-a9ff-efbd797e59f7-stats-auth\") pod \"router-default-b7cdbb4c5-nksgs\" (UID: \"7f36af6b-773c-49e1-a9ff-efbd797e59f7\") " pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:23.463502 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.463480 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662-serving-cert\") pod \"insights-operator-5c847dcfc4-h8pb8\" (UID: \"18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662\") " pod="openshift-insights/insights-operator-5c847dcfc4-h8pb8" Jul 09 01:38:23.463801 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.463786 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e61b2313-6b39-4068-95b6-dd2a95db5b1d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-99rjb\" (UID: \"e61b2313-6b39-4068-95b6-dd2a95db5b1d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-99rjb" Jul 09 01:38:23.464623 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.464604 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7f36af6b-773c-49e1-a9ff-efbd797e59f7-default-certificate\") pod \"router-default-b7cdbb4c5-nksgs\" (UID: \"7f36af6b-773c-49e1-a9ff-efbd797e59f7\") " pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:23.469850 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.469829 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx6k6\" (UniqueName: \"kubernetes.io/projected/9a6b0c11-7b7c-460a-8a34-af1ac8d924a4-kube-api-access-sx6k6\") pod \"cluster-monitoring-operator-64786d9cbb-ckzls\" (UID: \"9a6b0c11-7b7c-460a-8a34-af1ac8d924a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ckzls" Jul 09 01:38:23.471345 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.471323 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv65b\" (UniqueName: \"kubernetes.io/projected/440a2154-c6ac-4974-86c3-e61735bfe17b-kube-api-access-fv65b\") pod \"ingress-canary-qpvvm\" (UID: \"440a2154-c6ac-4974-86c3-e61735bfe17b\") " pod="openshift-ingress-canary/ingress-canary-qpvvm" Jul 09 01:38:23.471846 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.471823 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5mxj\" (UniqueName: \"kubernetes.io/projected/3d8307ed-04c9-429e-a83c-7b24847e0a38-kube-api-access-f5mxj\") pod \"console-operator-68b757fb67-7gfhk\" (UID: \"3d8307ed-04c9-429e-a83c-7b24847e0a38\") " pod="openshift-console-operator/console-operator-68b757fb67-7gfhk" Jul 09 01:38:23.472625 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.472584 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj559\" (UniqueName: \"kubernetes.io/projected/18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662-kube-api-access-wj559\") pod \"insights-operator-5c847dcfc4-h8pb8\" (UID: \"18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662\") " pod="openshift-insights/insights-operator-5c847dcfc4-h8pb8" Jul 09 01:38:23.473782 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.473758 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvk6q\" (UniqueName: \"kubernetes.io/projected/e36c83c0-d80b-4f03-957e-f8fa2186bc55-kube-api-access-jvk6q\") pod \"dns-default-fzl7v\" (UID: \"e36c83c0-d80b-4f03-957e-f8fa2186bc55\") " pod="openshift-dns/dns-default-fzl7v" Jul 09 01:38:23.474485 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.474465 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5g5n\" (UniqueName: \"kubernetes.io/projected/fa5bc969-c6e4-4e77-a7e5-268e982bc0b4-kube-api-access-c5g5n\") pod \"kube-storage-version-migrator-operator-846bf668f7-9z9g5\" (UID: \"fa5bc969-c6e4-4e77-a7e5-268e982bc0b4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9z9g5" Jul 09 01:38:23.474897 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.474881 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwgms\" (UniqueName: \"kubernetes.io/projected/7f36af6b-773c-49e1-a9ff-efbd797e59f7-kube-api-access-bwgms\") pod \"router-default-b7cdbb4c5-nksgs\" (UID: \"7f36af6b-773c-49e1-a9ff-efbd797e59f7\") " pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:23.475158 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.475141 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvw7w\" (UniqueName: \"kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-kube-api-access-tvw7w\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:23.475352 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.475332 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4ws7\" (UniqueName: \"kubernetes.io/projected/a95a7f22-fa64-492d-a8fb-b115d707eb17-kube-api-access-p4ws7\") pod \"network-check-source-989f8b8dc-q6qdb\" (UID: \"a95a7f22-fa64-492d-a8fb-b115d707eb17\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-q6qdb" Jul 09 01:38:23.475871 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.475852 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgxnj\" (UniqueName: \"kubernetes.io/projected/99942bcc-7a4f-4495-a1fe-7ce77a613b89-kube-api-access-vgxnj\") pod \"cluster-samples-operator-56fcf86bf-p5xcw\" (UID: \"99942bcc-7a4f-4495-a1fe-7ce77a613b89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p5xcw" Jul 09 01:38:23.477687 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.477667 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brgvk\" (UniqueName: \"kubernetes.io/projected/e61b2313-6b39-4068-95b6-dd2a95db5b1d-kube-api-access-brgvk\") pod \"service-ca-operator-5d46d9ffd4-99rjb\" (UID: \"e61b2313-6b39-4068-95b6-dd2a95db5b1d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-99rjb" Jul 09 01:38:23.478103 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.478083 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-bound-sa-token\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:23.478204 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.478188 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqp9k\" (UniqueName: \"kubernetes.io/projected/f827dc20-03eb-481b-98bd-52e34499e298-kube-api-access-xqp9k\") pod \"volume-data-source-validator-5d456fdbcd-rxlj9\" (UID: \"f827dc20-03eb-481b-98bd-52e34499e298\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rxlj9" Jul 09 01:38:23.526054 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.526026 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9z9g5" Jul 09 01:38:23.561169 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.561138 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rxlj9" Jul 09 01:38:23.572843 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.572819 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-h8pb8" Jul 09 01:38:23.596712 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.596539 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-99rjb" Jul 09 01:38:23.602994 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.602646 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qpvvm" Jul 09 01:38:23.608731 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.608492 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-7gfhk" Jul 09 01:38:23.613787 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.613592 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-q6qdb" Jul 09 01:38:23.703265 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.703091 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9z9g5"] Jul 09 01:38:23.779658 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.779618 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rxlj9"] Jul 09 01:38:23.810900 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.810868 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-h8pb8"] Jul 09 01:38:23.813362 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:38:23.813335 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18cdf55a_4f6c_4cbf_92c3_59b7e8fa5662.slice/crio-a0edb9b9c1aed6a16b8d7b83accd1d1d2ea66ba115b90bcc816efdb8e05f9d33 WatchSource:0}: Error finding container a0edb9b9c1aed6a16b8d7b83accd1d1d2ea66ba115b90bcc816efdb8e05f9d33: Status 404 returned error can't find the container with id a0edb9b9c1aed6a16b8d7b83accd1d1d2ea66ba115b90bcc816efdb8e05f9d33 Jul 09 01:38:23.842829 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.842648 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-99rjb"] Jul 09 01:38:23.845193 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:38:23.845155 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode61b2313_6b39_4068_95b6_dd2a95db5b1d.slice/crio-faa0792d89bb4214dd171f3c1cf9fe3ee577191bbb6da176f5c4e2cde914230b WatchSource:0}: Error finding container faa0792d89bb4214dd171f3c1cf9fe3ee577191bbb6da176f5c4e2cde914230b: Status 404 returned error can't find the container with id faa0792d89bb4214dd171f3c1cf9fe3ee577191bbb6da176f5c4e2cde914230b Jul 09 01:38:23.855447 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.855425 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-7gfhk"] Jul 09 01:38:23.859503 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:38:23.859427 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d8307ed_04c9_429e_a83c_7b24847e0a38.slice/crio-5ba4478d9c2b3752406fa83b0ff8c9bc5d8f8b862f6997eabc3c6eb544acb31f WatchSource:0}: Error finding container 5ba4478d9c2b3752406fa83b0ff8c9bc5d8f8b862f6997eabc3c6eb544acb31f: Status 404 returned error can't find the container with id 5ba4478d9c2b3752406fa83b0ff8c9bc5d8f8b862f6997eabc3c6eb544acb31f Jul 09 01:38:23.860743 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.860698 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:38:23.860743 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.860706 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:38:23.860743 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.860709 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:38:23.868517 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.863450 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 01:38:23.868517 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.863643 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 01:38:23.868517 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.865837 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9w8gn\"" Jul 09 01:38:23.868517 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.866561 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-npl7s\"" Jul 09 01:38:23.871658 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.871638 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-q6qdb"] Jul 09 01:38:23.871825 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.871811 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qpvvm"] Jul 09 01:38:23.966680 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.966588 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a6b0c11-7b7c-460a-8a34-af1ac8d924a4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-ckzls\" (UID: \"9a6b0c11-7b7c-460a-8a34-af1ac8d924a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ckzls" Jul 09 01:38:23.966835 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.966700 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e36c83c0-d80b-4f03-957e-f8fa2186bc55-metrics-tls\") pod \"dns-default-fzl7v\" (UID: \"e36c83c0-d80b-4f03-957e-f8fa2186bc55\") " pod="openshift-dns/dns-default-fzl7v" Jul 09 01:38:23.966835 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.966735 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-tls\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:23.966835 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:23.966753 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 01:38:23.966835 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.966768 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/99942bcc-7a4f-4495-a1fe-7ce77a613b89-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-p5xcw\" (UID: \"99942bcc-7a4f-4495-a1fe-7ce77a613b89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p5xcw" Jul 09 01:38:23.966835 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.966815 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f36af6b-773c-49e1-a9ff-efbd797e59f7-metrics-certs\") pod \"router-default-b7cdbb4c5-nksgs\" (UID: \"7f36af6b-773c-49e1-a9ff-efbd797e59f7\") " pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:23.967018 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:23.966838 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a6b0c11-7b7c-460a-8a34-af1ac8d924a4-cluster-monitoring-operator-tls podName:9a6b0c11-7b7c-460a-8a34-af1ac8d924a4 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:24.966816337 +0000 UTC m=+37.628553825 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9a6b0c11-7b7c-460a-8a34-af1ac8d924a4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-ckzls" (UID: "9a6b0c11-7b7c-460a-8a34-af1ac8d924a4") : secret "cluster-monitoring-operator-tls" not found Jul 09 01:38:23.967018 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:23.966848 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 01:38:23.967018 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:23.966878 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 01:38:23.967018 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:23.966918 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e36c83c0-d80b-4f03-957e-f8fa2186bc55-metrics-tls podName:e36c83c0-d80b-4f03-957e-f8fa2186bc55 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:24.966900985 +0000 UTC m=+37.628638456 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e36c83c0-d80b-4f03-957e-f8fa2186bc55-metrics-tls") pod "dns-default-fzl7v" (UID: "e36c83c0-d80b-4f03-957e-f8fa2186bc55") : secret "dns-default-metrics-tls" not found Jul 09 01:38:23.967018 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:23.966939 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f36af6b-773c-49e1-a9ff-efbd797e59f7-metrics-certs podName:7f36af6b-773c-49e1-a9ff-efbd797e59f7 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:24.966928214 +0000 UTC m=+37.628665691 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f36af6b-773c-49e1-a9ff-efbd797e59f7-metrics-certs") pod "router-default-b7cdbb4c5-nksgs" (UID: "7f36af6b-773c-49e1-a9ff-efbd797e59f7") : secret "router-metrics-certs-default" not found Jul 09 01:38:23.967018 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:23.966961 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 01:38:23.967018 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.966959 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbe2870c-05fa-44fd-9172-e556eb36c121-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-smgrj\" (UID: \"bbe2870c-05fa-44fd-9172-e556eb36c121\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-smgrj" Jul 09 01:38:23.967018 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:23.966971 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56f4fc4775-qvb8g: secret "image-registry-tls" not found Jul 09 01:38:23.967018 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:23.967002 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f36af6b-773c-49e1-a9ff-efbd797e59f7-service-ca-bundle\") pod \"router-default-b7cdbb4c5-nksgs\" (UID: \"7f36af6b-773c-49e1-a9ff-efbd797e59f7\") " pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:23.967018 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:23.967019 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 01:38:23.967447 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:23.967027 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-tls podName:4543d666-8d9f-4e5a-9cd1-e1b504aca20d nodeName:}" failed. No retries permitted until 2026-07-09 01:38:24.967013924 +0000 UTC m=+37.628751433 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-tls") pod "image-registry-56f4fc4775-qvb8g" (UID: "4543d666-8d9f-4e5a-9cd1-e1b504aca20d") : secret "image-registry-tls" not found Jul 09 01:38:23.967447 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:23.967086 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99942bcc-7a4f-4495-a1fe-7ce77a613b89-samples-operator-tls podName:99942bcc-7a4f-4495-a1fe-7ce77a613b89 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:24.967073798 +0000 UTC m=+37.628811280 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/99942bcc-7a4f-4495-a1fe-7ce77a613b89-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-p5xcw" (UID: "99942bcc-7a4f-4495-a1fe-7ce77a613b89") : secret "samples-operator-tls" not found Jul 09 01:38:23.967447 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:23.967102 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f36af6b-773c-49e1-a9ff-efbd797e59f7-service-ca-bundle podName:7f36af6b-773c-49e1-a9ff-efbd797e59f7 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:24.967093586 +0000 UTC m=+37.628831074 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7f36af6b-773c-49e1-a9ff-efbd797e59f7-service-ca-bundle") pod "router-default-b7cdbb4c5-nksgs" (UID: "7f36af6b-773c-49e1-a9ff-efbd797e59f7") : configmap references non-existent config key: service-ca.crt Jul 09 01:38:23.967447 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:23.967121 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 01:38:23.967447 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:23.967198 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbe2870c-05fa-44fd-9172-e556eb36c121-networking-console-plugin-cert podName:bbe2870c-05fa-44fd-9172-e556eb36c121 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:24.967174992 +0000 UTC m=+37.628912463 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bbe2870c-05fa-44fd-9172-e556eb36c121-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-smgrj" (UID: "bbe2870c-05fa-44fd-9172-e556eb36c121") : secret "networking-console-plugin-cert" not found Jul 09 01:38:24.053482 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:24.053443 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-q6qdb" event={"ID":"a95a7f22-fa64-492d-a8fb-b115d707eb17","Type":"ContainerStarted","Data":"3602264bd851e78611007a1385f046d6546f4256bf3eb071613b206050905108"} Jul 09 01:38:24.054725 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:24.054691 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qpvvm" event={"ID":"440a2154-c6ac-4974-86c3-e61735bfe17b","Type":"ContainerStarted","Data":"49dc4fdab5cd1bf824f9851f2fc1e52694ad2e2dddf69cf4e4723111ccade002"} Jul 09 01:38:24.055960 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:24.055932 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-99rjb" event={"ID":"e61b2313-6b39-4068-95b6-dd2a95db5b1d","Type":"ContainerStarted","Data":"faa0792d89bb4214dd171f3c1cf9fe3ee577191bbb6da176f5c4e2cde914230b"} Jul 09 01:38:24.057173 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:24.057142 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rxlj9" event={"ID":"f827dc20-03eb-481b-98bd-52e34499e298","Type":"ContainerStarted","Data":"291abd7c988b0874d82733b17fc4d57c442c322a6cbc7ec13a2e5aa8e1b8ab7a"} Jul 09 01:38:24.058344 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:24.058319 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-7gfhk" event={"ID":"3d8307ed-04c9-429e-a83c-7b24847e0a38","Type":"ContainerStarted","Data":"5ba4478d9c2b3752406fa83b0ff8c9bc5d8f8b862f6997eabc3c6eb544acb31f"} Jul 09 01:38:24.059530 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:24.059507 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-h8pb8" event={"ID":"18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662","Type":"ContainerStarted","Data":"a0edb9b9c1aed6a16b8d7b83accd1d1d2ea66ba115b90bcc816efdb8e05f9d33"} Jul 09 01:38:24.060709 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:24.060684 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9z9g5" event={"ID":"fa5bc969-c6e4-4e77-a7e5-268e982bc0b4","Type":"ContainerStarted","Data":"0ec6ba8f9f182645dba1ec3c336367344c928dc6636e0240667737aebc419d93"} Jul 09 01:38:24.976721 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:24.976682 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbe2870c-05fa-44fd-9172-e556eb36c121-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-smgrj\" (UID: \"bbe2870c-05fa-44fd-9172-e556eb36c121\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-smgrj" Jul 09 01:38:24.977536 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:24.976747 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f36af6b-773c-49e1-a9ff-efbd797e59f7-service-ca-bundle\") pod \"router-default-b7cdbb4c5-nksgs\" (UID: \"7f36af6b-773c-49e1-a9ff-efbd797e59f7\") " pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:24.977536 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:24.976779 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a6b0c11-7b7c-460a-8a34-af1ac8d924a4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-ckzls\" (UID: \"9a6b0c11-7b7c-460a-8a34-af1ac8d924a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ckzls" Jul 09 01:38:24.977536 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:24.976847 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e36c83c0-d80b-4f03-957e-f8fa2186bc55-metrics-tls\") pod \"dns-default-fzl7v\" (UID: \"e36c83c0-d80b-4f03-957e-f8fa2186bc55\") " pod="openshift-dns/dns-default-fzl7v" Jul 09 01:38:24.977536 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:24.976879 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-tls\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:24.977536 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:24.976918 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/99942bcc-7a4f-4495-a1fe-7ce77a613b89-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-p5xcw\" (UID: \"99942bcc-7a4f-4495-a1fe-7ce77a613b89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p5xcw" Jul 09 01:38:24.977536 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:24.976975 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f36af6b-773c-49e1-a9ff-efbd797e59f7-metrics-certs\") pod \"router-default-b7cdbb4c5-nksgs\" (UID: \"7f36af6b-773c-49e1-a9ff-efbd797e59f7\") " pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:24.977536 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:24.977140 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 01:38:24.977536 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:24.977202 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f36af6b-773c-49e1-a9ff-efbd797e59f7-metrics-certs podName:7f36af6b-773c-49e1-a9ff-efbd797e59f7 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:26.977183348 +0000 UTC m=+39.638920822 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f36af6b-773c-49e1-a9ff-efbd797e59f7-metrics-certs") pod "router-default-b7cdbb4c5-nksgs" (UID: "7f36af6b-773c-49e1-a9ff-efbd797e59f7") : secret "router-metrics-certs-default" not found Jul 09 01:38:24.977949 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:24.977643 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 01:38:24.977949 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:24.977693 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbe2870c-05fa-44fd-9172-e556eb36c121-networking-console-plugin-cert podName:bbe2870c-05fa-44fd-9172-e556eb36c121 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:26.977679086 +0000 UTC m=+39.639416559 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bbe2870c-05fa-44fd-9172-e556eb36c121-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-smgrj" (UID: "bbe2870c-05fa-44fd-9172-e556eb36c121") : secret "networking-console-plugin-cert" not found Jul 09 01:38:24.977949 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:24.977760 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f36af6b-773c-49e1-a9ff-efbd797e59f7-service-ca-bundle podName:7f36af6b-773c-49e1-a9ff-efbd797e59f7 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:26.9777505 +0000 UTC m=+39.639487970 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7f36af6b-773c-49e1-a9ff-efbd797e59f7-service-ca-bundle") pod "router-default-b7cdbb4c5-nksgs" (UID: "7f36af6b-773c-49e1-a9ff-efbd797e59f7") : configmap references non-existent config key: service-ca.crt Jul 09 01:38:24.977949 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:24.977815 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 01:38:24.977949 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:24.977847 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a6b0c11-7b7c-460a-8a34-af1ac8d924a4-cluster-monitoring-operator-tls podName:9a6b0c11-7b7c-460a-8a34-af1ac8d924a4 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:26.97783668 +0000 UTC m=+39.639574153 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9a6b0c11-7b7c-460a-8a34-af1ac8d924a4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-ckzls" (UID: "9a6b0c11-7b7c-460a-8a34-af1ac8d924a4") : secret "cluster-monitoring-operator-tls" not found Jul 09 01:38:24.977949 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:24.977903 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 01:38:24.977949 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:24.977931 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e36c83c0-d80b-4f03-957e-f8fa2186bc55-metrics-tls podName:e36c83c0-d80b-4f03-957e-f8fa2186bc55 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:26.977922424 +0000 UTC m=+39.639659898 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e36c83c0-d80b-4f03-957e-f8fa2186bc55-metrics-tls") pod "dns-default-fzl7v" (UID: "e36c83c0-d80b-4f03-957e-f8fa2186bc55") : secret "dns-default-metrics-tls" not found Jul 09 01:38:24.978325 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:24.977992 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 01:38:24.978325 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:24.978002 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56f4fc4775-qvb8g: secret "image-registry-tls" not found Jul 09 01:38:24.978325 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:24.978032 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-tls podName:4543d666-8d9f-4e5a-9cd1-e1b504aca20d nodeName:}" failed. No retries permitted until 2026-07-09 01:38:26.978020267 +0000 UTC m=+39.639757756 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-tls") pod "image-registry-56f4fc4775-qvb8g" (UID: "4543d666-8d9f-4e5a-9cd1-e1b504aca20d") : secret "image-registry-tls" not found Jul 09 01:38:24.978325 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:24.978088 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 01:38:24.978325 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:24.978116 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99942bcc-7a4f-4495-a1fe-7ce77a613b89-samples-operator-tls podName:99942bcc-7a4f-4495-a1fe-7ce77a613b89 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:26.978106537 +0000 UTC m=+39.639844024 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/99942bcc-7a4f-4495-a1fe-7ce77a613b89-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-p5xcw" (UID: "99942bcc-7a4f-4495-a1fe-7ce77a613b89") : secret "samples-operator-tls" not found Jul 09 01:38:26.997490 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:26.997420 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbe2870c-05fa-44fd-9172-e556eb36c121-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-smgrj\" (UID: \"bbe2870c-05fa-44fd-9172-e556eb36c121\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-smgrj" Jul 09 01:38:26.997490 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:26.997482 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f36af6b-773c-49e1-a9ff-efbd797e59f7-service-ca-bundle\") pod \"router-default-b7cdbb4c5-nksgs\" (UID: \"7f36af6b-773c-49e1-a9ff-efbd797e59f7\") " pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:26.998038 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:26.997515 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a6b0c11-7b7c-460a-8a34-af1ac8d924a4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-ckzls\" (UID: \"9a6b0c11-7b7c-460a-8a34-af1ac8d924a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ckzls" Jul 09 01:38:26.998038 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:26.997589 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 01:38:26.998038 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:26.997616 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 01:38:26.998038 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:26.997656 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbe2870c-05fa-44fd-9172-e556eb36c121-networking-console-plugin-cert podName:bbe2870c-05fa-44fd-9172-e556eb36c121 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:30.99763608 +0000 UTC m=+43.659373554 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bbe2870c-05fa-44fd-9172-e556eb36c121-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-smgrj" (UID: "bbe2870c-05fa-44fd-9172-e556eb36c121") : secret "networking-console-plugin-cert" not found Jul 09 01:38:26.998038 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:26.997673 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a6b0c11-7b7c-460a-8a34-af1ac8d924a4-cluster-monitoring-operator-tls podName:9a6b0c11-7b7c-460a-8a34-af1ac8d924a4 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:30.997664876 +0000 UTC m=+43.659402346 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9a6b0c11-7b7c-460a-8a34-af1ac8d924a4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-ckzls" (UID: "9a6b0c11-7b7c-460a-8a34-af1ac8d924a4") : secret "cluster-monitoring-operator-tls" not found Jul 09 01:38:26.998038 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:26.997723 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f36af6b-773c-49e1-a9ff-efbd797e59f7-service-ca-bundle podName:7f36af6b-773c-49e1-a9ff-efbd797e59f7 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:30.997706453 +0000 UTC m=+43.659443931 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7f36af6b-773c-49e1-a9ff-efbd797e59f7-service-ca-bundle") pod "router-default-b7cdbb4c5-nksgs" (UID: "7f36af6b-773c-49e1-a9ff-efbd797e59f7") : configmap references non-existent config key: service-ca.crt Jul 09 01:38:26.998038 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:26.997759 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e36c83c0-d80b-4f03-957e-f8fa2186bc55-metrics-tls\") pod \"dns-default-fzl7v\" (UID: \"e36c83c0-d80b-4f03-957e-f8fa2186bc55\") " pod="openshift-dns/dns-default-fzl7v" Jul 09 01:38:26.998038 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:26.997798 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-tls\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:26.998038 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:26.997839 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/99942bcc-7a4f-4495-a1fe-7ce77a613b89-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-p5xcw\" (UID: \"99942bcc-7a4f-4495-a1fe-7ce77a613b89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p5xcw" Jul 09 01:38:26.998038 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:26.997883 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f36af6b-773c-49e1-a9ff-efbd797e59f7-metrics-certs\") pod \"router-default-b7cdbb4c5-nksgs\" (UID: \"7f36af6b-773c-49e1-a9ff-efbd797e59f7\") " pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:26.998038 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:26.997970 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 01:38:26.998038 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:26.998001 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f36af6b-773c-49e1-a9ff-efbd797e59f7-metrics-certs podName:7f36af6b-773c-49e1-a9ff-efbd797e59f7 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:30.997990326 +0000 UTC m=+43.659727804 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f36af6b-773c-49e1-a9ff-efbd797e59f7-metrics-certs") pod "router-default-b7cdbb4c5-nksgs" (UID: "7f36af6b-773c-49e1-a9ff-efbd797e59f7") : secret "router-metrics-certs-default" not found Jul 09 01:38:26.998038 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:26.998039 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 01:38:26.998038 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:26.998051 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56f4fc4775-qvb8g: secret "image-registry-tls" not found Jul 09 01:38:26.998865 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:26.998060 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 01:38:26.998865 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:26.998090 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-tls podName:4543d666-8d9f-4e5a-9cd1-e1b504aca20d nodeName:}" failed. No retries permitted until 2026-07-09 01:38:30.998077767 +0000 UTC m=+43.659815238 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-tls") pod "image-registry-56f4fc4775-qvb8g" (UID: "4543d666-8d9f-4e5a-9cd1-e1b504aca20d") : secret "image-registry-tls" not found Jul 09 01:38:26.998865 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:26.998106 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99942bcc-7a4f-4495-a1fe-7ce77a613b89-samples-operator-tls podName:99942bcc-7a4f-4495-a1fe-7ce77a613b89 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:30.998097701 +0000 UTC m=+43.659835174 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/99942bcc-7a4f-4495-a1fe-7ce77a613b89-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-p5xcw" (UID: "99942bcc-7a4f-4495-a1fe-7ce77a613b89") : secret "samples-operator-tls" not found Jul 09 01:38:26.998865 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:26.998129 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 01:38:26.998865 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:26.998164 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e36c83c0-d80b-4f03-957e-f8fa2186bc55-metrics-tls podName:e36c83c0-d80b-4f03-957e-f8fa2186bc55 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:30.998153944 +0000 UTC m=+43.659891419 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e36c83c0-d80b-4f03-957e-f8fa2186bc55-metrics-tls") pod "dns-default-fzl7v" (UID: "e36c83c0-d80b-4f03-957e-f8fa2186bc55") : secret "dns-default-metrics-tls" not found Jul 09 01:38:31.039537 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:31.039494 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e36c83c0-d80b-4f03-957e-f8fa2186bc55-metrics-tls\") pod \"dns-default-fzl7v\" (UID: \"e36c83c0-d80b-4f03-957e-f8fa2186bc55\") " pod="openshift-dns/dns-default-fzl7v" Jul 09 01:38:31.040016 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:31.039548 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-tls\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:31.040016 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:31.039576 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/99942bcc-7a4f-4495-a1fe-7ce77a613b89-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-p5xcw\" (UID: \"99942bcc-7a4f-4495-a1fe-7ce77a613b89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p5xcw" Jul 09 01:38:31.040016 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:31.039605 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f36af6b-773c-49e1-a9ff-efbd797e59f7-metrics-certs\") pod \"router-default-b7cdbb4c5-nksgs\" (UID: \"7f36af6b-773c-49e1-a9ff-efbd797e59f7\") " pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:31.040016 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:31.039657 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 01:38:31.040016 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:31.039661 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbe2870c-05fa-44fd-9172-e556eb36c121-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-smgrj\" (UID: \"bbe2870c-05fa-44fd-9172-e556eb36c121\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-smgrj" Jul 09 01:38:31.040016 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:31.039713 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 01:38:31.040016 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:31.039747 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f36af6b-773c-49e1-a9ff-efbd797e59f7-service-ca-bundle\") pod \"router-default-b7cdbb4c5-nksgs\" (UID: \"7f36af6b-773c-49e1-a9ff-efbd797e59f7\") " pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:31.040016 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:31.039758 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 01:38:31.040016 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:31.039787 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f36af6b-773c-49e1-a9ff-efbd797e59f7-metrics-certs podName:7f36af6b-773c-49e1-a9ff-efbd797e59f7 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:39.039767606 +0000 UTC m=+51.701505090 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f36af6b-773c-49e1-a9ff-efbd797e59f7-metrics-certs") pod "router-default-b7cdbb4c5-nksgs" (UID: "7f36af6b-773c-49e1-a9ff-efbd797e59f7") : secret "router-metrics-certs-default" not found Jul 09 01:38:31.040016 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:31.039661 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 01:38:31.040016 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:31.039813 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a6b0c11-7b7c-460a-8a34-af1ac8d924a4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-ckzls\" (UID: \"9a6b0c11-7b7c-460a-8a34-af1ac8d924a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ckzls" Jul 09 01:38:31.040016 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:31.039826 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56f4fc4775-qvb8g: secret "image-registry-tls" not found Jul 09 01:38:31.040016 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:31.039833 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f36af6b-773c-49e1-a9ff-efbd797e59f7-service-ca-bundle podName:7f36af6b-773c-49e1-a9ff-efbd797e59f7 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:39.039819285 +0000 UTC m=+51.701556776 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7f36af6b-773c-49e1-a9ff-efbd797e59f7-service-ca-bundle") pod "router-default-b7cdbb4c5-nksgs" (UID: "7f36af6b-773c-49e1-a9ff-efbd797e59f7") : configmap references non-existent config key: service-ca.crt Jul 09 01:38:31.040016 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:31.039765 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 01:38:31.040016 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:31.039852 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbe2870c-05fa-44fd-9172-e556eb36c121-networking-console-plugin-cert podName:bbe2870c-05fa-44fd-9172-e556eb36c121 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:39.039843501 +0000 UTC m=+51.701580974 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bbe2870c-05fa-44fd-9172-e556eb36c121-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-smgrj" (UID: "bbe2870c-05fa-44fd-9172-e556eb36c121") : secret "networking-console-plugin-cert" not found Jul 09 01:38:31.040016 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:31.039866 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-tls podName:4543d666-8d9f-4e5a-9cd1-e1b504aca20d nodeName:}" failed. No retries permitted until 2026-07-09 01:38:39.039858613 +0000 UTC m=+51.701596087 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-tls") pod "image-registry-56f4fc4775-qvb8g" (UID: "4543d666-8d9f-4e5a-9cd1-e1b504aca20d") : secret "image-registry-tls" not found Jul 09 01:38:31.040864 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:31.039880 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e36c83c0-d80b-4f03-957e-f8fa2186bc55-metrics-tls podName:e36c83c0-d80b-4f03-957e-f8fa2186bc55 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:39.039872621 +0000 UTC m=+51.701610093 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e36c83c0-d80b-4f03-957e-f8fa2186bc55-metrics-tls") pod "dns-default-fzl7v" (UID: "e36c83c0-d80b-4f03-957e-f8fa2186bc55") : secret "dns-default-metrics-tls" not found Jul 09 01:38:31.040864 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:31.039894 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99942bcc-7a4f-4495-a1fe-7ce77a613b89-samples-operator-tls podName:99942bcc-7a4f-4495-a1fe-7ce77a613b89 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:39.039886586 +0000 UTC m=+51.701624058 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/99942bcc-7a4f-4495-a1fe-7ce77a613b89-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-p5xcw" (UID: "99942bcc-7a4f-4495-a1fe-7ce77a613b89") : secret "samples-operator-tls" not found Jul 09 01:38:31.040864 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:31.039914 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 01:38:31.040864 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:31.039955 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a6b0c11-7b7c-460a-8a34-af1ac8d924a4-cluster-monitoring-operator-tls podName:9a6b0c11-7b7c-460a-8a34-af1ac8d924a4 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:39.039943862 +0000 UTC m=+51.701681362 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9a6b0c11-7b7c-460a-8a34-af1ac8d924a4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-ckzls" (UID: "9a6b0c11-7b7c-460a-8a34-af1ac8d924a4") : secret "cluster-monitoring-operator-tls" not found Jul 09 01:38:34.091515 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:34.091256 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-q6qdb" event={"ID":"a95a7f22-fa64-492d-a8fb-b115d707eb17","Type":"ContainerStarted","Data":"c3b7711ba12f880f049f6f23a10ea984bfd7aa28188a5d37fafbb22a1581c0ff"} Jul 09 01:38:34.094905 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:34.094877 2564 generic.go:356] "Generic (PLEG): container finished" podID="3289febf-366d-4f6b-857c-be94e8771fba" containerID="54371f27bf74a13b788d7b911d647b622872442f4ec70e588d90c699ab96f014" exitCode=0 Jul 09 01:38:34.095042 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:34.094944 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkgtm" event={"ID":"3289febf-366d-4f6b-857c-be94e8771fba","Type":"ContainerDied","Data":"54371f27bf74a13b788d7b911d647b622872442f4ec70e588d90c699ab96f014"} Jul 09 01:38:34.096680 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:34.096656 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qpvvm" event={"ID":"440a2154-c6ac-4974-86c3-e61735bfe17b","Type":"ContainerStarted","Data":"dd9a1610564e6be508f5778793ad0da757de5c40bae5134d907c2e43341a6b37"} Jul 09 01:38:34.098354 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:34.098317 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-99rjb" event={"ID":"e61b2313-6b39-4068-95b6-dd2a95db5b1d","Type":"ContainerStarted","Data":"f1e9ed561e7e7517cce79fed4ad36c38bc0d84d16b6d8933bdf19e05f25a0f3c"} Jul 09 01:38:34.100015 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:34.099992 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rxlj9" event={"ID":"f827dc20-03eb-481b-98bd-52e34499e298","Type":"ContainerStarted","Data":"01f6ac5f4d7d279da4a21ce5efe29feac2e0a044dc403b7c28be7cc9ba5dbde6"} Jul 09 01:38:34.102044 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:34.102024 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gfhk_3d8307ed-04c9-429e-a83c-7b24847e0a38/console-operator/0.log" Jul 09 01:38:34.102148 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:34.102064 2564 generic.go:356] "Generic (PLEG): container finished" podID="3d8307ed-04c9-429e-a83c-7b24847e0a38" containerID="e437457ddbabb72a6abf30200d9ed005b40d8d82a502b7bd3aca3f24dcec335b" exitCode=255 Jul 09 01:38:34.102148 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:34.102136 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-7gfhk" event={"ID":"3d8307ed-04c9-429e-a83c-7b24847e0a38","Type":"ContainerDied","Data":"e437457ddbabb72a6abf30200d9ed005b40d8d82a502b7bd3aca3f24dcec335b"} Jul 09 01:38:34.102379 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:34.102348 2564 scope.go:117] "RemoveContainer" containerID="e437457ddbabb72a6abf30200d9ed005b40d8d82a502b7bd3aca3f24dcec335b" Jul 09 01:38:34.104283 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:34.104258 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-h8pb8" event={"ID":"18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662","Type":"ContainerStarted","Data":"c6c5efa165ddcb6c50a4e78e0407fb9073e9ae7571522496abaf29b1cbe51001"} Jul 09 01:38:34.105822 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:34.105796 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9z9g5" event={"ID":"fa5bc969-c6e4-4e77-a7e5-268e982bc0b4","Type":"ContainerStarted","Data":"72b9ec4528e10feb14a033775c710099a41538171bc09d759b131348ea921bb4"} Jul 09 01:38:34.107147 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:34.107109 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-q6qdb" podStartSLOduration=20.902672573 podStartE2EDuration="30.107096406s" totalImagesPullingTime="9.204423833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:38:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:34.106218462 +0000 UTC m=+46.767955954" watchObservedRunningTime="2026-07-09 01:38:34.107096406 +0000 UTC m=+46.768833894" Jul 09 01:38:34.123512 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:34.123465 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rxlj9" podStartSLOduration=27.835120655 podStartE2EDuration="37.12344701s" totalImagesPullingTime="9.288326355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:37:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:34.122766581 +0000 UTC m=+46.784504074" watchObservedRunningTime="2026-07-09 01:38:34.12344701 +0000 UTC m=+46.785184501" Jul 09 01:38:34.138154 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:34.138106 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-99rjb" podStartSLOduration=26.900695491 podStartE2EDuration="36.138088639s" totalImagesPullingTime="9.237393148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:37:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:34.136706863 +0000 UTC m=+46.798444375" watchObservedRunningTime="2026-07-09 01:38:34.138088639 +0000 UTC m=+46.799826132" Jul 09 01:38:34.156611 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:34.155504 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qpvvm" podStartSLOduration=1.941606736 podStartE2EDuration="11.155486275s" totalImagesPullingTime="9.213879539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:38:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:34.153885016 +0000 UTC m=+46.815622509" watchObservedRunningTime="2026-07-09 01:38:34.155486275 +0000 UTC m=+46.817223748" Jul 09 01:38:34.226761 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:34.226708 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9z9g5" podStartSLOduration=27.883098466 podStartE2EDuration="37.226684641s" totalImagesPullingTime="9.343586175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:37:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:34.225027226 +0000 UTC m=+46.886764718" watchObservedRunningTime="2026-07-09 01:38:34.226684641 +0000 UTC m=+46.888422139" Jul 09 01:38:34.862162 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:34.862092 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-h8pb8" podStartSLOduration=28.596625111 podStartE2EDuration="37.862066745s" totalImagesPullingTime="9.265441634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:37:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:34.247775193 +0000 UTC m=+46.909512664" watchObservedRunningTime="2026-07-09 01:38:34.862066745 +0000 UTC m=+47.523804217" Jul 09 01:38:34.873268 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:34.869362 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mr7jk"] Jul 09 01:38:34.884042 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:34.883658 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mr7jk" Jul 09 01:38:34.885135 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:34.885065 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mr7jk"] Jul 09 01:38:34.886430 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:34.886402 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 01:38:34.886584 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:34.886567 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4v722\"" Jul 09 01:38:34.886864 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:34.886622 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 01:38:34.977132 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:34.977092 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abfdb912-0143-469c-87e1-53fed7b4c2fd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mr7jk\" (UID: \"abfdb912-0143-469c-87e1-53fed7b4c2fd\") " pod="openshift-insights/insights-runtime-extractor-mr7jk" Jul 09 01:38:34.977461 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:34.977427 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65zwl\" (UniqueName: \"kubernetes.io/projected/abfdb912-0143-469c-87e1-53fed7b4c2fd-kube-api-access-65zwl\") pod \"insights-runtime-extractor-mr7jk\" (UID: \"abfdb912-0143-469c-87e1-53fed7b4c2fd\") " pod="openshift-insights/insights-runtime-extractor-mr7jk" Jul 09 01:38:34.977557 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:34.977491 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/abfdb912-0143-469c-87e1-53fed7b4c2fd-data-volume\") pod \"insights-runtime-extractor-mr7jk\" (UID: \"abfdb912-0143-469c-87e1-53fed7b4c2fd\") " pod="openshift-insights/insights-runtime-extractor-mr7jk" Jul 09 01:38:34.977557 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:34.977530 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abfdb912-0143-469c-87e1-53fed7b4c2fd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mr7jk\" (UID: \"abfdb912-0143-469c-87e1-53fed7b4c2fd\") " pod="openshift-insights/insights-runtime-extractor-mr7jk" Jul 09 01:38:34.977711 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:34.977684 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/abfdb912-0143-469c-87e1-53fed7b4c2fd-crio-socket\") pod \"insights-runtime-extractor-mr7jk\" (UID: \"abfdb912-0143-469c-87e1-53fed7b4c2fd\") " pod="openshift-insights/insights-runtime-extractor-mr7jk" Jul 09 01:38:35.078826 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:35.078789 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65zwl\" (UniqueName: \"kubernetes.io/projected/abfdb912-0143-469c-87e1-53fed7b4c2fd-kube-api-access-65zwl\") pod \"insights-runtime-extractor-mr7jk\" (UID: \"abfdb912-0143-469c-87e1-53fed7b4c2fd\") " pod="openshift-insights/insights-runtime-extractor-mr7jk" Jul 09 01:38:35.079033 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:35.078838 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/abfdb912-0143-469c-87e1-53fed7b4c2fd-data-volume\") pod \"insights-runtime-extractor-mr7jk\" (UID: \"abfdb912-0143-469c-87e1-53fed7b4c2fd\") " pod="openshift-insights/insights-runtime-extractor-mr7jk" Jul 09 01:38:35.079033 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:35.078862 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abfdb912-0143-469c-87e1-53fed7b4c2fd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mr7jk\" (UID: \"abfdb912-0143-469c-87e1-53fed7b4c2fd\") " pod="openshift-insights/insights-runtime-extractor-mr7jk" Jul 09 01:38:35.079033 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:35.078917 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/abfdb912-0143-469c-87e1-53fed7b4c2fd-crio-socket\") pod \"insights-runtime-extractor-mr7jk\" (UID: \"abfdb912-0143-469c-87e1-53fed7b4c2fd\") " pod="openshift-insights/insights-runtime-extractor-mr7jk" Jul 09 01:38:35.079033 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:35.078982 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abfdb912-0143-469c-87e1-53fed7b4c2fd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mr7jk\" (UID: \"abfdb912-0143-469c-87e1-53fed7b4c2fd\") " pod="openshift-insights/insights-runtime-extractor-mr7jk" Jul 09 01:38:35.079218 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:35.079081 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 01:38:35.079218 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:35.079121 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/abfdb912-0143-469c-87e1-53fed7b4c2fd-crio-socket\") pod \"insights-runtime-extractor-mr7jk\" (UID: \"abfdb912-0143-469c-87e1-53fed7b4c2fd\") " pod="openshift-insights/insights-runtime-extractor-mr7jk" Jul 09 01:38:35.079218 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:35.079137 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 01:38:35.079218 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:35.079170 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/abfdb912-0143-469c-87e1-53fed7b4c2fd-kube-rbac-proxy-cm podName:abfdb912-0143-469c-87e1-53fed7b4c2fd nodeName:}" failed. No retries permitted until 2026-07-09 01:38:35.579148797 +0000 UTC m=+48.240886283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/abfdb912-0143-469c-87e1-53fed7b4c2fd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mr7jk" (UID: "abfdb912-0143-469c-87e1-53fed7b4c2fd") : configmap "kube-rbac-proxy" not found Jul 09 01:38:35.079218 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:35.079203 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abfdb912-0143-469c-87e1-53fed7b4c2fd-insights-runtime-extractor-tls podName:abfdb912-0143-469c-87e1-53fed7b4c2fd nodeName:}" failed. No retries permitted until 2026-07-09 01:38:35.579184553 +0000 UTC m=+48.240922038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/abfdb912-0143-469c-87e1-53fed7b4c2fd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mr7jk" (UID: "abfdb912-0143-469c-87e1-53fed7b4c2fd") : secret "insights-runtime-extractor-tls" not found Jul 09 01:38:35.079218 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:35.079202 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/abfdb912-0143-469c-87e1-53fed7b4c2fd-data-volume\") pod \"insights-runtime-extractor-mr7jk\" (UID: \"abfdb912-0143-469c-87e1-53fed7b4c2fd\") " pod="openshift-insights/insights-runtime-extractor-mr7jk" Jul 09 01:38:35.091920 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:35.091896 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65zwl\" (UniqueName: \"kubernetes.io/projected/abfdb912-0143-469c-87e1-53fed7b4c2fd-kube-api-access-65zwl\") pod \"insights-runtime-extractor-mr7jk\" (UID: \"abfdb912-0143-469c-87e1-53fed7b4c2fd\") " pod="openshift-insights/insights-runtime-extractor-mr7jk" Jul 09 01:38:35.114172 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:35.114097 2564 generic.go:356] "Generic (PLEG): container finished" podID="3289febf-366d-4f6b-857c-be94e8771fba" containerID="9e753a05865233877eaf510fb46cb87241a3d220c7d8346039af9da5087b0fe4" exitCode=0 Jul 09 01:38:35.114342 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:35.114166 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkgtm" event={"ID":"3289febf-366d-4f6b-857c-be94e8771fba","Type":"ContainerDied","Data":"9e753a05865233877eaf510fb46cb87241a3d220c7d8346039af9da5087b0fe4"} Jul 09 01:38:35.115853 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:35.115837 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gfhk_3d8307ed-04c9-429e-a83c-7b24847e0a38/console-operator/1.log" Jul 09 01:38:35.116312 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:35.116294 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gfhk_3d8307ed-04c9-429e-a83c-7b24847e0a38/console-operator/0.log" Jul 09 01:38:35.116395 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:35.116334 2564 generic.go:356] "Generic (PLEG): container finished" podID="3d8307ed-04c9-429e-a83c-7b24847e0a38" containerID="82466025c4f4794324ab4090762726922cf57cca6756f6cd85feaa0dbc748934" exitCode=255 Jul 09 01:38:35.116487 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:35.116459 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-7gfhk" event={"ID":"3d8307ed-04c9-429e-a83c-7b24847e0a38","Type":"ContainerDied","Data":"82466025c4f4794324ab4090762726922cf57cca6756f6cd85feaa0dbc748934"} Jul 09 01:38:35.116557 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:35.116541 2564 scope.go:117] "RemoveContainer" containerID="e437457ddbabb72a6abf30200d9ed005b40d8d82a502b7bd3aca3f24dcec335b" Jul 09 01:38:35.116658 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:35.116642 2564 scope.go:117] "RemoveContainer" containerID="82466025c4f4794324ab4090762726922cf57cca6756f6cd85feaa0dbc748934" Jul 09 01:38:35.116865 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:35.116815 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-7gfhk_openshift-console-operator(3d8307ed-04c9-429e-a83c-7b24847e0a38)\"" pod="openshift-console-operator/console-operator-68b757fb67-7gfhk" podUID="3d8307ed-04c9-429e-a83c-7b24847e0a38" Jul 09 01:38:35.584996 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:35.584957 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abfdb912-0143-469c-87e1-53fed7b4c2fd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mr7jk\" (UID: \"abfdb912-0143-469c-87e1-53fed7b4c2fd\") " pod="openshift-insights/insights-runtime-extractor-mr7jk" Jul 09 01:38:35.585166 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:35.585094 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 01:38:35.585166 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:35.585125 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abfdb912-0143-469c-87e1-53fed7b4c2fd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mr7jk\" (UID: \"abfdb912-0143-469c-87e1-53fed7b4c2fd\") " pod="openshift-insights/insights-runtime-extractor-mr7jk" Jul 09 01:38:35.585166 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:35.585155 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/abfdb912-0143-469c-87e1-53fed7b4c2fd-kube-rbac-proxy-cm podName:abfdb912-0143-469c-87e1-53fed7b4c2fd nodeName:}" failed. No retries permitted until 2026-07-09 01:38:36.585138532 +0000 UTC m=+49.246876002 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/abfdb912-0143-469c-87e1-53fed7b4c2fd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mr7jk" (UID: "abfdb912-0143-469c-87e1-53fed7b4c2fd") : configmap "kube-rbac-proxy" not found Jul 09 01:38:35.585349 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:35.585267 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 01:38:35.585349 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:35.585318 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abfdb912-0143-469c-87e1-53fed7b4c2fd-insights-runtime-extractor-tls podName:abfdb912-0143-469c-87e1-53fed7b4c2fd nodeName:}" failed. No retries permitted until 2026-07-09 01:38:36.585304886 +0000 UTC m=+49.247042378 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/abfdb912-0143-469c-87e1-53fed7b4c2fd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mr7jk" (UID: "abfdb912-0143-469c-87e1-53fed7b4c2fd") : secret "insights-runtime-extractor-tls" not found Jul 09 01:38:36.124036 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:36.124002 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkgtm" event={"ID":"3289febf-366d-4f6b-857c-be94e8771fba","Type":"ContainerStarted","Data":"9e5b9577119ef8d7f2839b22681b35c253b317641d9d9e53dc9877e148100c9f"} Jul 09 01:38:36.125597 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:36.125575 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gfhk_3d8307ed-04c9-429e-a83c-7b24847e0a38/console-operator/1.log" Jul 09 01:38:36.125933 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:36.125915 2564 scope.go:117] "RemoveContainer" containerID="82466025c4f4794324ab4090762726922cf57cca6756f6cd85feaa0dbc748934" Jul 09 01:38:36.126107 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:36.126086 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-7gfhk_openshift-console-operator(3d8307ed-04c9-429e-a83c-7b24847e0a38)\"" pod="openshift-console-operator/console-operator-68b757fb67-7gfhk" podUID="3d8307ed-04c9-429e-a83c-7b24847e0a38" Jul 09 01:38:36.145637 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:36.145590 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fkgtm" podStartSLOduration=11.512898542 podStartE2EDuration="48.14557021s" totalImagesPullingTime="36.632671668s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:37:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:36.14390433 +0000 UTC m=+48.805641822" watchObservedRunningTime="2026-07-09 01:38:36.14557021 +0000 UTC m=+48.807307703" Jul 09 01:38:36.596469 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:36.596421 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abfdb912-0143-469c-87e1-53fed7b4c2fd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mr7jk\" (UID: \"abfdb912-0143-469c-87e1-53fed7b4c2fd\") " pod="openshift-insights/insights-runtime-extractor-mr7jk" Jul 09 01:38:36.596651 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:36.596558 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abfdb912-0143-469c-87e1-53fed7b4c2fd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mr7jk\" (UID: \"abfdb912-0143-469c-87e1-53fed7b4c2fd\") " pod="openshift-insights/insights-runtime-extractor-mr7jk" Jul 09 01:38:36.596651 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:36.596586 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 01:38:36.596746 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:36.596654 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abfdb912-0143-469c-87e1-53fed7b4c2fd-insights-runtime-extractor-tls podName:abfdb912-0143-469c-87e1-53fed7b4c2fd nodeName:}" failed. No retries permitted until 2026-07-09 01:38:38.596636809 +0000 UTC m=+51.258374304 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/abfdb912-0143-469c-87e1-53fed7b4c2fd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mr7jk" (UID: "abfdb912-0143-469c-87e1-53fed7b4c2fd") : secret "insights-runtime-extractor-tls" not found Jul 09 01:38:36.596746 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:36.596674 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 01:38:36.596746 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:36.596727 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/abfdb912-0143-469c-87e1-53fed7b4c2fd-kube-rbac-proxy-cm podName:abfdb912-0143-469c-87e1-53fed7b4c2fd nodeName:}" failed. No retries permitted until 2026-07-09 01:38:38.596714522 +0000 UTC m=+51.258451996 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/abfdb912-0143-469c-87e1-53fed7b4c2fd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mr7jk" (UID: "abfdb912-0143-469c-87e1-53fed7b4c2fd") : configmap "kube-rbac-proxy" not found Jul 09 01:38:36.677144 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:36.677118 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wwf2c_2a07af9d-8807-44f2-9185-2a4f5f57e0e3/dns-node-resolver/0.log" Jul 09 01:38:37.483392 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:37.483365 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zj4qk_872d30ee-57a3-4820-b761-38485e5bfcc0/node-ca/0.log" Jul 09 01:38:38.278960 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:38.278918 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qpvvm_440a2154-c6ac-4974-86c3-e61735bfe17b/serve-healthcheck-canary/0.log" Jul 09 01:38:38.614791 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:38.614704 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abfdb912-0143-469c-87e1-53fed7b4c2fd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mr7jk\" (UID: \"abfdb912-0143-469c-87e1-53fed7b4c2fd\") " pod="openshift-insights/insights-runtime-extractor-mr7jk" Jul 09 01:38:38.615166 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:38.614827 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 01:38:38.615166 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:38.614845 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abfdb912-0143-469c-87e1-53fed7b4c2fd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mr7jk\" (UID: \"abfdb912-0143-469c-87e1-53fed7b4c2fd\") " pod="openshift-insights/insights-runtime-extractor-mr7jk" Jul 09 01:38:38.615166 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:38.614898 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/abfdb912-0143-469c-87e1-53fed7b4c2fd-kube-rbac-proxy-cm podName:abfdb912-0143-469c-87e1-53fed7b4c2fd nodeName:}" failed. No retries permitted until 2026-07-09 01:38:42.614880933 +0000 UTC m=+55.276618402 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/abfdb912-0143-469c-87e1-53fed7b4c2fd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mr7jk" (UID: "abfdb912-0143-469c-87e1-53fed7b4c2fd") : configmap "kube-rbac-proxy" not found Jul 09 01:38:38.615166 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:38.614960 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 01:38:38.615166 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:38.615016 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abfdb912-0143-469c-87e1-53fed7b4c2fd-insights-runtime-extractor-tls podName:abfdb912-0143-469c-87e1-53fed7b4c2fd nodeName:}" failed. No retries permitted until 2026-07-09 01:38:42.614999745 +0000 UTC m=+55.276737217 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/abfdb912-0143-469c-87e1-53fed7b4c2fd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mr7jk" (UID: "abfdb912-0143-469c-87e1-53fed7b4c2fd") : secret "insights-runtime-extractor-tls" not found Jul 09 01:38:39.119651 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:39.119610 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f36af6b-773c-49e1-a9ff-efbd797e59f7-service-ca-bundle\") pod \"router-default-b7cdbb4c5-nksgs\" (UID: \"7f36af6b-773c-49e1-a9ff-efbd797e59f7\") " pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:39.119651 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:39.119656 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a6b0c11-7b7c-460a-8a34-af1ac8d924a4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-ckzls\" (UID: \"9a6b0c11-7b7c-460a-8a34-af1ac8d924a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ckzls" Jul 09 01:38:39.119891 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:39.119700 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e36c83c0-d80b-4f03-957e-f8fa2186bc55-metrics-tls\") pod \"dns-default-fzl7v\" (UID: \"e36c83c0-d80b-4f03-957e-f8fa2186bc55\") " pod="openshift-dns/dns-default-fzl7v" Jul 09 01:38:39.119891 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:39.119733 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-tls\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:39.119891 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:39.119784 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/99942bcc-7a4f-4495-a1fe-7ce77a613b89-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-p5xcw\" (UID: \"99942bcc-7a4f-4495-a1fe-7ce77a613b89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p5xcw" Jul 09 01:38:39.119891 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:39.119801 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f36af6b-773c-49e1-a9ff-efbd797e59f7-service-ca-bundle podName:7f36af6b-773c-49e1-a9ff-efbd797e59f7 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:55.119778066 +0000 UTC m=+67.781515550 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7f36af6b-773c-49e1-a9ff-efbd797e59f7-service-ca-bundle") pod "router-default-b7cdbb4c5-nksgs" (UID: "7f36af6b-773c-49e1-a9ff-efbd797e59f7") : configmap references non-existent config key: service-ca.crt Jul 09 01:38:39.119891 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:39.119844 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 01:38:39.119891 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:39.119854 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 01:38:39.119891 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:39.119874 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56f4fc4775-qvb8g: secret "image-registry-tls" not found Jul 09 01:38:39.119891 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:39.119878 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f36af6b-773c-49e1-a9ff-efbd797e59f7-metrics-certs\") pod \"router-default-b7cdbb4c5-nksgs\" (UID: \"7f36af6b-773c-49e1-a9ff-efbd797e59f7\") " pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:39.120199 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:39.119901 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a6b0c11-7b7c-460a-8a34-af1ac8d924a4-cluster-monitoring-operator-tls podName:9a6b0c11-7b7c-460a-8a34-af1ac8d924a4 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:55.119885717 +0000 UTC m=+67.781623190 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9a6b0c11-7b7c-460a-8a34-af1ac8d924a4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-ckzls" (UID: "9a6b0c11-7b7c-460a-8a34-af1ac8d924a4") : secret "cluster-monitoring-operator-tls" not found Jul 09 01:38:39.120199 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:39.119926 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-tls podName:4543d666-8d9f-4e5a-9cd1-e1b504aca20d nodeName:}" failed. No retries permitted until 2026-07-09 01:38:55.119912734 +0000 UTC m=+67.781650209 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-tls") pod "image-registry-56f4fc4775-qvb8g" (UID: "4543d666-8d9f-4e5a-9cd1-e1b504aca20d") : secret "image-registry-tls" not found Jul 09 01:38:39.120199 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:39.119860 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 01:38:39.120199 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:39.119944 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 01:38:39.120199 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:39.119968 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99942bcc-7a4f-4495-a1fe-7ce77a613b89-samples-operator-tls podName:99942bcc-7a4f-4495-a1fe-7ce77a613b89 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:55.119957851 +0000 UTC m=+67.781695326 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/99942bcc-7a4f-4495-a1fe-7ce77a613b89-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-p5xcw" (UID: "99942bcc-7a4f-4495-a1fe-7ce77a613b89") : secret "samples-operator-tls" not found Jul 09 01:38:39.120199 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:39.119983 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f36af6b-773c-49e1-a9ff-efbd797e59f7-metrics-certs podName:7f36af6b-773c-49e1-a9ff-efbd797e59f7 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:55.119977446 +0000 UTC m=+67.781714921 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f36af6b-773c-49e1-a9ff-efbd797e59f7-metrics-certs") pod "router-default-b7cdbb4c5-nksgs" (UID: "7f36af6b-773c-49e1-a9ff-efbd797e59f7") : secret "router-metrics-certs-default" not found Jul 09 01:38:39.120199 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:39.120023 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbe2870c-05fa-44fd-9172-e556eb36c121-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-smgrj\" (UID: \"bbe2870c-05fa-44fd-9172-e556eb36c121\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-smgrj" Jul 09 01:38:39.120199 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:39.120037 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 01:38:39.120199 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:39.120071 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e36c83c0-d80b-4f03-957e-f8fa2186bc55-metrics-tls podName:e36c83c0-d80b-4f03-957e-f8fa2186bc55 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:55.120061692 +0000 UTC m=+67.781799165 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e36c83c0-d80b-4f03-957e-f8fa2186bc55-metrics-tls") pod "dns-default-fzl7v" (UID: "e36c83c0-d80b-4f03-957e-f8fa2186bc55") : secret "dns-default-metrics-tls" not found Jul 09 01:38:39.120199 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:39.120112 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 01:38:39.120199 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:39.120171 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbe2870c-05fa-44fd-9172-e556eb36c121-networking-console-plugin-cert podName:bbe2870c-05fa-44fd-9172-e556eb36c121 nodeName:}" failed. No retries permitted until 2026-07-09 01:38:55.120155889 +0000 UTC m=+67.781893375 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bbe2870c-05fa-44fd-9172-e556eb36c121-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-smgrj" (UID: "bbe2870c-05fa-44fd-9172-e556eb36c121") : secret "networking-console-plugin-cert" not found Jul 09 01:38:42.654126 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:42.654085 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abfdb912-0143-469c-87e1-53fed7b4c2fd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mr7jk\" (UID: \"abfdb912-0143-469c-87e1-53fed7b4c2fd\") " pod="openshift-insights/insights-runtime-extractor-mr7jk" Jul 09 01:38:42.654615 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:42.654214 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abfdb912-0143-469c-87e1-53fed7b4c2fd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mr7jk\" (UID: \"abfdb912-0143-469c-87e1-53fed7b4c2fd\") " pod="openshift-insights/insights-runtime-extractor-mr7jk" Jul 09 01:38:42.654615 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:42.654256 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 01:38:42.654615 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:42.654332 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abfdb912-0143-469c-87e1-53fed7b4c2fd-insights-runtime-extractor-tls podName:abfdb912-0143-469c-87e1-53fed7b4c2fd nodeName:}" failed. No retries permitted until 2026-07-09 01:38:50.654314551 +0000 UTC m=+63.316052021 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/abfdb912-0143-469c-87e1-53fed7b4c2fd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mr7jk" (UID: "abfdb912-0143-469c-87e1-53fed7b4c2fd") : secret "insights-runtime-extractor-tls" not found Jul 09 01:38:42.654615 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:42.654332 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 01:38:42.654615 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:42.654383 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/abfdb912-0143-469c-87e1-53fed7b4c2fd-kube-rbac-proxy-cm podName:abfdb912-0143-469c-87e1-53fed7b4c2fd nodeName:}" failed. No retries permitted until 2026-07-09 01:38:50.654367824 +0000 UTC m=+63.316105307 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/abfdb912-0143-469c-87e1-53fed7b4c2fd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mr7jk" (UID: "abfdb912-0143-469c-87e1-53fed7b4c2fd") : configmap "kube-rbac-proxy" not found Jul 09 01:38:43.609440 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:43.609403 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-7gfhk" Jul 09 01:38:43.609691 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:43.609461 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-7gfhk" Jul 09 01:38:43.609821 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:43.609809 2564 scope.go:117] "RemoveContainer" containerID="82466025c4f4794324ab4090762726922cf57cca6756f6cd85feaa0dbc748934" Jul 09 01:38:43.609999 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:43.609980 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-7gfhk_openshift-console-operator(3d8307ed-04c9-429e-a83c-7b24847e0a38)\"" pod="openshift-console-operator/console-operator-68b757fb67-7gfhk" podUID="3d8307ed-04c9-429e-a83c-7b24847e0a38" Jul 09 01:38:50.050325 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:50.050299 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ntptr" Jul 09 01:38:50.729071 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:50.729034 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abfdb912-0143-469c-87e1-53fed7b4c2fd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mr7jk\" (UID: \"abfdb912-0143-469c-87e1-53fed7b4c2fd\") " pod="openshift-insights/insights-runtime-extractor-mr7jk" Jul 09 01:38:50.729291 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:50.729270 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abfdb912-0143-469c-87e1-53fed7b4c2fd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mr7jk\" (UID: \"abfdb912-0143-469c-87e1-53fed7b4c2fd\") " pod="openshift-insights/insights-runtime-extractor-mr7jk" Jul 09 01:38:50.729389 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:50.729376 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 01:38:50.729438 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:38:50.729429 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abfdb912-0143-469c-87e1-53fed7b4c2fd-insights-runtime-extractor-tls podName:abfdb912-0143-469c-87e1-53fed7b4c2fd nodeName:}" failed. No retries permitted until 2026-07-09 01:39:06.729415737 +0000 UTC m=+79.391153206 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/abfdb912-0143-469c-87e1-53fed7b4c2fd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mr7jk" (UID: "abfdb912-0143-469c-87e1-53fed7b4c2fd") : secret "insights-runtime-extractor-tls" not found Jul 09 01:38:50.730044 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:50.730026 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/abfdb912-0143-469c-87e1-53fed7b4c2fd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mr7jk\" (UID: \"abfdb912-0143-469c-87e1-53fed7b4c2fd\") " pod="openshift-insights/insights-runtime-extractor-mr7jk" Jul 09 01:38:52.546888 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:52.546849 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eef45e59-8530-47b9-bdab-917bec4c3c42-original-pull-secret\") pod \"global-pull-secret-syncer-6g7sx\" (UID: \"eef45e59-8530-47b9-bdab-917bec4c3c42\") " pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:38:52.547380 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:52.546969 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d06ec329-9c7d-418a-b019-385ecf29cc79-metrics-certs\") pod \"network-metrics-daemon-b2d6x\" (UID: \"d06ec329-9c7d-418a-b019-385ecf29cc79\") " pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:38:52.549215 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:52.549194 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 01:38:52.549843 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:52.549826 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 01:38:52.559710 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:52.559690 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d06ec329-9c7d-418a-b019-385ecf29cc79-metrics-certs\") pod \"network-metrics-daemon-b2d6x\" (UID: \"d06ec329-9c7d-418a-b019-385ecf29cc79\") " pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:38:52.559817 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:52.559727 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eef45e59-8530-47b9-bdab-917bec4c3c42-original-pull-secret\") pod \"global-pull-secret-syncer-6g7sx\" (UID: \"eef45e59-8530-47b9-bdab-917bec4c3c42\") " pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:38:52.648427 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:52.648392 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wrpr\" (UniqueName: \"kubernetes.io/projected/d5a732a0-f772-4ff8-ba3a-9583da4f8600-kube-api-access-2wrpr\") pod \"network-check-target-22lm4\" (UID: \"d5a732a0-f772-4ff8-ba3a-9583da4f8600\") " pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:38:52.650748 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:52.650730 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wrpr\" (UniqueName: \"kubernetes.io/projected/d5a732a0-f772-4ff8-ba3a-9583da4f8600-kube-api-access-2wrpr\") pod \"network-check-target-22lm4\" (UID: \"d5a732a0-f772-4ff8-ba3a-9583da4f8600\") " pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:38:52.678905 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:52.678879 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6g7sx" Jul 09 01:38:52.689431 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:52.689407 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-npl7s\"" Jul 09 01:38:52.695598 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:52.695578 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9w8gn\"" Jul 09 01:38:52.697297 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:52.697278 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2d6x" Jul 09 01:38:52.705111 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:52.705072 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:38:52.821877 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:52.821853 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6g7sx"] Jul 09 01:38:52.824937 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:38:52.824906 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeef45e59_8530_47b9_bdab_917bec4c3c42.slice/crio-5804d180839f9831c96516175dcad025490384841e133a52ae0adc8fd49bc274 WatchSource:0}: Error finding container 5804d180839f9831c96516175dcad025490384841e133a52ae0adc8fd49bc274: Status 404 returned error can't find the container with id 5804d180839f9831c96516175dcad025490384841e133a52ae0adc8fd49bc274 Jul 09 01:38:52.842199 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:52.842137 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-22lm4"] Jul 09 01:38:52.844474 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:38:52.844448 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5a732a0_f772_4ff8_ba3a_9583da4f8600.slice/crio-cfe639ff6c56c125de3a8c911b2f4c37851941982f3f4482a67ff8d83914b1bd WatchSource:0}: Error finding container cfe639ff6c56c125de3a8c911b2f4c37851941982f3f4482a67ff8d83914b1bd: Status 404 returned error can't find the container with id cfe639ff6c56c125de3a8c911b2f4c37851941982f3f4482a67ff8d83914b1bd Jul 09 01:38:52.858986 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:52.858946 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b2d6x"] Jul 09 01:38:52.861558 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:38:52.861534 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd06ec329_9c7d_418a_b019_385ecf29cc79.slice/crio-fc60d9f45c0d24061c2dc4e13fe32250ee783053015f7bc90e5d777e4eff2fbd WatchSource:0}: Error finding container fc60d9f45c0d24061c2dc4e13fe32250ee783053015f7bc90e5d777e4eff2fbd: Status 404 returned error can't find the container with id fc60d9f45c0d24061c2dc4e13fe32250ee783053015f7bc90e5d777e4eff2fbd Jul 09 01:38:53.177745 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:53.177651 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b2d6x" event={"ID":"d06ec329-9c7d-418a-b019-385ecf29cc79","Type":"ContainerStarted","Data":"fc60d9f45c0d24061c2dc4e13fe32250ee783053015f7bc90e5d777e4eff2fbd"} Jul 09 01:38:53.178816 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:53.178784 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6g7sx" event={"ID":"eef45e59-8530-47b9-bdab-917bec4c3c42","Type":"ContainerStarted","Data":"5804d180839f9831c96516175dcad025490384841e133a52ae0adc8fd49bc274"} Jul 09 01:38:53.180206 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:53.180181 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-22lm4" event={"ID":"d5a732a0-f772-4ff8-ba3a-9583da4f8600","Type":"ContainerStarted","Data":"ca31cc99355dbbbd00ebb27c937befecd7e058bcc842fb2a3efd367c7d5e1122"} Jul 09 01:38:53.180317 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:53.180224 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-22lm4" event={"ID":"d5a732a0-f772-4ff8-ba3a-9583da4f8600","Type":"ContainerStarted","Data":"cfe639ff6c56c125de3a8c911b2f4c37851941982f3f4482a67ff8d83914b1bd"} Jul 09 01:38:53.180371 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:53.180330 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:38:53.194503 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:53.194456 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-22lm4" podStartSLOduration=65.194440197 podStartE2EDuration="1m5.194440197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:37:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:53.194160474 +0000 UTC m=+65.855897967" watchObservedRunningTime="2026-07-09 01:38:53.194440197 +0000 UTC m=+65.856177690" Jul 09 01:38:55.174695 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.174655 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f36af6b-773c-49e1-a9ff-efbd797e59f7-metrics-certs\") pod \"router-default-b7cdbb4c5-nksgs\" (UID: \"7f36af6b-773c-49e1-a9ff-efbd797e59f7\") " pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:55.175283 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.174728 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbe2870c-05fa-44fd-9172-e556eb36c121-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-smgrj\" (UID: \"bbe2870c-05fa-44fd-9172-e556eb36c121\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-smgrj" Jul 09 01:38:55.175283 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.174761 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f36af6b-773c-49e1-a9ff-efbd797e59f7-service-ca-bundle\") pod \"router-default-b7cdbb4c5-nksgs\" (UID: \"7f36af6b-773c-49e1-a9ff-efbd797e59f7\") " pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:55.175283 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.174905 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a6b0c11-7b7c-460a-8a34-af1ac8d924a4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-ckzls\" (UID: \"9a6b0c11-7b7c-460a-8a34-af1ac8d924a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ckzls" Jul 09 01:38:55.175283 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.174973 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e36c83c0-d80b-4f03-957e-f8fa2186bc55-metrics-tls\") pod \"dns-default-fzl7v\" (UID: \"e36c83c0-d80b-4f03-957e-f8fa2186bc55\") " pod="openshift-dns/dns-default-fzl7v" Jul 09 01:38:55.175283 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.175018 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-tls\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:55.175283 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.175061 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/99942bcc-7a4f-4495-a1fe-7ce77a613b89-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-p5xcw\" (UID: \"99942bcc-7a4f-4495-a1fe-7ce77a613b89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p5xcw" Jul 09 01:38:55.175705 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.175500 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f36af6b-773c-49e1-a9ff-efbd797e59f7-service-ca-bundle\") pod \"router-default-b7cdbb4c5-nksgs\" (UID: \"7f36af6b-773c-49e1-a9ff-efbd797e59f7\") " pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:55.178024 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.177918 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e36c83c0-d80b-4f03-957e-f8fa2186bc55-metrics-tls\") pod \"dns-default-fzl7v\" (UID: \"e36c83c0-d80b-4f03-957e-f8fa2186bc55\") " pod="openshift-dns/dns-default-fzl7v" Jul 09 01:38:55.178024 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.178002 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbe2870c-05fa-44fd-9172-e556eb36c121-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-smgrj\" (UID: \"bbe2870c-05fa-44fd-9172-e556eb36c121\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-smgrj" Jul 09 01:38:55.178024 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.178010 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a6b0c11-7b7c-460a-8a34-af1ac8d924a4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-ckzls\" (UID: \"9a6b0c11-7b7c-460a-8a34-af1ac8d924a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ckzls" Jul 09 01:38:55.178275 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.178002 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/99942bcc-7a4f-4495-a1fe-7ce77a613b89-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-p5xcw\" (UID: \"99942bcc-7a4f-4495-a1fe-7ce77a613b89\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p5xcw" Jul 09 01:38:55.178275 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.178002 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f36af6b-773c-49e1-a9ff-efbd797e59f7-metrics-certs\") pod \"router-default-b7cdbb4c5-nksgs\" (UID: \"7f36af6b-773c-49e1-a9ff-efbd797e59f7\") " pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:55.179527 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.179504 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-tls\") pod \"image-registry-56f4fc4775-qvb8g\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:55.189745 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.189712 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b2d6x" event={"ID":"d06ec329-9c7d-418a-b019-385ecf29cc79","Type":"ContainerStarted","Data":"b0832a6eaba5b4e78605affaf67a4a41c61052c39c5425b09cda28cabd9fde71"} Jul 09 01:38:55.189850 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.189770 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b2d6x" event={"ID":"d06ec329-9c7d-418a-b019-385ecf29cc79","Type":"ContainerStarted","Data":"e8a7bcbd624ff0c6e4b3db0c0dbee43107a84dda16713017468e929119298aea"} Jul 09 01:38:55.205700 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.205642 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-b2d6x" podStartSLOduration=65.668426647 podStartE2EDuration="1m7.205624124s" totalImagesPullingTime="1.537197477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:37:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:55.204370917 +0000 UTC m=+67.866108411" watchObservedRunningTime="2026-07-09 01:38:55.205624124 +0000 UTC m=+67.867361617" Jul 09 01:38:55.343551 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.343521 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jm8rq\"" Jul 09 01:38:55.352210 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.352179 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p5xcw" Jul 09 01:38:55.354200 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.354184 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wqnbs\"" Jul 09 01:38:55.363426 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.363300 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:55.382471 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.382446 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-x69mf\"" Jul 09 01:38:55.390433 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.390395 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:55.392336 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.392313 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-grrgr\"" Jul 09 01:38:55.401140 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.400937 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ckzls" Jul 09 01:38:55.430243 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.430204 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-l5brk\"" Jul 09 01:38:55.433055 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.433029 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-smgrj" Jul 09 01:38:55.433173 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.433111 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s9n5n\"" Jul 09 01:38:55.441294 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.441012 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fzl7v" Jul 09 01:38:55.538155 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.537210 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p5xcw"] Jul 09 01:38:55.573338 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.573201 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56f4fc4775-qvb8g"] Jul 09 01:38:55.586913 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:38:55.586883 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4543d666_8d9f_4e5a_9cd1_e1b504aca20d.slice/crio-974a1273321b14d720a9f75f4d0b9f293ca5000b9cc2d4fe17a28408298a7047 WatchSource:0}: Error finding container 974a1273321b14d720a9f75f4d0b9f293ca5000b9cc2d4fe17a28408298a7047: Status 404 returned error can't find the container with id 974a1273321b14d720a9f75f4d0b9f293ca5000b9cc2d4fe17a28408298a7047 Jul 09 01:38:55.610496 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.610429 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ckzls"] Jul 09 01:38:55.614198 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:38:55.614160 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a6b0c11_7b7c_460a_8a34_af1ac8d924a4.slice/crio-73aefdec050007520b861d1ba08eacfb1ba1d552d2ea9c0cf86c6da521268461 WatchSource:0}: Error finding container 73aefdec050007520b861d1ba08eacfb1ba1d552d2ea9c0cf86c6da521268461: Status 404 returned error can't find the container with id 73aefdec050007520b861d1ba08eacfb1ba1d552d2ea9c0cf86c6da521268461 Jul 09 01:38:55.619491 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.619451 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-b7cdbb4c5-nksgs"] Jul 09 01:38:55.624417 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:38:55.624387 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f36af6b_773c_49e1_a9ff_efbd797e59f7.slice/crio-37c258eeabe2513aba00a0e983038d616f662ad78cf32690fa38d70adff257d0 WatchSource:0}: Error finding container 37c258eeabe2513aba00a0e983038d616f662ad78cf32690fa38d70adff257d0: Status 404 returned error can't find the container with id 37c258eeabe2513aba00a0e983038d616f662ad78cf32690fa38d70adff257d0 Jul 09 01:38:55.632973 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.632952 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-smgrj"] Jul 09 01:38:55.637272 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:38:55.637227 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbe2870c_05fa_44fd_9172_e556eb36c121.slice/crio-58bee78efe4f977d8c2eabb3d27602fbcf44551a0eb60160b915b053dc47f1b5 WatchSource:0}: Error finding container 58bee78efe4f977d8c2eabb3d27602fbcf44551a0eb60160b915b053dc47f1b5: Status 404 returned error can't find the container with id 58bee78efe4f977d8c2eabb3d27602fbcf44551a0eb60160b915b053dc47f1b5 Jul 09 01:38:55.656882 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:55.656822 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fzl7v"] Jul 09 01:38:55.660301 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:38:55.660275 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode36c83c0_d80b_4f03_957e_f8fa2186bc55.slice/crio-94f151b073064da5b36d8383b3f662874ac74ac5168c8b8aeff90ead53014981 WatchSource:0}: Error finding container 94f151b073064da5b36d8383b3f662874ac74ac5168c8b8aeff90ead53014981: Status 404 returned error can't find the container with id 94f151b073064da5b36d8383b3f662874ac74ac5168c8b8aeff90ead53014981 Jul 09 01:38:56.197920 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:56.197820 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" event={"ID":"7f36af6b-773c-49e1-a9ff-efbd797e59f7","Type":"ContainerStarted","Data":"43e453db0338270e8003048864169ccf032d43a7eee87ee625c17bff6f3a5c19"} Jul 09 01:38:56.197920 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:56.197883 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" event={"ID":"7f36af6b-773c-49e1-a9ff-efbd797e59f7","Type":"ContainerStarted","Data":"37c258eeabe2513aba00a0e983038d616f662ad78cf32690fa38d70adff257d0"} Jul 09 01:38:56.199940 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:56.199909 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fzl7v" event={"ID":"e36c83c0-d80b-4f03-957e-f8fa2186bc55","Type":"ContainerStarted","Data":"94f151b073064da5b36d8383b3f662874ac74ac5168c8b8aeff90ead53014981"} Jul 09 01:38:56.203251 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:56.203176 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-smgrj" event={"ID":"bbe2870c-05fa-44fd-9172-e556eb36c121","Type":"ContainerStarted","Data":"58bee78efe4f977d8c2eabb3d27602fbcf44551a0eb60160b915b053dc47f1b5"} Jul 09 01:38:56.204507 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:56.204477 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ckzls" event={"ID":"9a6b0c11-7b7c-460a-8a34-af1ac8d924a4","Type":"ContainerStarted","Data":"73aefdec050007520b861d1ba08eacfb1ba1d552d2ea9c0cf86c6da521268461"} Jul 09 01:38:56.206486 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:56.206461 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" event={"ID":"4543d666-8d9f-4e5a-9cd1-e1b504aca20d","Type":"ContainerStarted","Data":"f244314d2794761741b7808c442ca6029b826ab54d62881532dfdc846994a662"} Jul 09 01:38:56.206605 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:56.206516 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" event={"ID":"4543d666-8d9f-4e5a-9cd1-e1b504aca20d","Type":"ContainerStarted","Data":"974a1273321b14d720a9f75f4d0b9f293ca5000b9cc2d4fe17a28408298a7047"} Jul 09 01:38:56.206605 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:56.206546 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:38:56.207932 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:56.207868 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p5xcw" event={"ID":"99942bcc-7a4f-4495-a1fe-7ce77a613b89","Type":"ContainerStarted","Data":"1106cac22aaedd326bcfa00f731a4232e8745d46bf3342777d4ed9b49580a532"} Jul 09 01:38:56.217906 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:56.217474 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" podStartSLOduration=59.217460157 podStartE2EDuration="59.217460157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:37:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:56.216750584 +0000 UTC m=+68.878488103" watchObservedRunningTime="2026-07-09 01:38:56.217460157 +0000 UTC m=+68.879197626" Jul 09 01:38:56.236371 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:56.235729 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" podStartSLOduration=68.235712352 podStartE2EDuration="1m8.235712352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:37:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:38:56.234700614 +0000 UTC m=+68.896438107" watchObservedRunningTime="2026-07-09 01:38:56.235712352 +0000 UTC m=+68.897449845" Jul 09 01:38:56.395738 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:56.395622 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:56.398439 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:56.398408 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:57.214280 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:57.214249 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:57.215834 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:57.215782 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-b7cdbb4c5-nksgs" Jul 09 01:38:57.862454 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:38:57.862413 2564 scope.go:117] "RemoveContainer" containerID="82466025c4f4794324ab4090762726922cf57cca6756f6cd85feaa0dbc748934" Jul 09 01:39:01.231172 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.231135 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gfhk_3d8307ed-04c9-429e-a83c-7b24847e0a38/console-operator/1.log" Jul 09 01:39:01.231642 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.231270 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-7gfhk" event={"ID":"3d8307ed-04c9-429e-a83c-7b24847e0a38","Type":"ContainerStarted","Data":"8c001526915fd9b873cd2415f0b64cf2969b6bf5f9ce875dde4fcd23b33cbe64"} Jul 09 01:39:01.231899 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.231878 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-7gfhk" Jul 09 01:39:01.233609 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.233584 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fzl7v" event={"ID":"e36c83c0-d80b-4f03-957e-f8fa2186bc55","Type":"ContainerStarted","Data":"a7437e3543692f70de6f4cad14fd7c0a2be60ae42ccf176528b9e4c93d4d5998"} Jul 09 01:39:01.233691 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.233627 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fzl7v" event={"ID":"e36c83c0-d80b-4f03-957e-f8fa2186bc55","Type":"ContainerStarted","Data":"4d8b491f3b6bf9054a03116bedefdb2881dff18d42a4431f752416597bac9c13"} Jul 09 01:39:01.234015 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.233953 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fzl7v" Jul 09 01:39:01.236361 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.236091 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-smgrj" event={"ID":"bbe2870c-05fa-44fd-9172-e556eb36c121","Type":"ContainerStarted","Data":"5349fbdd47169318c0f213d9e44efd841a3cdabf3b23fb9b29b10c435a12c042"} Jul 09 01:39:01.238345 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.238271 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ckzls" event={"ID":"9a6b0c11-7b7c-460a-8a34-af1ac8d924a4","Type":"ContainerStarted","Data":"5bbe20b2192c50635adb8b1e64da07ae071e716d5381135720f9d32547ce78b1"} Jul 09 01:39:01.240700 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.240300 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6g7sx" event={"ID":"eef45e59-8530-47b9-bdab-917bec4c3c42","Type":"ContainerStarted","Data":"c8cf9d95703052a6258fcad9272762340b012f1c526defa24330ed6c4957b5d4"} Jul 09 01:39:01.243161 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.242863 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p5xcw" event={"ID":"99942bcc-7a4f-4495-a1fe-7ce77a613b89","Type":"ContainerStarted","Data":"dc79f0c74ffd3aac5fb98de4de0273ba35a3cffaa76a98b39d4f2bed3c32acdd"} Jul 09 01:39:01.243161 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.242908 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p5xcw" event={"ID":"99942bcc-7a4f-4495-a1fe-7ce77a613b89","Type":"ContainerStarted","Data":"a49083aecc553edb034ec0d9ac9c963ce078d01d6c09fb0afd1fd6ed6b7f4201"} Jul 09 01:39:01.249071 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.248904 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-7gfhk" podStartSLOduration=54.028496539 podStartE2EDuration="1m3.248887822s" totalImagesPullingTime="9.220391283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:37:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:01.248222977 +0000 UTC m=+73.909960473" watchObservedRunningTime="2026-07-09 01:39:01.248887822 +0000 UTC m=+73.910625312" Jul 09 01:39:01.270964 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.270907 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-smgrj" podStartSLOduration=47.054668458 podStartE2EDuration="52.270888479s" totalImagesPullingTime="5.216220021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:38:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:01.26956277 +0000 UTC m=+73.931300289" watchObservedRunningTime="2026-07-09 01:39:01.270888479 +0000 UTC m=+73.932625976" Jul 09 01:39:01.296006 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.295930 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fzl7v" podStartSLOduration=33.102699659 podStartE2EDuration="38.295908495s" totalImagesPullingTime="5.193208836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:38:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:01.294661791 +0000 UTC m=+73.956399284" watchObservedRunningTime="2026-07-09 01:39:01.295908495 +0000 UTC m=+73.957645979" Jul 09 01:39:01.322817 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.322754 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p5xcw" podStartSLOduration=59.079211906 podStartE2EDuration="1m4.322734874s" totalImagesPullingTime="5.243522968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:37:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:01.321864075 +0000 UTC m=+73.983601590" watchObservedRunningTime="2026-07-09 01:39:01.322734874 +0000 UTC m=+73.984472366" Jul 09 01:39:01.339419 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.339359 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6g7sx" podStartSLOduration=65.310839226 podStartE2EDuration="1m13.33933638s" totalImagesPullingTime="8.028497154s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:37:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:01.338142017 +0000 UTC m=+73.999879510" watchObservedRunningTime="2026-07-09 01:39:01.33933638 +0000 UTC m=+74.001073877" Jul 09 01:39:01.357203 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.357154 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ckzls" podStartSLOduration=58.11480813 podStartE2EDuration="1m3.357136577s" totalImagesPullingTime="5.242328447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:37:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:01.355947885 +0000 UTC m=+74.017685376" watchObservedRunningTime="2026-07-09 01:39:01.357136577 +0000 UTC m=+74.018874068" Jul 09 01:39:01.526021 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.525988 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pl6sj"] Jul 09 01:39:01.546559 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.546527 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pl6sj"] Jul 09 01:39:01.546800 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.546631 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pl6sj" Jul 09 01:39:01.548193 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.548163 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-7gfhk" Jul 09 01:39:01.549077 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.549053 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 09 01:39:01.549268 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.549251 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-bwrcx\"" Jul 09 01:39:01.633791 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.633699 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/991948ab-37ab-4725-85f9-b7f43531d4c3-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-pl6sj\" (UID: \"991948ab-37ab-4725-85f9-b7f43531d4c3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pl6sj" Jul 09 01:39:01.734066 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.734022 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/991948ab-37ab-4725-85f9-b7f43531d4c3-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-pl6sj\" (UID: \"991948ab-37ab-4725-85f9-b7f43531d4c3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pl6sj" Jul 09 01:39:01.734267 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:39:01.734161 2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 09 01:39:01.734267 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:39:01.734226 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/991948ab-37ab-4725-85f9-b7f43531d4c3-tls-certificates podName:991948ab-37ab-4725-85f9-b7f43531d4c3 nodeName:}" failed. No retries permitted until 2026-07-09 01:39:02.23420847 +0000 UTC m=+74.895945940 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/991948ab-37ab-4725-85f9-b7f43531d4c3-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-pl6sj" (UID: "991948ab-37ab-4725-85f9-b7f43531d4c3") : secret "prometheus-operator-admission-webhook-tls" not found Jul 09 01:39:01.743584 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.743554 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-t26wx"] Jul 09 01:39:01.763320 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.763286 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-t26wx"] Jul 09 01:39:01.763448 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.763348 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-t26wx" Jul 09 01:39:01.765648 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.765620 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 01:39:01.765785 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.765752 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-wtsl5\"" Jul 09 01:39:01.765785 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.765771 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 01:39:01.835277 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.835213 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvmp5\" (UniqueName: \"kubernetes.io/projected/e614a865-02c6-4419-b5b0-065bffaa7c8e-kube-api-access-bvmp5\") pod \"downloads-685bfb5f64-t26wx\" (UID: \"e614a865-02c6-4419-b5b0-065bffaa7c8e\") " pod="openshift-console/downloads-685bfb5f64-t26wx" Jul 09 01:39:01.936177 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.936071 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvmp5\" (UniqueName: \"kubernetes.io/projected/e614a865-02c6-4419-b5b0-065bffaa7c8e-kube-api-access-bvmp5\") pod \"downloads-685bfb5f64-t26wx\" (UID: \"e614a865-02c6-4419-b5b0-065bffaa7c8e\") " pod="openshift-console/downloads-685bfb5f64-t26wx" Jul 09 01:39:01.944907 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:01.944876 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvmp5\" (UniqueName: \"kubernetes.io/projected/e614a865-02c6-4419-b5b0-065bffaa7c8e-kube-api-access-bvmp5\") pod \"downloads-685bfb5f64-t26wx\" (UID: \"e614a865-02c6-4419-b5b0-065bffaa7c8e\") " pod="openshift-console/downloads-685bfb5f64-t26wx" Jul 09 01:39:02.072919 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:02.072877 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-t26wx" Jul 09 01:39:02.228751 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:02.228719 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-t26wx"] Jul 09 01:39:02.231778 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:39:02.231745 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode614a865_02c6_4419_b5b0_065bffaa7c8e.slice/crio-a9632b26d19ff5c6daf068ce62a57a0a6c61f6a119bc61e2f16072c66fd0d0f1 WatchSource:0}: Error finding container a9632b26d19ff5c6daf068ce62a57a0a6c61f6a119bc61e2f16072c66fd0d0f1: Status 404 returned error can't find the container with id a9632b26d19ff5c6daf068ce62a57a0a6c61f6a119bc61e2f16072c66fd0d0f1 Jul 09 01:39:02.239065 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:02.239040 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/991948ab-37ab-4725-85f9-b7f43531d4c3-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-pl6sj\" (UID: \"991948ab-37ab-4725-85f9-b7f43531d4c3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pl6sj" Jul 09 01:39:02.241508 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:02.241486 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/991948ab-37ab-4725-85f9-b7f43531d4c3-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-pl6sj\" (UID: \"991948ab-37ab-4725-85f9-b7f43531d4c3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pl6sj" Jul 09 01:39:02.252084 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:02.252037 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-t26wx" event={"ID":"e614a865-02c6-4419-b5b0-065bffaa7c8e","Type":"ContainerStarted","Data":"a9632b26d19ff5c6daf068ce62a57a0a6c61f6a119bc61e2f16072c66fd0d0f1"} Jul 09 01:39:02.456763 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:02.456721 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pl6sj" Jul 09 01:39:02.617705 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:02.617666 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pl6sj"] Jul 09 01:39:02.620859 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:39:02.620826 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod991948ab_37ab_4725_85f9_b7f43531d4c3.slice/crio-e8701d16c1752fbcc8a2a4ef09ec3089af5b93a66d80ffb8dd8bf9c3ae6b0da4 WatchSource:0}: Error finding container e8701d16c1752fbcc8a2a4ef09ec3089af5b93a66d80ffb8dd8bf9c3ae6b0da4: Status 404 returned error can't find the container with id e8701d16c1752fbcc8a2a4ef09ec3089af5b93a66d80ffb8dd8bf9c3ae6b0da4 Jul 09 01:39:03.259634 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:03.259589 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pl6sj" event={"ID":"991948ab-37ab-4725-85f9-b7f43531d4c3","Type":"ContainerStarted","Data":"e8701d16c1752fbcc8a2a4ef09ec3089af5b93a66d80ffb8dd8bf9c3ae6b0da4"} Jul 09 01:39:05.270213 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:05.270178 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pl6sj" event={"ID":"991948ab-37ab-4725-85f9-b7f43531d4c3","Type":"ContainerStarted","Data":"3702b2487541ca86aad0a968439c9f09cd714f84aa1b1f4f539fa50d8a1d91e4"} Jul 09 01:39:05.285341 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:05.285285 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pl6sj" podStartSLOduration=2.668067044 podStartE2EDuration="4.28526362s" totalImagesPullingTime="1.617196576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:05.283784602 +0000 UTC m=+77.945522117" watchObservedRunningTime="2026-07-09 01:39:05.28526362 +0000 UTC m=+77.947001114" Jul 09 01:39:06.274697 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:06.274663 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pl6sj" Jul 09 01:39:06.280254 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:06.280203 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pl6sj" Jul 09 01:39:06.777122 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:06.777084 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abfdb912-0143-469c-87e1-53fed7b4c2fd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mr7jk\" (UID: \"abfdb912-0143-469c-87e1-53fed7b4c2fd\") " pod="openshift-insights/insights-runtime-extractor-mr7jk" Jul 09 01:39:06.779696 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:06.779668 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/abfdb912-0143-469c-87e1-53fed7b4c2fd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mr7jk\" (UID: \"abfdb912-0143-469c-87e1-53fed7b4c2fd\") " pod="openshift-insights/insights-runtime-extractor-mr7jk" Jul 09 01:39:06.998644 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:06.998613 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4v722\"" Jul 09 01:39:07.007412 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:07.007384 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mr7jk" Jul 09 01:39:07.179485 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:07.179465 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mr7jk"] Jul 09 01:39:07.193399 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:39:07.193372 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabfdb912_0143_469c_87e1_53fed7b4c2fd.slice/crio-6c13204a3308cda0bda04ec28cca1e25417bdd26813f85defe7d78994f983021 WatchSource:0}: Error finding container 6c13204a3308cda0bda04ec28cca1e25417bdd26813f85defe7d78994f983021: Status 404 returned error can't find the container with id 6c13204a3308cda0bda04ec28cca1e25417bdd26813f85defe7d78994f983021 Jul 09 01:39:07.285816 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:07.285776 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mr7jk" event={"ID":"abfdb912-0143-469c-87e1-53fed7b4c2fd","Type":"ContainerStarted","Data":"6c13204a3308cda0bda04ec28cca1e25417bdd26813f85defe7d78994f983021"} Jul 09 01:39:11.255338 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:11.255200 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fzl7v" Jul 09 01:39:12.313817 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:12.313775 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mr7jk" event={"ID":"abfdb912-0143-469c-87e1-53fed7b4c2fd","Type":"ContainerStarted","Data":"09a309610dceb18dc1deaf99005ddc4ac3c026fbf119510d8b1a5e5558099c86"} Jul 09 01:39:13.321658 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:13.321621 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mr7jk" event={"ID":"abfdb912-0143-469c-87e1-53fed7b4c2fd","Type":"ContainerStarted","Data":"c6f20c5afd16958fccc67a49295d70f45e1f08b0467dd094c6e2a963202779a3"} Jul 09 01:39:13.975967 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:13.975930 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pj4pr"] Jul 09 01:39:13.979652 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:13.979582 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pj4pr" Jul 09 01:39:13.982306 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:13.982282 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 01:39:13.982442 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:13.982351 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mb84g\"" Jul 09 01:39:13.982627 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:13.982595 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 01:39:13.982990 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:13.982968 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 01:39:13.983269 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:13.983213 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 01:39:14.040676 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:14.040637 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7eb4bb6e-d678-4de9-b462-d52551ae0756-root\") pod \"node-exporter-pj4pr\" (UID: \"7eb4bb6e-d678-4de9-b462-d52551ae0756\") " pod="openshift-monitoring/node-exporter-pj4pr" Jul 09 01:39:14.040849 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:14.040691 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7eb4bb6e-d678-4de9-b462-d52551ae0756-sys\") pod \"node-exporter-pj4pr\" (UID: \"7eb4bb6e-d678-4de9-b462-d52551ae0756\") " pod="openshift-monitoring/node-exporter-pj4pr" Jul 09 01:39:14.040849 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:14.040720 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7eb4bb6e-d678-4de9-b462-d52551ae0756-node-exporter-textfile\") pod \"node-exporter-pj4pr\" (UID: \"7eb4bb6e-d678-4de9-b462-d52551ae0756\") " pod="openshift-monitoring/node-exporter-pj4pr" Jul 09 01:39:14.040849 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:14.040756 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7eb4bb6e-d678-4de9-b462-d52551ae0756-node-exporter-accelerators-collector-config\") pod \"node-exporter-pj4pr\" (UID: \"7eb4bb6e-d678-4de9-b462-d52551ae0756\") " pod="openshift-monitoring/node-exporter-pj4pr" Jul 09 01:39:14.040849 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:14.040783 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7eb4bb6e-d678-4de9-b462-d52551ae0756-node-exporter-tls\") pod \"node-exporter-pj4pr\" (UID: \"7eb4bb6e-d678-4de9-b462-d52551ae0756\") " pod="openshift-monitoring/node-exporter-pj4pr" Jul 09 01:39:14.040849 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:14.040804 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7eb4bb6e-d678-4de9-b462-d52551ae0756-node-exporter-wtmp\") pod \"node-exporter-pj4pr\" (UID: \"7eb4bb6e-d678-4de9-b462-d52551ae0756\") " pod="openshift-monitoring/node-exporter-pj4pr" Jul 09 01:39:14.041098 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:14.040913 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zcs6\" (UniqueName: \"kubernetes.io/projected/7eb4bb6e-d678-4de9-b462-d52551ae0756-kube-api-access-4zcs6\") pod \"node-exporter-pj4pr\" (UID: \"7eb4bb6e-d678-4de9-b462-d52551ae0756\") " pod="openshift-monitoring/node-exporter-pj4pr" Jul 09 01:39:14.041098 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:14.040953 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7eb4bb6e-d678-4de9-b462-d52551ae0756-metrics-client-ca\") pod \"node-exporter-pj4pr\" (UID: \"7eb4bb6e-d678-4de9-b462-d52551ae0756\") " pod="openshift-monitoring/node-exporter-pj4pr" Jul 09 01:39:14.041098 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:14.040991 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7eb4bb6e-d678-4de9-b462-d52551ae0756-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pj4pr\" (UID: \"7eb4bb6e-d678-4de9-b462-d52551ae0756\") " pod="openshift-monitoring/node-exporter-pj4pr" Jul 09 01:39:14.141979 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:14.141944 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7eb4bb6e-d678-4de9-b462-d52551ae0756-node-exporter-accelerators-collector-config\") pod \"node-exporter-pj4pr\" (UID: \"7eb4bb6e-d678-4de9-b462-d52551ae0756\") " pod="openshift-monitoring/node-exporter-pj4pr" Jul 09 01:39:14.142173 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:14.141993 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7eb4bb6e-d678-4de9-b462-d52551ae0756-node-exporter-tls\") pod \"node-exporter-pj4pr\" (UID: \"7eb4bb6e-d678-4de9-b462-d52551ae0756\") " pod="openshift-monitoring/node-exporter-pj4pr" Jul 09 01:39:14.142173 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:14.142011 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7eb4bb6e-d678-4de9-b462-d52551ae0756-node-exporter-wtmp\") pod \"node-exporter-pj4pr\" (UID: \"7eb4bb6e-d678-4de9-b462-d52551ae0756\") " pod="openshift-monitoring/node-exporter-pj4pr" Jul 09 01:39:14.142173 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:14.142044 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zcs6\" (UniqueName: \"kubernetes.io/projected/7eb4bb6e-d678-4de9-b462-d52551ae0756-kube-api-access-4zcs6\") pod \"node-exporter-pj4pr\" (UID: \"7eb4bb6e-d678-4de9-b462-d52551ae0756\") " pod="openshift-monitoring/node-exporter-pj4pr" Jul 09 01:39:14.142173 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:14.142073 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7eb4bb6e-d678-4de9-b462-d52551ae0756-metrics-client-ca\") pod \"node-exporter-pj4pr\" (UID: \"7eb4bb6e-d678-4de9-b462-d52551ae0756\") " pod="openshift-monitoring/node-exporter-pj4pr" Jul 09 01:39:14.142173 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:14.142102 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7eb4bb6e-d678-4de9-b462-d52551ae0756-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pj4pr\" (UID: \"7eb4bb6e-d678-4de9-b462-d52551ae0756\") " pod="openshift-monitoring/node-exporter-pj4pr" Jul 09 01:39:14.142173 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:14.142158 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7eb4bb6e-d678-4de9-b462-d52551ae0756-root\") pod \"node-exporter-pj4pr\" (UID: \"7eb4bb6e-d678-4de9-b462-d52551ae0756\") " pod="openshift-monitoring/node-exporter-pj4pr" Jul 09 01:39:14.142514 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:14.142189 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7eb4bb6e-d678-4de9-b462-d52551ae0756-sys\") pod \"node-exporter-pj4pr\" (UID: \"7eb4bb6e-d678-4de9-b462-d52551ae0756\") " pod="openshift-monitoring/node-exporter-pj4pr" Jul 09 01:39:14.142514 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:14.142213 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7eb4bb6e-d678-4de9-b462-d52551ae0756-node-exporter-textfile\") pod \"node-exporter-pj4pr\" (UID: \"7eb4bb6e-d678-4de9-b462-d52551ae0756\") " pod="openshift-monitoring/node-exporter-pj4pr" Jul 09 01:39:14.142514 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:14.142224 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7eb4bb6e-d678-4de9-b462-d52551ae0756-node-exporter-wtmp\") pod \"node-exporter-pj4pr\" (UID: \"7eb4bb6e-d678-4de9-b462-d52551ae0756\") " pod="openshift-monitoring/node-exporter-pj4pr" Jul 09 01:39:14.142514 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:14.142472 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7eb4bb6e-d678-4de9-b462-d52551ae0756-root\") pod \"node-exporter-pj4pr\" (UID: \"7eb4bb6e-d678-4de9-b462-d52551ae0756\") " pod="openshift-monitoring/node-exporter-pj4pr" Jul 09 01:39:14.142715 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:14.142530 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7eb4bb6e-d678-4de9-b462-d52551ae0756-node-exporter-textfile\") pod \"node-exporter-pj4pr\" (UID: \"7eb4bb6e-d678-4de9-b462-d52551ae0756\") " pod="openshift-monitoring/node-exporter-pj4pr" Jul 09 01:39:14.142715 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:14.142543 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7eb4bb6e-d678-4de9-b462-d52551ae0756-sys\") pod \"node-exporter-pj4pr\" (UID: \"7eb4bb6e-d678-4de9-b462-d52551ae0756\") " pod="openshift-monitoring/node-exporter-pj4pr" Jul 09 01:39:14.142715 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:14.142689 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7eb4bb6e-d678-4de9-b462-d52551ae0756-node-exporter-accelerators-collector-config\") pod \"node-exporter-pj4pr\" (UID: \"7eb4bb6e-d678-4de9-b462-d52551ae0756\") " pod="openshift-monitoring/node-exporter-pj4pr" Jul 09 01:39:14.143008 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:14.142982 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7eb4bb6e-d678-4de9-b462-d52551ae0756-metrics-client-ca\") pod \"node-exporter-pj4pr\" (UID: \"7eb4bb6e-d678-4de9-b462-d52551ae0756\") " pod="openshift-monitoring/node-exporter-pj4pr" Jul 09 01:39:14.144788 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:14.144767 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7eb4bb6e-d678-4de9-b462-d52551ae0756-node-exporter-tls\") pod \"node-exporter-pj4pr\" (UID: \"7eb4bb6e-d678-4de9-b462-d52551ae0756\") " pod="openshift-monitoring/node-exporter-pj4pr" Jul 09 01:39:14.145037 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:14.145018 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7eb4bb6e-d678-4de9-b462-d52551ae0756-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pj4pr\" (UID: \"7eb4bb6e-d678-4de9-b462-d52551ae0756\") " pod="openshift-monitoring/node-exporter-pj4pr" Jul 09 01:39:14.150172 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:14.150146 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zcs6\" (UniqueName: \"kubernetes.io/projected/7eb4bb6e-d678-4de9-b462-d52551ae0756-kube-api-access-4zcs6\") pod \"node-exporter-pj4pr\" (UID: \"7eb4bb6e-d678-4de9-b462-d52551ae0756\") " pod="openshift-monitoring/node-exporter-pj4pr" Jul 09 01:39:14.291256 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:14.291161 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pj4pr" Jul 09 01:39:17.218765 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:17.218737 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:39:21.969409 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:21.969372 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56f4fc4775-qvb8g"] Jul 09 01:39:22.505978 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:39:22.505948 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eb4bb6e_d678_4de9_b462_d52551ae0756.slice/crio-d2d2494ded0fa9126f6ff13a92408328cb9b3b5c02fcafa063bf7a7bf870a081 WatchSource:0}: Error finding container d2d2494ded0fa9126f6ff13a92408328cb9b3b5c02fcafa063bf7a7bf870a081: Status 404 returned error can't find the container with id d2d2494ded0fa9126f6ff13a92408328cb9b3b5c02fcafa063bf7a7bf870a081 Jul 09 01:39:22.661497 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.661464 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8497f8d558-pzhph"] Jul 09 01:39:22.664010 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.663993 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8497f8d558-pzhph" Jul 09 01:39:22.666944 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.666918 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 01:39:22.670965 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.667157 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 01:39:22.671132 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.667210 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 01:39:22.671268 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.667277 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9x9t2\"" Jul 09 01:39:22.671347 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.668870 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 01:39:22.671347 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.669372 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 01:39:22.673173 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.673151 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 01:39:22.674866 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.674843 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8497f8d558-pzhph"] Jul 09 01:39:22.720703 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.720672 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9544219a-dc72-4be9-8973-a699c6ae0c21-oauth-serving-cert\") pod \"console-8497f8d558-pzhph\" (UID: \"9544219a-dc72-4be9-8973-a699c6ae0c21\") " pod="openshift-console/console-8497f8d558-pzhph" Jul 09 01:39:22.720892 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.720720 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9544219a-dc72-4be9-8973-a699c6ae0c21-trusted-ca-bundle\") pod \"console-8497f8d558-pzhph\" (UID: \"9544219a-dc72-4be9-8973-a699c6ae0c21\") " pod="openshift-console/console-8497f8d558-pzhph" Jul 09 01:39:22.720892 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.720749 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9544219a-dc72-4be9-8973-a699c6ae0c21-console-config\") pod \"console-8497f8d558-pzhph\" (UID: \"9544219a-dc72-4be9-8973-a699c6ae0c21\") " pod="openshift-console/console-8497f8d558-pzhph" Jul 09 01:39:22.720892 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.720807 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9544219a-dc72-4be9-8973-a699c6ae0c21-console-serving-cert\") pod \"console-8497f8d558-pzhph\" (UID: \"9544219a-dc72-4be9-8973-a699c6ae0c21\") " pod="openshift-console/console-8497f8d558-pzhph" Jul 09 01:39:22.720892 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.720829 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fb67\" (UniqueName: \"kubernetes.io/projected/9544219a-dc72-4be9-8973-a699c6ae0c21-kube-api-access-8fb67\") pod \"console-8497f8d558-pzhph\" (UID: \"9544219a-dc72-4be9-8973-a699c6ae0c21\") " pod="openshift-console/console-8497f8d558-pzhph" Jul 09 01:39:22.720892 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.720879 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9544219a-dc72-4be9-8973-a699c6ae0c21-console-oauth-config\") pod \"console-8497f8d558-pzhph\" (UID: \"9544219a-dc72-4be9-8973-a699c6ae0c21\") " pod="openshift-console/console-8497f8d558-pzhph" Jul 09 01:39:22.721127 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.720916 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9544219a-dc72-4be9-8973-a699c6ae0c21-service-ca\") pod \"console-8497f8d558-pzhph\" (UID: \"9544219a-dc72-4be9-8973-a699c6ae0c21\") " pod="openshift-console/console-8497f8d558-pzhph" Jul 09 01:39:22.821973 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.821897 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9544219a-dc72-4be9-8973-a699c6ae0c21-console-serving-cert\") pod \"console-8497f8d558-pzhph\" (UID: \"9544219a-dc72-4be9-8973-a699c6ae0c21\") " pod="openshift-console/console-8497f8d558-pzhph" Jul 09 01:39:22.821973 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.821935 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fb67\" (UniqueName: \"kubernetes.io/projected/9544219a-dc72-4be9-8973-a699c6ae0c21-kube-api-access-8fb67\") pod \"console-8497f8d558-pzhph\" (UID: \"9544219a-dc72-4be9-8973-a699c6ae0c21\") " pod="openshift-console/console-8497f8d558-pzhph" Jul 09 01:39:22.822150 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.821992 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9544219a-dc72-4be9-8973-a699c6ae0c21-console-oauth-config\") pod \"console-8497f8d558-pzhph\" (UID: \"9544219a-dc72-4be9-8973-a699c6ae0c21\") " pod="openshift-console/console-8497f8d558-pzhph" Jul 09 01:39:22.822150 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.822032 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9544219a-dc72-4be9-8973-a699c6ae0c21-service-ca\") pod \"console-8497f8d558-pzhph\" (UID: \"9544219a-dc72-4be9-8973-a699c6ae0c21\") " pod="openshift-console/console-8497f8d558-pzhph" Jul 09 01:39:22.822150 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.822070 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9544219a-dc72-4be9-8973-a699c6ae0c21-oauth-serving-cert\") pod \"console-8497f8d558-pzhph\" (UID: \"9544219a-dc72-4be9-8973-a699c6ae0c21\") " pod="openshift-console/console-8497f8d558-pzhph" Jul 09 01:39:22.822150 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.822100 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9544219a-dc72-4be9-8973-a699c6ae0c21-trusted-ca-bundle\") pod \"console-8497f8d558-pzhph\" (UID: \"9544219a-dc72-4be9-8973-a699c6ae0c21\") " pod="openshift-console/console-8497f8d558-pzhph" Jul 09 01:39:22.822150 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.822127 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9544219a-dc72-4be9-8973-a699c6ae0c21-console-config\") pod \"console-8497f8d558-pzhph\" (UID: \"9544219a-dc72-4be9-8973-a699c6ae0c21\") " pod="openshift-console/console-8497f8d558-pzhph" Jul 09 01:39:22.823055 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.823027 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9544219a-dc72-4be9-8973-a699c6ae0c21-console-config\") pod \"console-8497f8d558-pzhph\" (UID: \"9544219a-dc72-4be9-8973-a699c6ae0c21\") " pod="openshift-console/console-8497f8d558-pzhph" Jul 09 01:39:22.823306 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.823057 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9544219a-dc72-4be9-8973-a699c6ae0c21-oauth-serving-cert\") pod \"console-8497f8d558-pzhph\" (UID: \"9544219a-dc72-4be9-8973-a699c6ae0c21\") " pod="openshift-console/console-8497f8d558-pzhph" Jul 09 01:39:22.823306 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.823186 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9544219a-dc72-4be9-8973-a699c6ae0c21-service-ca\") pod \"console-8497f8d558-pzhph\" (UID: \"9544219a-dc72-4be9-8973-a699c6ae0c21\") " pod="openshift-console/console-8497f8d558-pzhph" Jul 09 01:39:22.823482 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.823379 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9544219a-dc72-4be9-8973-a699c6ae0c21-trusted-ca-bundle\") pod \"console-8497f8d558-pzhph\" (UID: \"9544219a-dc72-4be9-8973-a699c6ae0c21\") " pod="openshift-console/console-8497f8d558-pzhph" Jul 09 01:39:22.825366 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.825338 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9544219a-dc72-4be9-8973-a699c6ae0c21-console-oauth-config\") pod \"console-8497f8d558-pzhph\" (UID: \"9544219a-dc72-4be9-8973-a699c6ae0c21\") " pod="openshift-console/console-8497f8d558-pzhph" Jul 09 01:39:22.825475 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.825423 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9544219a-dc72-4be9-8973-a699c6ae0c21-console-serving-cert\") pod \"console-8497f8d558-pzhph\" (UID: \"9544219a-dc72-4be9-8973-a699c6ae0c21\") " pod="openshift-console/console-8497f8d558-pzhph" Jul 09 01:39:22.830090 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.830063 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fb67\" (UniqueName: \"kubernetes.io/projected/9544219a-dc72-4be9-8973-a699c6ae0c21-kube-api-access-8fb67\") pod \"console-8497f8d558-pzhph\" (UID: \"9544219a-dc72-4be9-8973-a699c6ae0c21\") " pod="openshift-console/console-8497f8d558-pzhph" Jul 09 01:39:22.980768 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:22.980626 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8497f8d558-pzhph" Jul 09 01:39:23.154023 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:23.153767 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8497f8d558-pzhph"] Jul 09 01:39:23.157111 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:39:23.157072 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9544219a_dc72_4be9_8973_a699c6ae0c21.slice/crio-d6032b14fc991ee1b313660b01c5c87ee1fc6cba17823ad92a49e4529ca675ef WatchSource:0}: Error finding container d6032b14fc991ee1b313660b01c5c87ee1fc6cba17823ad92a49e4529ca675ef: Status 404 returned error can't find the container with id d6032b14fc991ee1b313660b01c5c87ee1fc6cba17823ad92a49e4529ca675ef Jul 09 01:39:23.365141 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:23.365028 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pj4pr" event={"ID":"7eb4bb6e-d678-4de9-b462-d52551ae0756","Type":"ContainerStarted","Data":"d2d2494ded0fa9126f6ff13a92408328cb9b3b5c02fcafa063bf7a7bf870a081"} Jul 09 01:39:23.368397 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:23.368327 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mr7jk" event={"ID":"abfdb912-0143-469c-87e1-53fed7b4c2fd","Type":"ContainerStarted","Data":"d3db59513014352b2ec6c1b264edbc8789d36863f493d567c622689d5632205d"} Jul 09 01:39:23.370830 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:23.370805 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-t26wx" event={"ID":"e614a865-02c6-4419-b5b0-065bffaa7c8e","Type":"ContainerStarted","Data":"59173da376a7272fe10ea5e12b7943b1e8c46a9050dd8bad047fc354ef8f848d"} Jul 09 01:39:23.371090 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:23.371066 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-t26wx" Jul 09 01:39:23.372965 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:23.372935 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8497f8d558-pzhph" event={"ID":"9544219a-dc72-4be9-8973-a699c6ae0c21","Type":"ContainerStarted","Data":"d6032b14fc991ee1b313660b01c5c87ee1fc6cba17823ad92a49e4529ca675ef"} Jul 09 01:39:23.383333 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:23.383311 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-t26wx" Jul 09 01:39:23.387771 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:23.387637 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mr7jk" podStartSLOduration=34.230594463 podStartE2EDuration="49.387617037s" totalImagesPullingTime="15.157022574s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:38:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:23.386118754 +0000 UTC m=+96.047856252" watchObservedRunningTime="2026-07-09 01:39:23.387617037 +0000 UTC m=+96.049354529" Jul 09 01:39:24.188149 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:24.187471 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-22lm4" Jul 09 01:39:24.204088 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:24.202406 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-t26wx" podStartSLOduration=2.882654279 podStartE2EDuration="23.202381266s" totalImagesPullingTime="20.319726987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:23.40379305 +0000 UTC m=+96.065530544" watchObservedRunningTime="2026-07-09 01:39:24.202381266 +0000 UTC m=+96.864118761" Jul 09 01:39:24.379698 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:24.379648 2564 generic.go:356] "Generic (PLEG): container finished" podID="7eb4bb6e-d678-4de9-b462-d52551ae0756" containerID="d308d2e9cd0dfc941db7d03dc974425c221f2a44831fde25345309851adeeb83" exitCode=0 Jul 09 01:39:24.379890 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:24.379744 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pj4pr" event={"ID":"7eb4bb6e-d678-4de9-b462-d52551ae0756","Type":"ContainerDied","Data":"d308d2e9cd0dfc941db7d03dc974425c221f2a44831fde25345309851adeeb83"} Jul 09 01:39:25.390318 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:25.390265 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pj4pr" event={"ID":"7eb4bb6e-d678-4de9-b462-d52551ae0756","Type":"ContainerStarted","Data":"ecab2c7df96e70a7f33ccabfddc2510d30aea5bb4d9bf15370f8f67cd80c3257"} Jul 09 01:39:25.390765 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:25.390371 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pj4pr" event={"ID":"7eb4bb6e-d678-4de9-b462-d52551ae0756","Type":"ContainerStarted","Data":"036a72c62a15b4e1f98318270a0b514170e0e2fdc63ee1a5632f5cf2601207c4"} Jul 09 01:39:25.417861 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:25.417809 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pj4pr" podStartSLOduration=11.287579363 podStartE2EDuration="12.417790957s" totalImagesPullingTime="1.021750666s" totalInitContainerRuntime="108.460928ms" isStatefulPod=true podCreationTimestamp="2026-07-09 01:39:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:25.415566945 +0000 UTC m=+98.077304460" watchObservedRunningTime="2026-07-09 01:39:25.417790957 +0000 UTC m=+98.079528449" Jul 09 01:39:28.408495 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:28.408442 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8497f8d558-pzhph" event={"ID":"9544219a-dc72-4be9-8973-a699c6ae0c21","Type":"ContainerStarted","Data":"12c47e652290718e5a24c85ee6c270483370ae8d7257aa0e06932bb11bcbde2b"} Jul 09 01:39:28.427061 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:28.427006 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8497f8d558-pzhph" podStartSLOduration=1.969496854 podStartE2EDuration="6.426989831s" totalImagesPullingTime="4.457492977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:39:28.425938284 +0000 UTC m=+101.087675780" watchObservedRunningTime="2026-07-09 01:39:28.426989831 +0000 UTC m=+101.088727326" Jul 09 01:39:29.411972 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:29.411924 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8497f8d558-pzhph"] Jul 09 01:39:32.981287 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:32.981250 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8497f8d558-pzhph" Jul 09 01:39:46.992808 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:46.992749 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" podUID="4543d666-8d9f-4e5a-9cd1-e1b504aca20d" containerName="registry" containerID="cri-o://f244314d2794761741b7808c442ca6029b826ab54d62881532dfdc846994a662" gracePeriod=30 Jul 09 01:39:47.268888 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.268830 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:39:47.332490 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.332458 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-certificates\") pod \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " Jul 09 01:39:47.332674 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.332506 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-image-registry-private-configuration\") pod \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " Jul 09 01:39:47.332674 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.332532 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-ca-trust-extracted\") pod \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " Jul 09 01:39:47.332674 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.332566 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-installation-pull-secrets\") pod \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " Jul 09 01:39:47.332674 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.332598 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-trusted-ca\") pod \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " Jul 09 01:39:47.332674 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.332616 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvw7w\" (UniqueName: \"kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-kube-api-access-tvw7w\") pod \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " Jul 09 01:39:47.332674 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.332663 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-tls\") pod \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " Jul 09 01:39:47.332979 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.332690 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-bound-sa-token\") pod \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\" (UID: \"4543d666-8d9f-4e5a-9cd1-e1b504aca20d\") " Jul 09 01:39:47.332979 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.332950 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4543d666-8d9f-4e5a-9cd1-e1b504aca20d" (UID: "4543d666-8d9f-4e5a-9cd1-e1b504aca20d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 01:39:47.333517 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.333480 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4543d666-8d9f-4e5a-9cd1-e1b504aca20d" (UID: "4543d666-8d9f-4e5a-9cd1-e1b504aca20d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 01:39:47.335289 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.335255 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4543d666-8d9f-4e5a-9cd1-e1b504aca20d" (UID: "4543d666-8d9f-4e5a-9cd1-e1b504aca20d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 01:39:47.335411 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.335268 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4543d666-8d9f-4e5a-9cd1-e1b504aca20d" (UID: "4543d666-8d9f-4e5a-9cd1-e1b504aca20d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 01:39:47.335475 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.335434 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4543d666-8d9f-4e5a-9cd1-e1b504aca20d" (UID: "4543d666-8d9f-4e5a-9cd1-e1b504aca20d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 01:39:47.335475 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.335453 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4543d666-8d9f-4e5a-9cd1-e1b504aca20d" (UID: "4543d666-8d9f-4e5a-9cd1-e1b504aca20d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 01:39:47.335715 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.335694 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-kube-api-access-tvw7w" (OuterVolumeSpecName: "kube-api-access-tvw7w") pod "4543d666-8d9f-4e5a-9cd1-e1b504aca20d" (UID: "4543d666-8d9f-4e5a-9cd1-e1b504aca20d"). InnerVolumeSpecName "kube-api-access-tvw7w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 01:39:47.341147 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.341120 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4543d666-8d9f-4e5a-9cd1-e1b504aca20d" (UID: "4543d666-8d9f-4e5a-9cd1-e1b504aca20d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 01:39:47.433428 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.433393 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-image-registry-private-configuration\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:39:47.433428 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.433419 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-ca-trust-extracted\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:39:47.433428 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.433430 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-installation-pull-secrets\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:39:47.433428 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.433439 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-trusted-ca\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:39:47.433655 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.433447 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvw7w\" (UniqueName: \"kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-kube-api-access-tvw7w\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:39:47.433655 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.433456 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-tls\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:39:47.433655 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.433464 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-bound-sa-token\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:39:47.433655 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.433472 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4543d666-8d9f-4e5a-9cd1-e1b504aca20d-registry-certificates\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:39:47.479675 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.479646 2564 generic.go:356] "Generic (PLEG): container finished" podID="4543d666-8d9f-4e5a-9cd1-e1b504aca20d" containerID="f244314d2794761741b7808c442ca6029b826ab54d62881532dfdc846994a662" exitCode=0 Jul 09 01:39:47.479795 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.479689 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" Jul 09 01:39:47.479795 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.479706 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" event={"ID":"4543d666-8d9f-4e5a-9cd1-e1b504aca20d","Type":"ContainerDied","Data":"f244314d2794761741b7808c442ca6029b826ab54d62881532dfdc846994a662"} Jul 09 01:39:47.479795 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.479747 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" event={"ID":"4543d666-8d9f-4e5a-9cd1-e1b504aca20d","Type":"ContainerDied","Data":"974a1273321b14d720a9f75f4d0b9f293ca5000b9cc2d4fe17a28408298a7047"} Jul 09 01:39:47.479795 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.479769 2564 scope.go:117] "RemoveContainer" containerID="f244314d2794761741b7808c442ca6029b826ab54d62881532dfdc846994a662" Jul 09 01:39:47.487911 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.487893 2564 scope.go:117] "RemoveContainer" containerID="f244314d2794761741b7808c442ca6029b826ab54d62881532dfdc846994a662" Jul 09 01:39:47.488269 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:39:47.488225 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f244314d2794761741b7808c442ca6029b826ab54d62881532dfdc846994a662\": container with ID starting with f244314d2794761741b7808c442ca6029b826ab54d62881532dfdc846994a662 not found: ID does not exist" containerID="f244314d2794761741b7808c442ca6029b826ab54d62881532dfdc846994a662" Jul 09 01:39:47.488349 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.488277 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f244314d2794761741b7808c442ca6029b826ab54d62881532dfdc846994a662"} err="failed to get container status \"f244314d2794761741b7808c442ca6029b826ab54d62881532dfdc846994a662\": rpc error: code = NotFound desc = could not find container \"f244314d2794761741b7808c442ca6029b826ab54d62881532dfdc846994a662\": container with ID starting with f244314d2794761741b7808c442ca6029b826ab54d62881532dfdc846994a662 not found: ID does not exist" Jul 09 01:39:47.501451 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.501429 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56f4fc4775-qvb8g"] Jul 09 01:39:47.504599 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.504580 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-56f4fc4775-qvb8g"] Jul 09 01:39:47.870462 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:47.870429 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4543d666-8d9f-4e5a-9cd1-e1b504aca20d" path="/var/lib/kubelet/pods/4543d666-8d9f-4e5a-9cd1-e1b504aca20d/volumes" Jul 09 01:39:52.215389 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:52.215350 2564 patch_prober.go:28] interesting pod/image-registry-56f4fc4775-qvb8g container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.132.0.8:5000/healthz\": context deadline exceeded" start-of-body= Jul 09 01:39:52.215781 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:52.215423 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-56f4fc4775-qvb8g" podUID="4543d666-8d9f-4e5a-9cd1-e1b504aca20d" containerName="registry" probeResult="failure" output="Get \"https://10.132.0.8:5000/healthz\": context deadline exceeded" Jul 09 01:39:55.443202 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:55.443156 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8497f8d558-pzhph" podUID="9544219a-dc72-4be9-8973-a699c6ae0c21" containerName="console" containerID="cri-o://12c47e652290718e5a24c85ee6c270483370ae8d7257aa0e06932bb11bcbde2b" gracePeriod=15 Jul 09 01:39:55.753609 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:55.753584 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8497f8d558-pzhph" Jul 09 01:39:55.805156 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:55.805130 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9544219a-dc72-4be9-8973-a699c6ae0c21-console-serving-cert\") pod \"9544219a-dc72-4be9-8973-a699c6ae0c21\" (UID: \"9544219a-dc72-4be9-8973-a699c6ae0c21\") " Jul 09 01:39:55.805343 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:55.805178 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9544219a-dc72-4be9-8973-a699c6ae0c21-console-oauth-config\") pod \"9544219a-dc72-4be9-8973-a699c6ae0c21\" (UID: \"9544219a-dc72-4be9-8973-a699c6ae0c21\") " Jul 09 01:39:55.805343 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:55.805201 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9544219a-dc72-4be9-8973-a699c6ae0c21-trusted-ca-bundle\") pod \"9544219a-dc72-4be9-8973-a699c6ae0c21\" (UID: \"9544219a-dc72-4be9-8973-a699c6ae0c21\") " Jul 09 01:39:55.805343 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:55.805249 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9544219a-dc72-4be9-8973-a699c6ae0c21-console-config\") pod \"9544219a-dc72-4be9-8973-a699c6ae0c21\" (UID: \"9544219a-dc72-4be9-8973-a699c6ae0c21\") " Jul 09 01:39:55.805343 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:55.805266 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fb67\" (UniqueName: \"kubernetes.io/projected/9544219a-dc72-4be9-8973-a699c6ae0c21-kube-api-access-8fb67\") pod \"9544219a-dc72-4be9-8973-a699c6ae0c21\" (UID: \"9544219a-dc72-4be9-8973-a699c6ae0c21\") " Jul 09 01:39:55.805343 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:55.805291 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9544219a-dc72-4be9-8973-a699c6ae0c21-service-ca\") pod \"9544219a-dc72-4be9-8973-a699c6ae0c21\" (UID: \"9544219a-dc72-4be9-8973-a699c6ae0c21\") " Jul 09 01:39:55.805619 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:55.805389 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9544219a-dc72-4be9-8973-a699c6ae0c21-oauth-serving-cert\") pod \"9544219a-dc72-4be9-8973-a699c6ae0c21\" (UID: \"9544219a-dc72-4be9-8973-a699c6ae0c21\") " Jul 09 01:39:55.805752 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:55.805711 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9544219a-dc72-4be9-8973-a699c6ae0c21-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9544219a-dc72-4be9-8973-a699c6ae0c21" (UID: "9544219a-dc72-4be9-8973-a699c6ae0c21"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 01:39:55.805752 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:55.805724 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9544219a-dc72-4be9-8973-a699c6ae0c21-service-ca" (OuterVolumeSpecName: "service-ca") pod "9544219a-dc72-4be9-8973-a699c6ae0c21" (UID: "9544219a-dc72-4be9-8973-a699c6ae0c21"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 01:39:55.805752 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:55.805741 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9544219a-dc72-4be9-8973-a699c6ae0c21-console-config" (OuterVolumeSpecName: "console-config") pod "9544219a-dc72-4be9-8973-a699c6ae0c21" (UID: "9544219a-dc72-4be9-8973-a699c6ae0c21"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 01:39:55.806019 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:55.805992 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9544219a-dc72-4be9-8973-a699c6ae0c21-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9544219a-dc72-4be9-8973-a699c6ae0c21" (UID: "9544219a-dc72-4be9-8973-a699c6ae0c21"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 01:39:55.807458 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:55.807437 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9544219a-dc72-4be9-8973-a699c6ae0c21-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9544219a-dc72-4be9-8973-a699c6ae0c21" (UID: "9544219a-dc72-4be9-8973-a699c6ae0c21"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 01:39:55.807702 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:55.807683 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9544219a-dc72-4be9-8973-a699c6ae0c21-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9544219a-dc72-4be9-8973-a699c6ae0c21" (UID: "9544219a-dc72-4be9-8973-a699c6ae0c21"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 01:39:55.807776 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:55.807685 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9544219a-dc72-4be9-8973-a699c6ae0c21-kube-api-access-8fb67" (OuterVolumeSpecName: "kube-api-access-8fb67") pod "9544219a-dc72-4be9-8973-a699c6ae0c21" (UID: "9544219a-dc72-4be9-8973-a699c6ae0c21"). InnerVolumeSpecName "kube-api-access-8fb67". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 01:39:55.906133 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:55.906102 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9544219a-dc72-4be9-8973-a699c6ae0c21-console-oauth-config\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:39:55.906133 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:55.906127 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9544219a-dc72-4be9-8973-a699c6ae0c21-trusted-ca-bundle\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:39:55.906133 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:55.906136 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9544219a-dc72-4be9-8973-a699c6ae0c21-console-config\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:39:55.906348 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:55.906145 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fb67\" (UniqueName: \"kubernetes.io/projected/9544219a-dc72-4be9-8973-a699c6ae0c21-kube-api-access-8fb67\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:39:55.906348 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:55.906154 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9544219a-dc72-4be9-8973-a699c6ae0c21-service-ca\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:39:55.906348 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:55.906163 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9544219a-dc72-4be9-8973-a699c6ae0c21-oauth-serving-cert\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:39:55.906348 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:55.906171 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9544219a-dc72-4be9-8973-a699c6ae0c21-console-serving-cert\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:39:56.513299 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:56.513265 2564 generic.go:356] "Generic (PLEG): container finished" podID="9544219a-dc72-4be9-8973-a699c6ae0c21" containerID="12c47e652290718e5a24c85ee6c270483370ae8d7257aa0e06932bb11bcbde2b" exitCode=0 Jul 09 01:39:56.513717 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:56.513311 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8497f8d558-pzhph" Jul 09 01:39:56.513717 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:56.513338 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8497f8d558-pzhph" event={"ID":"9544219a-dc72-4be9-8973-a699c6ae0c21","Type":"ContainerDied","Data":"12c47e652290718e5a24c85ee6c270483370ae8d7257aa0e06932bb11bcbde2b"} Jul 09 01:39:56.513717 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:56.513378 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8497f8d558-pzhph" event={"ID":"9544219a-dc72-4be9-8973-a699c6ae0c21","Type":"ContainerDied","Data":"d6032b14fc991ee1b313660b01c5c87ee1fc6cba17823ad92a49e4529ca675ef"} Jul 09 01:39:56.513717 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:56.513398 2564 scope.go:117] "RemoveContainer" containerID="12c47e652290718e5a24c85ee6c270483370ae8d7257aa0e06932bb11bcbde2b" Jul 09 01:39:56.521482 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:56.521434 2564 scope.go:117] "RemoveContainer" containerID="12c47e652290718e5a24c85ee6c270483370ae8d7257aa0e06932bb11bcbde2b" Jul 09 01:39:56.521733 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:39:56.521709 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12c47e652290718e5a24c85ee6c270483370ae8d7257aa0e06932bb11bcbde2b\": container with ID starting with 12c47e652290718e5a24c85ee6c270483370ae8d7257aa0e06932bb11bcbde2b not found: ID does not exist" containerID="12c47e652290718e5a24c85ee6c270483370ae8d7257aa0e06932bb11bcbde2b" Jul 09 01:39:56.521791 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:56.521742 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12c47e652290718e5a24c85ee6c270483370ae8d7257aa0e06932bb11bcbde2b"} err="failed to get container status \"12c47e652290718e5a24c85ee6c270483370ae8d7257aa0e06932bb11bcbde2b\": rpc error: code = NotFound desc = could not find container \"12c47e652290718e5a24c85ee6c270483370ae8d7257aa0e06932bb11bcbde2b\": container with ID starting with 12c47e652290718e5a24c85ee6c270483370ae8d7257aa0e06932bb11bcbde2b not found: ID does not exist" Jul 09 01:39:56.529372 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:56.529345 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8497f8d558-pzhph"] Jul 09 01:39:56.533725 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:56.533704 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8497f8d558-pzhph"] Jul 09 01:39:57.865280 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:57.865229 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9544219a-dc72-4be9-8973-a699c6ae0c21" path="/var/lib/kubelet/pods/9544219a-dc72-4be9-8973-a699c6ae0c21/volumes" Jul 09 01:39:59.530538 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:59.530507 2564 generic.go:356] "Generic (PLEG): container finished" podID="18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662" containerID="c6c5efa165ddcb6c50a4e78e0407fb9073e9ae7571522496abaf29b1cbe51001" exitCode=0 Jul 09 01:39:59.530992 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:59.530581 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-h8pb8" event={"ID":"18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662","Type":"ContainerDied","Data":"c6c5efa165ddcb6c50a4e78e0407fb9073e9ae7571522496abaf29b1cbe51001"} Jul 09 01:39:59.530992 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:59.530930 2564 scope.go:117] "RemoveContainer" containerID="c6c5efa165ddcb6c50a4e78e0407fb9073e9ae7571522496abaf29b1cbe51001" Jul 09 01:39:59.532147 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:59.532123 2564 generic.go:356] "Generic (PLEG): container finished" podID="e61b2313-6b39-4068-95b6-dd2a95db5b1d" containerID="f1e9ed561e7e7517cce79fed4ad36c38bc0d84d16b6d8933bdf19e05f25a0f3c" exitCode=0 Jul 09 01:39:59.532250 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:59.532172 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-99rjb" event={"ID":"e61b2313-6b39-4068-95b6-dd2a95db5b1d","Type":"ContainerDied","Data":"f1e9ed561e7e7517cce79fed4ad36c38bc0d84d16b6d8933bdf19e05f25a0f3c"} Jul 09 01:39:59.532437 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:39:59.532424 2564 scope.go:117] "RemoveContainer" containerID="f1e9ed561e7e7517cce79fed4ad36c38bc0d84d16b6d8933bdf19e05f25a0f3c" Jul 09 01:40:00.538323 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:00.538268 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-99rjb" event={"ID":"e61b2313-6b39-4068-95b6-dd2a95db5b1d","Type":"ContainerStarted","Data":"6721623b7460c49a5c31734d6991f261f2d8c828c3ff15c0795dd248d31630f0"} Jul 09 01:40:00.546286 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:00.546223 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-h8pb8" event={"ID":"18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662","Type":"ContainerStarted","Data":"e56ab0b10ed758c0d06e67b19df0f22fc1fc643c7183311b0571417bb904561b"} Jul 09 01:40:00.995588 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:00.995549 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5445498bf7-xbjsl"] Jul 09 01:40:00.995868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:00.995855 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9544219a-dc72-4be9-8973-a699c6ae0c21" containerName="console" Jul 09 01:40:00.995920 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:00.995871 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9544219a-dc72-4be9-8973-a699c6ae0c21" containerName="console" Jul 09 01:40:00.995920 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:00.995897 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4543d666-8d9f-4e5a-9cd1-e1b504aca20d" containerName="registry" Jul 09 01:40:00.995920 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:00.995904 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4543d666-8d9f-4e5a-9cd1-e1b504aca20d" containerName="registry" Jul 09 01:40:00.996013 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:00.995966 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9544219a-dc72-4be9-8973-a699c6ae0c21" containerName="console" Jul 09 01:40:00.996013 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:00.995976 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4543d666-8d9f-4e5a-9cd1-e1b504aca20d" containerName="registry" Jul 09 01:40:01.013147 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.013110 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5445498bf7-xbjsl"] Jul 09 01:40:01.013339 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.013269 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5445498bf7-xbjsl" Jul 09 01:40:01.015527 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.015503 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 01:40:01.015672 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.015503 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9x9t2\"" Jul 09 01:40:01.015672 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.015619 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 01:40:01.015672 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.015650 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 01:40:01.015963 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.015946 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 01:40:01.016052 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.015990 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 01:40:01.021335 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.021299 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 01:40:01.049509 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.049477 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2200fc69-5995-46b7-b8e3-e7f14f66fd36-console-oauth-config\") pod \"console-5445498bf7-xbjsl\" (UID: \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\") " pod="openshift-console/console-5445498bf7-xbjsl" Jul 09 01:40:01.049666 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.049514 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2xw6\" (UniqueName: \"kubernetes.io/projected/2200fc69-5995-46b7-b8e3-e7f14f66fd36-kube-api-access-b2xw6\") pod \"console-5445498bf7-xbjsl\" (UID: \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\") " pod="openshift-console/console-5445498bf7-xbjsl" Jul 09 01:40:01.049666 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.049544 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2200fc69-5995-46b7-b8e3-e7f14f66fd36-console-config\") pod \"console-5445498bf7-xbjsl\" (UID: \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\") " pod="openshift-console/console-5445498bf7-xbjsl" Jul 09 01:40:01.049666 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.049638 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2200fc69-5995-46b7-b8e3-e7f14f66fd36-oauth-serving-cert\") pod \"console-5445498bf7-xbjsl\" (UID: \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\") " pod="openshift-console/console-5445498bf7-xbjsl" Jul 09 01:40:01.049666 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.049663 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2200fc69-5995-46b7-b8e3-e7f14f66fd36-trusted-ca-bundle\") pod \"console-5445498bf7-xbjsl\" (UID: \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\") " pod="openshift-console/console-5445498bf7-xbjsl" Jul 09 01:40:01.049824 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.049689 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2200fc69-5995-46b7-b8e3-e7f14f66fd36-service-ca\") pod \"console-5445498bf7-xbjsl\" (UID: \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\") " pod="openshift-console/console-5445498bf7-xbjsl" Jul 09 01:40:01.049824 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.049708 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2200fc69-5995-46b7-b8e3-e7f14f66fd36-console-serving-cert\") pod \"console-5445498bf7-xbjsl\" (UID: \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\") " pod="openshift-console/console-5445498bf7-xbjsl" Jul 09 01:40:01.150622 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.150585 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2200fc69-5995-46b7-b8e3-e7f14f66fd36-console-oauth-config\") pod \"console-5445498bf7-xbjsl\" (UID: \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\") " pod="openshift-console/console-5445498bf7-xbjsl" Jul 09 01:40:01.150622 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.150623 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2xw6\" (UniqueName: \"kubernetes.io/projected/2200fc69-5995-46b7-b8e3-e7f14f66fd36-kube-api-access-b2xw6\") pod \"console-5445498bf7-xbjsl\" (UID: \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\") " pod="openshift-console/console-5445498bf7-xbjsl" Jul 09 01:40:01.150889 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.150641 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2200fc69-5995-46b7-b8e3-e7f14f66fd36-console-config\") pod \"console-5445498bf7-xbjsl\" (UID: \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\") " pod="openshift-console/console-5445498bf7-xbjsl" Jul 09 01:40:01.151005 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.150986 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2200fc69-5995-46b7-b8e3-e7f14f66fd36-oauth-serving-cert\") pod \"console-5445498bf7-xbjsl\" (UID: \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\") " pod="openshift-console/console-5445498bf7-xbjsl" Jul 09 01:40:01.151144 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.151011 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2200fc69-5995-46b7-b8e3-e7f14f66fd36-trusted-ca-bundle\") pod \"console-5445498bf7-xbjsl\" (UID: \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\") " pod="openshift-console/console-5445498bf7-xbjsl" Jul 09 01:40:01.151144 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.151030 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2200fc69-5995-46b7-b8e3-e7f14f66fd36-service-ca\") pod \"console-5445498bf7-xbjsl\" (UID: \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\") " pod="openshift-console/console-5445498bf7-xbjsl" Jul 09 01:40:01.151144 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.151046 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2200fc69-5995-46b7-b8e3-e7f14f66fd36-console-serving-cert\") pod \"console-5445498bf7-xbjsl\" (UID: \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\") " pod="openshift-console/console-5445498bf7-xbjsl" Jul 09 01:40:01.151630 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.151602 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2200fc69-5995-46b7-b8e3-e7f14f66fd36-console-config\") pod \"console-5445498bf7-xbjsl\" (UID: \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\") " pod="openshift-console/console-5445498bf7-xbjsl" Jul 09 01:40:01.151726 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.151684 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2200fc69-5995-46b7-b8e3-e7f14f66fd36-oauth-serving-cert\") pod \"console-5445498bf7-xbjsl\" (UID: \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\") " pod="openshift-console/console-5445498bf7-xbjsl" Jul 09 01:40:01.151787 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.151750 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2200fc69-5995-46b7-b8e3-e7f14f66fd36-service-ca\") pod \"console-5445498bf7-xbjsl\" (UID: \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\") " pod="openshift-console/console-5445498bf7-xbjsl" Jul 09 01:40:01.151940 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.151921 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2200fc69-5995-46b7-b8e3-e7f14f66fd36-trusted-ca-bundle\") pod \"console-5445498bf7-xbjsl\" (UID: \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\") " pod="openshift-console/console-5445498bf7-xbjsl" Jul 09 01:40:01.153418 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.153400 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2200fc69-5995-46b7-b8e3-e7f14f66fd36-console-oauth-config\") pod \"console-5445498bf7-xbjsl\" (UID: \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\") " pod="openshift-console/console-5445498bf7-xbjsl" Jul 09 01:40:01.153593 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.153567 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2200fc69-5995-46b7-b8e3-e7f14f66fd36-console-serving-cert\") pod \"console-5445498bf7-xbjsl\" (UID: \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\") " pod="openshift-console/console-5445498bf7-xbjsl" Jul 09 01:40:01.158755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.158731 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2xw6\" (UniqueName: \"kubernetes.io/projected/2200fc69-5995-46b7-b8e3-e7f14f66fd36-kube-api-access-b2xw6\") pod \"console-5445498bf7-xbjsl\" (UID: \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\") " pod="openshift-console/console-5445498bf7-xbjsl" Jul 09 01:40:01.324486 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.324391 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5445498bf7-xbjsl" Jul 09 01:40:01.485349 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.485325 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5445498bf7-xbjsl"] Jul 09 01:40:01.487839 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:40:01.487804 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2200fc69_5995_46b7_b8e3_e7f14f66fd36.slice/crio-7284c9b2e06b52a62101310dd37fb71ea7f649fab78c97ca42c1ef4e2a232958 WatchSource:0}: Error finding container 7284c9b2e06b52a62101310dd37fb71ea7f649fab78c97ca42c1ef4e2a232958: Status 404 returned error can't find the container with id 7284c9b2e06b52a62101310dd37fb71ea7f649fab78c97ca42c1ef4e2a232958 Jul 09 01:40:01.552295 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:01.552264 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5445498bf7-xbjsl" event={"ID":"2200fc69-5995-46b7-b8e3-e7f14f66fd36","Type":"ContainerStarted","Data":"7284c9b2e06b52a62101310dd37fb71ea7f649fab78c97ca42c1ef4e2a232958"} Jul 09 01:40:02.557927 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:02.557886 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5445498bf7-xbjsl" event={"ID":"2200fc69-5995-46b7-b8e3-e7f14f66fd36","Type":"ContainerStarted","Data":"073f70347d39725f4bf3aff2f140bd5a9a32a69b097770f2a5d879dbaefb3b56"} Jul 09 01:40:02.575750 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:02.575699 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5445498bf7-xbjsl" podStartSLOduration=2.57568094 podStartE2EDuration="2.57568094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:40:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:40:02.573823219 +0000 UTC m=+135.235560708" watchObservedRunningTime="2026-07-09 01:40:02.57568094 +0000 UTC m=+135.237418432" Jul 09 01:40:04.566464 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:04.566426 2564 generic.go:356] "Generic (PLEG): container finished" podID="fa5bc969-c6e4-4e77-a7e5-268e982bc0b4" containerID="72b9ec4528e10feb14a033775c710099a41538171bc09d759b131348ea921bb4" exitCode=0 Jul 09 01:40:04.566839 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:04.566489 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9z9g5" event={"ID":"fa5bc969-c6e4-4e77-a7e5-268e982bc0b4","Type":"ContainerDied","Data":"72b9ec4528e10feb14a033775c710099a41538171bc09d759b131348ea921bb4"} Jul 09 01:40:04.566881 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:04.566860 2564 scope.go:117] "RemoveContainer" containerID="72b9ec4528e10feb14a033775c710099a41538171bc09d759b131348ea921bb4" Jul 09 01:40:05.572545 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:05.572515 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9z9g5" event={"ID":"fa5bc969-c6e4-4e77-a7e5-268e982bc0b4","Type":"ContainerStarted","Data":"3b54ad6bce590915dd26659dd44c7c9cd95a64d3796afebf27986af70ea159f3"} Jul 09 01:40:11.325413 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:11.325380 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5445498bf7-xbjsl" Jul 09 01:40:11.325866 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:11.325438 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5445498bf7-xbjsl" Jul 09 01:40:11.330437 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:11.330413 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5445498bf7-xbjsl" Jul 09 01:40:11.600438 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:11.600358 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5445498bf7-xbjsl" Jul 09 01:40:57.804675 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:57.804644 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k"] Jul 09 01:40:57.809096 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:57.809078 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k" Jul 09 01:40:57.811723 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:57.811694 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 01:40:57.811881 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:57.811862 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 01:40:57.812588 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:57.812571 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8pfx9\"" Jul 09 01:40:57.817303 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:57.817281 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k"] Jul 09 01:40:57.873053 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:57.873027 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k\" (UID: \"d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k" Jul 09 01:40:57.873199 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:57.873067 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k\" (UID: \"d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k" Jul 09 01:40:57.873199 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:57.873101 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5rvb\" (UniqueName: \"kubernetes.io/projected/d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5-kube-api-access-h5rvb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k\" (UID: \"d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k" Jul 09 01:40:57.974085 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:57.974050 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k\" (UID: \"d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k" Jul 09 01:40:57.974311 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:57.974104 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k\" (UID: \"d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k" Jul 09 01:40:57.974311 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:57.974279 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5rvb\" (UniqueName: \"kubernetes.io/projected/d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5-kube-api-access-h5rvb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k\" (UID: \"d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k" Jul 09 01:40:57.974467 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:57.974451 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k\" (UID: \"d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k" Jul 09 01:40:57.974550 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:57.974532 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k\" (UID: \"d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k" Jul 09 01:40:57.983615 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:57.983595 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5rvb\" (UniqueName: \"kubernetes.io/projected/d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5-kube-api-access-h5rvb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k\" (UID: \"d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k" Jul 09 01:40:58.119135 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:58.119051 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k" Jul 09 01:40:58.253674 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:58.253649 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k"] Jul 09 01:40:58.256384 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:40:58.256357 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd87ebb64_96f2_4ad0_93f3_553b6bc9b8b5.slice/crio-6165b2b5961e8c47d83e379fab40a344cd21d6d3858a82b74efb12a329402702 WatchSource:0}: Error finding container 6165b2b5961e8c47d83e379fab40a344cd21d6d3858a82b74efb12a329402702: Status 404 returned error can't find the container with id 6165b2b5961e8c47d83e379fab40a344cd21d6d3858a82b74efb12a329402702 Jul 09 01:40:58.775630 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:40:58.775593 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k" event={"ID":"d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5","Type":"ContainerStarted","Data":"6165b2b5961e8c47d83e379fab40a344cd21d6d3858a82b74efb12a329402702"} Jul 09 01:41:05.805967 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:05.805930 2564 generic.go:356] "Generic (PLEG): container finished" podID="d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5" containerID="c398d1bf98b3c933ce27101a2d9cd75606ca70717268bce923f708183bcfbde6" exitCode=0 Jul 09 01:41:05.806367 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:05.806021 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k" event={"ID":"d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5","Type":"ContainerDied","Data":"c398d1bf98b3c933ce27101a2d9cd75606ca70717268bce923f708183bcfbde6"} Jul 09 01:41:08.819397 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:08.819356 2564 generic.go:356] "Generic (PLEG): container finished" podID="d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5" containerID="8c0bd264de5d32be9e4ff62d0be2858adae3ecdad7ebb7fb44ec874c4587fa51" exitCode=0 Jul 09 01:41:08.819857 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:08.819443 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k" event={"ID":"d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5","Type":"ContainerDied","Data":"8c0bd264de5d32be9e4ff62d0be2858adae3ecdad7ebb7fb44ec874c4587fa51"} Jul 09 01:41:17.859202 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:17.859114 2564 generic.go:356] "Generic (PLEG): container finished" podID="d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5" containerID="c884641761f8658405287e48bcb0abcdd494ebc727b1efcd994cb27b26d1de6d" exitCode=0 Jul 09 01:41:17.859202 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:17.859156 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k" event={"ID":"d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5","Type":"ContainerDied","Data":"c884641761f8658405287e48bcb0abcdd494ebc727b1efcd994cb27b26d1de6d"} Jul 09 01:41:18.989552 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:18.989530 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k" Jul 09 01:41:19.044027 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:19.043995 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5-bundle\") pod \"d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5\" (UID: \"d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5\") " Jul 09 01:41:19.044158 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:19.044069 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5rvb\" (UniqueName: \"kubernetes.io/projected/d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5-kube-api-access-h5rvb\") pod \"d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5\" (UID: \"d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5\") " Jul 09 01:41:19.044158 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:19.044095 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5-util\") pod \"d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5\" (UID: \"d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5\") " Jul 09 01:41:19.044758 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:19.044728 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5-bundle" (OuterVolumeSpecName: "bundle") pod "d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5" (UID: "d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 01:41:19.046267 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:19.046224 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5-kube-api-access-h5rvb" (OuterVolumeSpecName: "kube-api-access-h5rvb") pod "d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5" (UID: "d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5"). InnerVolumeSpecName "kube-api-access-h5rvb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 01:41:19.049485 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:19.049455 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5-util" (OuterVolumeSpecName: "util") pod "d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5" (UID: "d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 01:41:19.145610 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:19.145530 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5rvb\" (UniqueName: \"kubernetes.io/projected/d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5-kube-api-access-h5rvb\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:41:19.145610 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:19.145560 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5-util\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:41:19.145610 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:19.145571 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5-bundle\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:41:19.867877 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:19.867846 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k" Jul 09 01:41:19.867877 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:19.867857 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h264k" event={"ID":"d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5","Type":"ContainerDied","Data":"6165b2b5961e8c47d83e379fab40a344cd21d6d3858a82b74efb12a329402702"} Jul 09 01:41:19.868121 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:19.867897 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6165b2b5961e8c47d83e379fab40a344cd21d6d3858a82b74efb12a329402702" Jul 09 01:41:25.872403 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:25.872371 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c9fwm"] Jul 09 01:41:25.872796 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:25.872665 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5" containerName="extract" Jul 09 01:41:25.872796 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:25.872675 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5" containerName="extract" Jul 09 01:41:25.872796 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:25.872686 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5" containerName="util" Jul 09 01:41:25.872796 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:25.872691 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5" containerName="util" Jul 09 01:41:25.872796 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:25.872701 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5" containerName="pull" Jul 09 01:41:25.872796 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:25.872707 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5" containerName="pull" Jul 09 01:41:25.872796 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:25.872753 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d87ebb64-96f2-4ad0-93f3-553b6bc9b8b5" containerName="extract" Jul 09 01:41:25.877010 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:25.876991 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c9fwm" Jul 09 01:41:25.880107 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:25.880077 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-zqs7v\"" Jul 09 01:41:25.880107 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:25.880098 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 09 01:41:25.880281 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:25.880120 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 09 01:41:25.893227 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:25.893201 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c9fwm"] Jul 09 01:41:25.998932 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:25.998893 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbbd8f53-0ebd-467b-a882-276dca2423c1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-c9fwm\" (UID: \"bbbd8f53-0ebd-467b-a882-276dca2423c1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c9fwm" Jul 09 01:41:25.998932 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:25.998938 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgvr2\" (UniqueName: \"kubernetes.io/projected/bbbd8f53-0ebd-467b-a882-276dca2423c1-kube-api-access-wgvr2\") pod \"cert-manager-operator-controller-manager-55c444bf86-c9fwm\" (UID: \"bbbd8f53-0ebd-467b-a882-276dca2423c1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c9fwm" Jul 09 01:41:26.099810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:26.099773 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbbd8f53-0ebd-467b-a882-276dca2423c1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-c9fwm\" (UID: \"bbbd8f53-0ebd-467b-a882-276dca2423c1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c9fwm" Jul 09 01:41:26.099975 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:26.099819 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgvr2\" (UniqueName: \"kubernetes.io/projected/bbbd8f53-0ebd-467b-a882-276dca2423c1-kube-api-access-wgvr2\") pod \"cert-manager-operator-controller-manager-55c444bf86-c9fwm\" (UID: \"bbbd8f53-0ebd-467b-a882-276dca2423c1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c9fwm" Jul 09 01:41:26.100166 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:26.100147 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbbd8f53-0ebd-467b-a882-276dca2423c1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-c9fwm\" (UID: \"bbbd8f53-0ebd-467b-a882-276dca2423c1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c9fwm" Jul 09 01:41:26.112084 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:26.112055 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgvr2\" (UniqueName: \"kubernetes.io/projected/bbbd8f53-0ebd-467b-a882-276dca2423c1-kube-api-access-wgvr2\") pod \"cert-manager-operator-controller-manager-55c444bf86-c9fwm\" (UID: \"bbbd8f53-0ebd-467b-a882-276dca2423c1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c9fwm" Jul 09 01:41:26.186119 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:26.186032 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c9fwm" Jul 09 01:41:26.318139 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:26.317956 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c9fwm"] Jul 09 01:41:26.321108 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:41:26.321071 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbbd8f53_0ebd_467b_a882_276dca2423c1.slice/crio-1ace4b53997acd8b10fdf653f6e7ee859bd5370c9bc4df126c27a1ad11612512 WatchSource:0}: Error finding container 1ace4b53997acd8b10fdf653f6e7ee859bd5370c9bc4df126c27a1ad11612512: Status 404 returned error can't find the container with id 1ace4b53997acd8b10fdf653f6e7ee859bd5370c9bc4df126c27a1ad11612512 Jul 09 01:41:26.895828 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:26.895793 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c9fwm" event={"ID":"bbbd8f53-0ebd-467b-a882-276dca2423c1","Type":"ContainerStarted","Data":"1ace4b53997acd8b10fdf653f6e7ee859bd5370c9bc4df126c27a1ad11612512"} Jul 09 01:41:28.905513 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:28.905478 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c9fwm" event={"ID":"bbbd8f53-0ebd-467b-a882-276dca2423c1","Type":"ContainerStarted","Data":"37ec10ae1c8af590eaa6e9d7b5410c6a347edc2728dd0cca3e48357be12d9e78"} Jul 09 01:41:28.928697 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:28.928644 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c9fwm" podStartSLOduration=2.203428636 podStartE2EDuration="3.928624831s" totalImagesPullingTime="1.725196195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:41:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:41:28.928064357 +0000 UTC m=+221.589801849" watchObservedRunningTime="2026-07-09 01:41:28.928624831 +0000 UTC m=+221.590362323" Jul 09 01:41:29.851807 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:29.851770 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-446md"] Jul 09 01:41:29.858916 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:29.858889 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-446md" Jul 09 01:41:29.861345 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:29.861317 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 09 01:41:29.862052 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:29.862034 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 09 01:41:29.862052 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:29.862045 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-pcdbx\"" Jul 09 01:41:29.867178 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:29.867153 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-446md"] Jul 09 01:41:29.932362 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:29.932333 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njr28\" (UniqueName: \"kubernetes.io/projected/2b99b5bf-15eb-49ed-8d23-0c68e4547f84-kube-api-access-njr28\") pod \"cert-manager-webhook-6486ffd997-446md\" (UID: \"2b99b5bf-15eb-49ed-8d23-0c68e4547f84\") " pod="cert-manager/cert-manager-webhook-6486ffd997-446md" Jul 09 01:41:29.932707 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:29.932370 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b99b5bf-15eb-49ed-8d23-0c68e4547f84-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-446md\" (UID: \"2b99b5bf-15eb-49ed-8d23-0c68e4547f84\") " pod="cert-manager/cert-manager-webhook-6486ffd997-446md" Jul 09 01:41:29.947440 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:29.947412 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m"] Jul 09 01:41:29.950708 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:29.950692 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m" Jul 09 01:41:29.952998 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:29.952984 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 01:41:29.953379 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:29.953358 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8pfx9\"" Jul 09 01:41:29.953532 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:29.953513 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 01:41:29.959316 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:29.959293 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m"] Jul 09 01:41:30.032819 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:30.032780 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18eaf8fd-5674-4659-8e85-0fddcf0539e2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m\" (UID: \"18eaf8fd-5674-4659-8e85-0fddcf0539e2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m" Jul 09 01:41:30.032990 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:30.032845 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njr28\" (UniqueName: \"kubernetes.io/projected/2b99b5bf-15eb-49ed-8d23-0c68e4547f84-kube-api-access-njr28\") pod \"cert-manager-webhook-6486ffd997-446md\" (UID: \"2b99b5bf-15eb-49ed-8d23-0c68e4547f84\") " pod="cert-manager/cert-manager-webhook-6486ffd997-446md" Jul 09 01:41:30.032990 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:30.032906 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b99b5bf-15eb-49ed-8d23-0c68e4547f84-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-446md\" (UID: \"2b99b5bf-15eb-49ed-8d23-0c68e4547f84\") " pod="cert-manager/cert-manager-webhook-6486ffd997-446md" Jul 09 01:41:30.032990 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:30.032961 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18eaf8fd-5674-4659-8e85-0fddcf0539e2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m\" (UID: \"18eaf8fd-5674-4659-8e85-0fddcf0539e2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m" Jul 09 01:41:30.033112 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:30.033023 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2jqz\" (UniqueName: \"kubernetes.io/projected/18eaf8fd-5674-4659-8e85-0fddcf0539e2-kube-api-access-h2jqz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m\" (UID: \"18eaf8fd-5674-4659-8e85-0fddcf0539e2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m" Jul 09 01:41:30.040979 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:30.040943 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b99b5bf-15eb-49ed-8d23-0c68e4547f84-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-446md\" (UID: \"2b99b5bf-15eb-49ed-8d23-0c68e4547f84\") " pod="cert-manager/cert-manager-webhook-6486ffd997-446md" Jul 09 01:41:30.041123 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:30.041000 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njr28\" (UniqueName: \"kubernetes.io/projected/2b99b5bf-15eb-49ed-8d23-0c68e4547f84-kube-api-access-njr28\") pod \"cert-manager-webhook-6486ffd997-446md\" (UID: \"2b99b5bf-15eb-49ed-8d23-0c68e4547f84\") " pod="cert-manager/cert-manager-webhook-6486ffd997-446md" Jul 09 01:41:30.134288 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:30.134170 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18eaf8fd-5674-4659-8e85-0fddcf0539e2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m\" (UID: \"18eaf8fd-5674-4659-8e85-0fddcf0539e2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m" Jul 09 01:41:30.134435 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:30.134317 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2jqz\" (UniqueName: \"kubernetes.io/projected/18eaf8fd-5674-4659-8e85-0fddcf0539e2-kube-api-access-h2jqz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m\" (UID: \"18eaf8fd-5674-4659-8e85-0fddcf0539e2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m" Jul 09 01:41:30.134435 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:30.134367 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18eaf8fd-5674-4659-8e85-0fddcf0539e2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m\" (UID: \"18eaf8fd-5674-4659-8e85-0fddcf0539e2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m" Jul 09 01:41:30.134637 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:30.134616 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18eaf8fd-5674-4659-8e85-0fddcf0539e2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m\" (UID: \"18eaf8fd-5674-4659-8e85-0fddcf0539e2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m" Jul 09 01:41:30.134673 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:30.134632 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18eaf8fd-5674-4659-8e85-0fddcf0539e2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m\" (UID: \"18eaf8fd-5674-4659-8e85-0fddcf0539e2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m" Jul 09 01:41:30.142093 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:30.142064 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2jqz\" (UniqueName: \"kubernetes.io/projected/18eaf8fd-5674-4659-8e85-0fddcf0539e2-kube-api-access-h2jqz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m\" (UID: \"18eaf8fd-5674-4659-8e85-0fddcf0539e2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m" Jul 09 01:41:30.179978 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:30.179940 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-446md" Jul 09 01:41:30.259737 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:30.259705 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m" Jul 09 01:41:30.312610 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:30.312544 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-446md"] Jul 09 01:41:30.413898 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:30.413806 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m"] Jul 09 01:41:30.416406 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:41:30.416377 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18eaf8fd_5674_4659_8e85_0fddcf0539e2.slice/crio-5d55b96437e71871d7e0455d0f6e3cb4b517037a8a01f37a819d985adf1f0c19 WatchSource:0}: Error finding container 5d55b96437e71871d7e0455d0f6e3cb4b517037a8a01f37a819d985adf1f0c19: Status 404 returned error can't find the container with id 5d55b96437e71871d7e0455d0f6e3cb4b517037a8a01f37a819d985adf1f0c19 Jul 09 01:41:30.914674 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:30.914633 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-446md" event={"ID":"2b99b5bf-15eb-49ed-8d23-0c68e4547f84","Type":"ContainerStarted","Data":"3c196d16fb450f86baac947bf06ee397b41982564cdc8863e3a1be9cad8ae8fe"} Jul 09 01:41:30.916026 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:30.915998 2564 generic.go:356] "Generic (PLEG): container finished" podID="18eaf8fd-5674-4659-8e85-0fddcf0539e2" containerID="30c40f38f4535d4fe663d35c89822d5a39800af8d676dc5ea666071b6b034f1f" exitCode=0 Jul 09 01:41:30.916177 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:30.916044 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m" event={"ID":"18eaf8fd-5674-4659-8e85-0fddcf0539e2","Type":"ContainerDied","Data":"30c40f38f4535d4fe663d35c89822d5a39800af8d676dc5ea666071b6b034f1f"} Jul 09 01:41:30.916177 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:30.916088 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m" event={"ID":"18eaf8fd-5674-4659-8e85-0fddcf0539e2","Type":"ContainerStarted","Data":"5d55b96437e71871d7e0455d0f6e3cb4b517037a8a01f37a819d985adf1f0c19"} Jul 09 01:41:33.933043 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:33.933004 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-446md" event={"ID":"2b99b5bf-15eb-49ed-8d23-0c68e4547f84","Type":"ContainerStarted","Data":"af36f608fadc8e83781f855668ade00b6dd84a33f58b7ee982e5209d3b49d67f"} Jul 09 01:41:33.933463 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:33.933151 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-446md" Jul 09 01:41:33.934758 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:33.934737 2564 generic.go:356] "Generic (PLEG): container finished" podID="18eaf8fd-5674-4659-8e85-0fddcf0539e2" containerID="e5c4d24e5fc735db14c373fa66bc107f6f00f4ad78ca4fa04383237a24cf7260" exitCode=0 Jul 09 01:41:33.934865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:33.934790 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m" event={"ID":"18eaf8fd-5674-4659-8e85-0fddcf0539e2","Type":"ContainerDied","Data":"e5c4d24e5fc735db14c373fa66bc107f6f00f4ad78ca4fa04383237a24cf7260"} Jul 09 01:41:33.948892 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:33.948837 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-446md" podStartSLOduration=1.519901604 podStartE2EDuration="4.9488195s" totalImagesPullingTime="3.428917896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:41:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:41:33.947362517 +0000 UTC m=+226.609100021" watchObservedRunningTime="2026-07-09 01:41:33.9488195 +0000 UTC m=+226.610556993" Jul 09 01:41:34.942051 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:34.942019 2564 generic.go:356] "Generic (PLEG): container finished" podID="18eaf8fd-5674-4659-8e85-0fddcf0539e2" containerID="43b3d76d5a76b5ff23a9bd82c536863adecf294c727667d68c173f8cb91c38e9" exitCode=0 Jul 09 01:41:34.942525 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:34.942088 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m" event={"ID":"18eaf8fd-5674-4659-8e85-0fddcf0539e2","Type":"ContainerDied","Data":"43b3d76d5a76b5ff23a9bd82c536863adecf294c727667d68c173f8cb91c38e9"} Jul 09 01:41:36.069535 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:36.069512 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m" Jul 09 01:41:36.188782 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:36.188752 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18eaf8fd-5674-4659-8e85-0fddcf0539e2-util\") pod \"18eaf8fd-5674-4659-8e85-0fddcf0539e2\" (UID: \"18eaf8fd-5674-4659-8e85-0fddcf0539e2\") " Jul 09 01:41:36.188918 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:36.188799 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18eaf8fd-5674-4659-8e85-0fddcf0539e2-bundle\") pod \"18eaf8fd-5674-4659-8e85-0fddcf0539e2\" (UID: \"18eaf8fd-5674-4659-8e85-0fddcf0539e2\") " Jul 09 01:41:36.188918 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:36.188860 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2jqz\" (UniqueName: \"kubernetes.io/projected/18eaf8fd-5674-4659-8e85-0fddcf0539e2-kube-api-access-h2jqz\") pod \"18eaf8fd-5674-4659-8e85-0fddcf0539e2\" (UID: \"18eaf8fd-5674-4659-8e85-0fddcf0539e2\") " Jul 09 01:41:36.189216 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:36.189187 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18eaf8fd-5674-4659-8e85-0fddcf0539e2-bundle" (OuterVolumeSpecName: "bundle") pod "18eaf8fd-5674-4659-8e85-0fddcf0539e2" (UID: "18eaf8fd-5674-4659-8e85-0fddcf0539e2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 01:41:36.191005 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:36.190976 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18eaf8fd-5674-4659-8e85-0fddcf0539e2-kube-api-access-h2jqz" (OuterVolumeSpecName: "kube-api-access-h2jqz") pod "18eaf8fd-5674-4659-8e85-0fddcf0539e2" (UID: "18eaf8fd-5674-4659-8e85-0fddcf0539e2"). InnerVolumeSpecName "kube-api-access-h2jqz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 01:41:36.193285 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:36.193264 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18eaf8fd-5674-4659-8e85-0fddcf0539e2-util" (OuterVolumeSpecName: "util") pod "18eaf8fd-5674-4659-8e85-0fddcf0539e2" (UID: "18eaf8fd-5674-4659-8e85-0fddcf0539e2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 01:41:36.289916 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:36.289836 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18eaf8fd-5674-4659-8e85-0fddcf0539e2-bundle\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:41:36.289916 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:36.289863 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2jqz\" (UniqueName: \"kubernetes.io/projected/18eaf8fd-5674-4659-8e85-0fddcf0539e2-kube-api-access-h2jqz\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:41:36.289916 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:36.289873 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18eaf8fd-5674-4659-8e85-0fddcf0539e2-util\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:41:36.951894 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:36.951854 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m" event={"ID":"18eaf8fd-5674-4659-8e85-0fddcf0539e2","Type":"ContainerDied","Data":"5d55b96437e71871d7e0455d0f6e3cb4b517037a8a01f37a819d985adf1f0c19"} Jul 09 01:41:36.952070 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:36.951911 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d55b96437e71871d7e0455d0f6e3cb4b517037a8a01f37a819d985adf1f0c19" Jul 09 01:41:36.952070 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:36.951879 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpg7m" Jul 09 01:41:39.944938 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:39.944909 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-446md" Jul 09 01:41:46.479213 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:46.479179 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkpdk"] Jul 09 01:41:46.479608 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:46.479508 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18eaf8fd-5674-4659-8e85-0fddcf0539e2" containerName="extract" Jul 09 01:41:46.479608 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:46.479521 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="18eaf8fd-5674-4659-8e85-0fddcf0539e2" containerName="extract" Jul 09 01:41:46.479608 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:46.479532 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18eaf8fd-5674-4659-8e85-0fddcf0539e2" containerName="util" Jul 09 01:41:46.479608 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:46.479538 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="18eaf8fd-5674-4659-8e85-0fddcf0539e2" containerName="util" Jul 09 01:41:46.479608 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:46.479556 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18eaf8fd-5674-4659-8e85-0fddcf0539e2" containerName="pull" Jul 09 01:41:46.479608 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:46.479562 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="18eaf8fd-5674-4659-8e85-0fddcf0539e2" containerName="pull" Jul 09 01:41:46.479608 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:46.479612 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="18eaf8fd-5674-4659-8e85-0fddcf0539e2" containerName="extract" Jul 09 01:41:46.521159 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:46.521134 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkpdk"] Jul 09 01:41:46.521336 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:46.521219 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkpdk" Jul 09 01:41:46.523990 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:46.523953 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 09 01:41:46.524128 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:46.524003 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 09 01:41:46.524128 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:46.524027 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-jprpn\"" Jul 09 01:41:46.678904 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:46.678859 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cfj8\" (UniqueName: \"kubernetes.io/projected/d94005a1-4364-49b3-8380-72bc96206ada-kube-api-access-2cfj8\") pod \"openshift-lws-operator-fd8ccff4c-lkpdk\" (UID: \"d94005a1-4364-49b3-8380-72bc96206ada\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkpdk" Jul 09 01:41:46.679087 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:46.678914 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d94005a1-4364-49b3-8380-72bc96206ada-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lkpdk\" (UID: \"d94005a1-4364-49b3-8380-72bc96206ada\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkpdk" Jul 09 01:41:46.779598 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:46.779508 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cfj8\" (UniqueName: \"kubernetes.io/projected/d94005a1-4364-49b3-8380-72bc96206ada-kube-api-access-2cfj8\") pod \"openshift-lws-operator-fd8ccff4c-lkpdk\" (UID: \"d94005a1-4364-49b3-8380-72bc96206ada\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkpdk" Jul 09 01:41:46.779598 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:46.779549 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d94005a1-4364-49b3-8380-72bc96206ada-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lkpdk\" (UID: \"d94005a1-4364-49b3-8380-72bc96206ada\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkpdk" Jul 09 01:41:46.779987 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:46.779964 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d94005a1-4364-49b3-8380-72bc96206ada-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lkpdk\" (UID: \"d94005a1-4364-49b3-8380-72bc96206ada\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkpdk" Jul 09 01:41:46.786524 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:46.786500 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cfj8\" (UniqueName: \"kubernetes.io/projected/d94005a1-4364-49b3-8380-72bc96206ada-kube-api-access-2cfj8\") pod \"openshift-lws-operator-fd8ccff4c-lkpdk\" (UID: \"d94005a1-4364-49b3-8380-72bc96206ada\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkpdk" Jul 09 01:41:46.829931 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:46.829904 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkpdk" Jul 09 01:41:46.973351 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:46.973212 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkpdk"] Jul 09 01:41:46.975512 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:41:46.975480 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd94005a1_4364_49b3_8380_72bc96206ada.slice/crio-1f678df0e86afeb8d67309a7483d630d1caae1e118379f54f3e5e7b26c455d43 WatchSource:0}: Error finding container 1f678df0e86afeb8d67309a7483d630d1caae1e118379f54f3e5e7b26c455d43: Status 404 returned error can't find the container with id 1f678df0e86afeb8d67309a7483d630d1caae1e118379f54f3e5e7b26c455d43 Jul 09 01:41:47.000558 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:47.000525 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkpdk" event={"ID":"d94005a1-4364-49b3-8380-72bc96206ada","Type":"ContainerStarted","Data":"1f678df0e86afeb8d67309a7483d630d1caae1e118379f54f3e5e7b26c455d43"} Jul 09 01:41:50.018314 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:50.018274 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkpdk" event={"ID":"d94005a1-4364-49b3-8380-72bc96206ada","Type":"ContainerStarted","Data":"de35f5a355dfecb584f768662a88b9fa0fe5f6f572355181d34585ef46bcb873"} Jul 09 01:41:50.034433 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:50.034380 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lkpdk" podStartSLOduration=1.91050258 podStartE2EDuration="4.034359956s" totalImagesPullingTime="2.123857376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:41:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:41:50.033625922 +0000 UTC m=+242.695363428" watchObservedRunningTime="2026-07-09 01:41:50.034359956 +0000 UTC m=+242.696097451" Jul 09 01:41:52.405248 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:52.405208 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq"] Jul 09 01:41:52.408671 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:52.408650 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq" Jul 09 01:41:52.410969 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:52.410947 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 01:41:52.411597 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:52.411583 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8pfx9\"" Jul 09 01:41:52.411673 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:52.411586 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 01:41:52.416364 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:52.416331 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq"] Jul 09 01:41:52.529527 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:52.529489 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e508b0dc-aee0-4858-8619-34ce1985644f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq\" (UID: \"e508b0dc-aee0-4858-8619-34ce1985644f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq" Jul 09 01:41:52.529702 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:52.529550 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hljf\" (UniqueName: \"kubernetes.io/projected/e508b0dc-aee0-4858-8619-34ce1985644f-kube-api-access-7hljf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq\" (UID: \"e508b0dc-aee0-4858-8619-34ce1985644f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq" Jul 09 01:41:52.529702 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:52.529588 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e508b0dc-aee0-4858-8619-34ce1985644f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq\" (UID: \"e508b0dc-aee0-4858-8619-34ce1985644f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq" Jul 09 01:41:52.630403 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:52.630369 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e508b0dc-aee0-4858-8619-34ce1985644f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq\" (UID: \"e508b0dc-aee0-4858-8619-34ce1985644f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq" Jul 09 01:41:52.630570 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:52.630420 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hljf\" (UniqueName: \"kubernetes.io/projected/e508b0dc-aee0-4858-8619-34ce1985644f-kube-api-access-7hljf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq\" (UID: \"e508b0dc-aee0-4858-8619-34ce1985644f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq" Jul 09 01:41:52.630570 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:52.630452 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e508b0dc-aee0-4858-8619-34ce1985644f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq\" (UID: \"e508b0dc-aee0-4858-8619-34ce1985644f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq" Jul 09 01:41:52.630759 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:52.630740 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e508b0dc-aee0-4858-8619-34ce1985644f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq\" (UID: \"e508b0dc-aee0-4858-8619-34ce1985644f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq" Jul 09 01:41:52.630837 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:52.630817 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e508b0dc-aee0-4858-8619-34ce1985644f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq\" (UID: \"e508b0dc-aee0-4858-8619-34ce1985644f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq" Jul 09 01:41:52.638292 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:52.638267 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hljf\" (UniqueName: \"kubernetes.io/projected/e508b0dc-aee0-4858-8619-34ce1985644f-kube-api-access-7hljf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq\" (UID: \"e508b0dc-aee0-4858-8619-34ce1985644f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq" Jul 09 01:41:52.719309 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:52.719275 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq" Jul 09 01:41:52.845028 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:52.845004 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq"] Jul 09 01:41:52.846793 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:41:52.846762 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode508b0dc_aee0_4858_8619_34ce1985644f.slice/crio-261fb8d44ac44772074da4c93137a06814ae24b4875a61bfda957ee3ebf2a004 WatchSource:0}: Error finding container 261fb8d44ac44772074da4c93137a06814ae24b4875a61bfda957ee3ebf2a004: Status 404 returned error can't find the container with id 261fb8d44ac44772074da4c93137a06814ae24b4875a61bfda957ee3ebf2a004 Jul 09 01:41:53.031796 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:53.031709 2564 generic.go:356] "Generic (PLEG): container finished" podID="e508b0dc-aee0-4858-8619-34ce1985644f" containerID="d574cb5f5c66c6042d5297297f0b3b61d13a5d8b175e4f0d930dfe5e02a0c5ed" exitCode=0 Jul 09 01:41:53.031943 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:53.031800 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq" event={"ID":"e508b0dc-aee0-4858-8619-34ce1985644f","Type":"ContainerDied","Data":"d574cb5f5c66c6042d5297297f0b3b61d13a5d8b175e4f0d930dfe5e02a0c5ed"} Jul 09 01:41:53.031943 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:53.031856 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq" event={"ID":"e508b0dc-aee0-4858-8619-34ce1985644f","Type":"ContainerStarted","Data":"261fb8d44ac44772074da4c93137a06814ae24b4875a61bfda957ee3ebf2a004"} Jul 09 01:41:54.038827 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:54.038791 2564 generic.go:356] "Generic (PLEG): container finished" podID="e508b0dc-aee0-4858-8619-34ce1985644f" containerID="e00e7dfec4413a731eeb02e163f17e9bd98a26d287ac119bbb705eb9620b8148" exitCode=0 Jul 09 01:41:54.039263 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:54.038886 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq" event={"ID":"e508b0dc-aee0-4858-8619-34ce1985644f","Type":"ContainerDied","Data":"e00e7dfec4413a731eeb02e163f17e9bd98a26d287ac119bbb705eb9620b8148"} Jul 09 01:41:55.045783 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:55.045751 2564 generic.go:356] "Generic (PLEG): container finished" podID="e508b0dc-aee0-4858-8619-34ce1985644f" containerID="5b78f81cee7326888cd703b5070d1408edd03070867e59de696452ffb6a696b2" exitCode=0 Jul 09 01:41:55.046152 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:55.045802 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq" event={"ID":"e508b0dc-aee0-4858-8619-34ce1985644f","Type":"ContainerDied","Data":"5b78f81cee7326888cd703b5070d1408edd03070867e59de696452ffb6a696b2"} Jul 09 01:41:56.175451 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:56.175425 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq" Jul 09 01:41:56.259255 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:56.259208 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e508b0dc-aee0-4858-8619-34ce1985644f-bundle\") pod \"e508b0dc-aee0-4858-8619-34ce1985644f\" (UID: \"e508b0dc-aee0-4858-8619-34ce1985644f\") " Jul 09 01:41:56.259424 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:56.259271 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hljf\" (UniqueName: \"kubernetes.io/projected/e508b0dc-aee0-4858-8619-34ce1985644f-kube-api-access-7hljf\") pod \"e508b0dc-aee0-4858-8619-34ce1985644f\" (UID: \"e508b0dc-aee0-4858-8619-34ce1985644f\") " Jul 09 01:41:56.259424 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:56.259376 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e508b0dc-aee0-4858-8619-34ce1985644f-util\") pod \"e508b0dc-aee0-4858-8619-34ce1985644f\" (UID: \"e508b0dc-aee0-4858-8619-34ce1985644f\") " Jul 09 01:41:56.259962 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:56.259935 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e508b0dc-aee0-4858-8619-34ce1985644f-bundle" (OuterVolumeSpecName: "bundle") pod "e508b0dc-aee0-4858-8619-34ce1985644f" (UID: "e508b0dc-aee0-4858-8619-34ce1985644f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 01:41:56.261359 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:56.261334 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e508b0dc-aee0-4858-8619-34ce1985644f-kube-api-access-7hljf" (OuterVolumeSpecName: "kube-api-access-7hljf") pod "e508b0dc-aee0-4858-8619-34ce1985644f" (UID: "e508b0dc-aee0-4858-8619-34ce1985644f"). InnerVolumeSpecName "kube-api-access-7hljf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 01:41:56.267868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:56.267826 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e508b0dc-aee0-4858-8619-34ce1985644f-util" (OuterVolumeSpecName: "util") pod "e508b0dc-aee0-4858-8619-34ce1985644f" (UID: "e508b0dc-aee0-4858-8619-34ce1985644f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 01:41:56.360678 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:56.360607 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e508b0dc-aee0-4858-8619-34ce1985644f-util\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:41:56.360678 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:56.360634 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e508b0dc-aee0-4858-8619-34ce1985644f-bundle\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:41:56.360678 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:56.360644 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hljf\" (UniqueName: \"kubernetes.io/projected/e508b0dc-aee0-4858-8619-34ce1985644f-kube-api-access-7hljf\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:41:57.057208 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:57.057180 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq" Jul 09 01:41:57.057208 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:57.057201 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrmmpq" event={"ID":"e508b0dc-aee0-4858-8619-34ce1985644f","Type":"ContainerDied","Data":"261fb8d44ac44772074da4c93137a06814ae24b4875a61bfda957ee3ebf2a004"} Jul 09 01:41:57.057423 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:41:57.057266 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="261fb8d44ac44772074da4c93137a06814ae24b4875a61bfda957ee3ebf2a004" Jul 09 01:42:10.478303 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.478195 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b4b98c894-rknhq"] Jul 09 01:42:10.478858 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.478621 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e508b0dc-aee0-4858-8619-34ce1985644f" containerName="pull" Jul 09 01:42:10.478858 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.478638 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e508b0dc-aee0-4858-8619-34ce1985644f" containerName="pull" Jul 09 01:42:10.478858 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.478658 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e508b0dc-aee0-4858-8619-34ce1985644f" containerName="util" Jul 09 01:42:10.478858 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.478666 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e508b0dc-aee0-4858-8619-34ce1985644f" containerName="util" Jul 09 01:42:10.478858 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.478693 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e508b0dc-aee0-4858-8619-34ce1985644f" containerName="extract" Jul 09 01:42:10.478858 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.478701 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e508b0dc-aee0-4858-8619-34ce1985644f" containerName="extract" Jul 09 01:42:10.478858 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.478780 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e508b0dc-aee0-4858-8619-34ce1985644f" containerName="extract" Jul 09 01:42:10.481764 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.481744 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-rknhq" Jul 09 01:42:10.484310 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.484291 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 01:42:10.484482 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.484467 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 01:42:10.484701 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.484689 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 01:42:10.485212 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.485193 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jb862\"" Jul 09 01:42:10.487514 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.487498 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 01:42:10.495466 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.495444 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b4b98c894-rknhq"] Jul 09 01:42:10.572479 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.572443 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxfgn\" (UniqueName: \"kubernetes.io/projected/b25ab30a-6059-4bf4-b812-add6a4ab09ec-kube-api-access-jxfgn\") pod \"opendatahub-operator-controller-manager-b4b98c894-rknhq\" (UID: \"b25ab30a-6059-4bf4-b812-add6a4ab09ec\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-rknhq" Jul 09 01:42:10.572657 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.572485 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b25ab30a-6059-4bf4-b812-add6a4ab09ec-webhook-cert\") pod \"opendatahub-operator-controller-manager-b4b98c894-rknhq\" (UID: \"b25ab30a-6059-4bf4-b812-add6a4ab09ec\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-rknhq" Jul 09 01:42:10.572657 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.572577 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b25ab30a-6059-4bf4-b812-add6a4ab09ec-tmp\") pod \"opendatahub-operator-controller-manager-b4b98c894-rknhq\" (UID: \"b25ab30a-6059-4bf4-b812-add6a4ab09ec\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-rknhq" Jul 09 01:42:10.572784 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.572668 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b25ab30a-6059-4bf4-b812-add6a4ab09ec-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b4b98c894-rknhq\" (UID: \"b25ab30a-6059-4bf4-b812-add6a4ab09ec\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-rknhq" Jul 09 01:42:10.572784 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.572730 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b25ab30a-6059-4bf4-b812-add6a4ab09ec-manifests\") pod \"opendatahub-operator-controller-manager-b4b98c894-rknhq\" (UID: \"b25ab30a-6059-4bf4-b812-add6a4ab09ec\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-rknhq" Jul 09 01:42:10.673402 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.673360 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b25ab30a-6059-4bf4-b812-add6a4ab09ec-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b4b98c894-rknhq\" (UID: \"b25ab30a-6059-4bf4-b812-add6a4ab09ec\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-rknhq" Jul 09 01:42:10.673588 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.673424 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b25ab30a-6059-4bf4-b812-add6a4ab09ec-manifests\") pod \"opendatahub-operator-controller-manager-b4b98c894-rknhq\" (UID: \"b25ab30a-6059-4bf4-b812-add6a4ab09ec\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-rknhq" Jul 09 01:42:10.673588 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.673475 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxfgn\" (UniqueName: \"kubernetes.io/projected/b25ab30a-6059-4bf4-b812-add6a4ab09ec-kube-api-access-jxfgn\") pod \"opendatahub-operator-controller-manager-b4b98c894-rknhq\" (UID: \"b25ab30a-6059-4bf4-b812-add6a4ab09ec\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-rknhq" Jul 09 01:42:10.673703 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.673610 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b25ab30a-6059-4bf4-b812-add6a4ab09ec-webhook-cert\") pod \"opendatahub-operator-controller-manager-b4b98c894-rknhq\" (UID: \"b25ab30a-6059-4bf4-b812-add6a4ab09ec\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-rknhq" Jul 09 01:42:10.673703 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.673674 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b25ab30a-6059-4bf4-b812-add6a4ab09ec-tmp\") pod \"opendatahub-operator-controller-manager-b4b98c894-rknhq\" (UID: \"b25ab30a-6059-4bf4-b812-add6a4ab09ec\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-rknhq" Jul 09 01:42:10.673926 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.673907 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b25ab30a-6059-4bf4-b812-add6a4ab09ec-manifests\") pod \"opendatahub-operator-controller-manager-b4b98c894-rknhq\" (UID: \"b25ab30a-6059-4bf4-b812-add6a4ab09ec\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-rknhq" Jul 09 01:42:10.675860 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.675838 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b25ab30a-6059-4bf4-b812-add6a4ab09ec-tmp\") pod \"opendatahub-operator-controller-manager-b4b98c894-rknhq\" (UID: \"b25ab30a-6059-4bf4-b812-add6a4ab09ec\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-rknhq" Jul 09 01:42:10.675998 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.675933 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b25ab30a-6059-4bf4-b812-add6a4ab09ec-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b4b98c894-rknhq\" (UID: \"b25ab30a-6059-4bf4-b812-add6a4ab09ec\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-rknhq" Jul 09 01:42:10.676173 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.676153 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b25ab30a-6059-4bf4-b812-add6a4ab09ec-webhook-cert\") pod \"opendatahub-operator-controller-manager-b4b98c894-rknhq\" (UID: \"b25ab30a-6059-4bf4-b812-add6a4ab09ec\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-rknhq" Jul 09 01:42:10.682882 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.682857 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxfgn\" (UniqueName: \"kubernetes.io/projected/b25ab30a-6059-4bf4-b812-add6a4ab09ec-kube-api-access-jxfgn\") pod \"opendatahub-operator-controller-manager-b4b98c894-rknhq\" (UID: \"b25ab30a-6059-4bf4-b812-add6a4ab09ec\") " pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-rknhq" Jul 09 01:42:10.792456 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.792372 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-rknhq" Jul 09 01:42:10.929828 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:10.929802 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b4b98c894-rknhq"] Jul 09 01:42:10.932686 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:42:10.932660 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb25ab30a_6059_4bf4_b812_add6a4ab09ec.slice/crio-4d81a6ff49bd80ce589b56b6cbf186780883f2bb8af21287a095b96ccf2fae30 WatchSource:0}: Error finding container 4d81a6ff49bd80ce589b56b6cbf186780883f2bb8af21287a095b96ccf2fae30: Status 404 returned error can't find the container with id 4d81a6ff49bd80ce589b56b6cbf186780883f2bb8af21287a095b96ccf2fae30 Jul 09 01:42:11.119604 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:11.119517 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-rknhq" event={"ID":"b25ab30a-6059-4bf4-b812-add6a4ab09ec","Type":"ContainerStarted","Data":"4d81a6ff49bd80ce589b56b6cbf186780883f2bb8af21287a095b96ccf2fae30"} Jul 09 01:42:14.134755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:14.134714 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-rknhq" event={"ID":"b25ab30a-6059-4bf4-b812-add6a4ab09ec","Type":"ContainerStarted","Data":"fc5d0fcc19332f1fd13ca2c7205c865f4b42c4420f40d21839b6dc2904d6028d"} Jul 09 01:42:15.140255 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:15.140201 2564 generic.go:356] "Generic (PLEG): container finished" podID="b25ab30a-6059-4bf4-b812-add6a4ab09ec" containerID="fc5d0fcc19332f1fd13ca2c7205c865f4b42c4420f40d21839b6dc2904d6028d" exitCode=0 Jul 09 01:42:15.140625 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:15.140283 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-rknhq" event={"ID":"b25ab30a-6059-4bf4-b812-add6a4ab09ec","Type":"ContainerDied","Data":"fc5d0fcc19332f1fd13ca2c7205c865f4b42c4420f40d21839b6dc2904d6028d"} Jul 09 01:42:16.147390 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:16.147352 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-rknhq" event={"ID":"b25ab30a-6059-4bf4-b812-add6a4ab09ec","Type":"ContainerStarted","Data":"600c51daa7d370ff6775d7d7d71c33fa313797ba8a24b71888caaf25be984123"} Jul 09 01:42:16.147791 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:16.147430 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-rknhq" Jul 09 01:42:16.170303 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:16.170221 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-rknhq" podStartSLOduration=1.8767435099999998 podStartE2EDuration="6.170199394s" totalImagesPullingTime="3.285240016s" totalInitContainerRuntime="1.008215868s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:42:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:42:16.168696688 +0000 UTC m=+268.830434181" watchObservedRunningTime="2026-07-09 01:42:16.170199394 +0000 UTC m=+268.831936888" Jul 09 01:42:27.154470 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:27.154441 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b4b98c894-rknhq" Jul 09 01:42:30.898463 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:30.898422 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5dd66d5ffd-wrrbr"] Jul 09 01:42:30.907330 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:30.907297 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5dd66d5ffd-wrrbr" Jul 09 01:42:30.911002 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:30.910974 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 09 01:42:30.911169 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:30.911028 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 09 01:42:30.911169 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:30.911028 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-hz776\"" Jul 09 01:42:30.920194 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:30.920167 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5dd66d5ffd-wrrbr"] Jul 09 01:42:31.028899 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:31.028862 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gj4kh"] Jul 09 01:42:31.032356 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:31.032339 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-gj4kh" Jul 09 01:42:31.037403 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:31.037381 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 09 01:42:31.037551 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:31.037474 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-jpxxs\"" Jul 09 01:42:31.047150 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:31.047125 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gj4kh"] Jul 09 01:42:31.051937 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:31.051916 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1632a632-f6fa-4719-b641-a855966a7469-tmp\") pod \"kube-auth-proxy-5dd66d5ffd-wrrbr\" (UID: \"1632a632-f6fa-4719-b641-a855966a7469\") " pod="openshift-ingress/kube-auth-proxy-5dd66d5ffd-wrrbr" Jul 09 01:42:31.052054 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:31.051963 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqtbb\" (UniqueName: \"kubernetes.io/projected/1632a632-f6fa-4719-b641-a855966a7469-kube-api-access-pqtbb\") pod \"kube-auth-proxy-5dd66d5ffd-wrrbr\" (UID: \"1632a632-f6fa-4719-b641-a855966a7469\") " pod="openshift-ingress/kube-auth-proxy-5dd66d5ffd-wrrbr" Jul 09 01:42:31.052054 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:31.052035 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1632a632-f6fa-4719-b641-a855966a7469-tls-certs\") pod \"kube-auth-proxy-5dd66d5ffd-wrrbr\" (UID: \"1632a632-f6fa-4719-b641-a855966a7469\") " pod="openshift-ingress/kube-auth-proxy-5dd66d5ffd-wrrbr" Jul 09 01:42:31.153555 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:31.153474 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqtbb\" (UniqueName: \"kubernetes.io/projected/1632a632-f6fa-4719-b641-a855966a7469-kube-api-access-pqtbb\") pod \"kube-auth-proxy-5dd66d5ffd-wrrbr\" (UID: \"1632a632-f6fa-4719-b641-a855966a7469\") " pod="openshift-ingress/kube-auth-proxy-5dd66d5ffd-wrrbr" Jul 09 01:42:31.153555 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:31.153522 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1632a632-f6fa-4719-b641-a855966a7469-tls-certs\") pod \"kube-auth-proxy-5dd66d5ffd-wrrbr\" (UID: \"1632a632-f6fa-4719-b641-a855966a7469\") " pod="openshift-ingress/kube-auth-proxy-5dd66d5ffd-wrrbr" Jul 09 01:42:31.153555 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:31.153550 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1dbf02f3-3602-4c1a-8e62-e053e932d9fa-cert\") pod \"odh-model-controller-7998c67dc4-gj4kh\" (UID: \"1dbf02f3-3602-4c1a-8e62-e053e932d9fa\") " pod="opendatahub/odh-model-controller-7998c67dc4-gj4kh" Jul 09 01:42:31.153787 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:31.153569 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzrfd\" (UniqueName: \"kubernetes.io/projected/1dbf02f3-3602-4c1a-8e62-e053e932d9fa-kube-api-access-qzrfd\") pod \"odh-model-controller-7998c67dc4-gj4kh\" (UID: \"1dbf02f3-3602-4c1a-8e62-e053e932d9fa\") " pod="opendatahub/odh-model-controller-7998c67dc4-gj4kh" Jul 09 01:42:31.153787 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:31.153602 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1632a632-f6fa-4719-b641-a855966a7469-tmp\") pod \"kube-auth-proxy-5dd66d5ffd-wrrbr\" (UID: \"1632a632-f6fa-4719-b641-a855966a7469\") " pod="openshift-ingress/kube-auth-proxy-5dd66d5ffd-wrrbr" Jul 09 01:42:31.155805 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:31.155775 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1632a632-f6fa-4719-b641-a855966a7469-tmp\") pod \"kube-auth-proxy-5dd66d5ffd-wrrbr\" (UID: \"1632a632-f6fa-4719-b641-a855966a7469\") " pod="openshift-ingress/kube-auth-proxy-5dd66d5ffd-wrrbr" Jul 09 01:42:31.156013 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:31.155995 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1632a632-f6fa-4719-b641-a855966a7469-tls-certs\") pod \"kube-auth-proxy-5dd66d5ffd-wrrbr\" (UID: \"1632a632-f6fa-4719-b641-a855966a7469\") " pod="openshift-ingress/kube-auth-proxy-5dd66d5ffd-wrrbr" Jul 09 01:42:31.161959 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:31.161929 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqtbb\" (UniqueName: \"kubernetes.io/projected/1632a632-f6fa-4719-b641-a855966a7469-kube-api-access-pqtbb\") pod \"kube-auth-proxy-5dd66d5ffd-wrrbr\" (UID: \"1632a632-f6fa-4719-b641-a855966a7469\") " pod="openshift-ingress/kube-auth-proxy-5dd66d5ffd-wrrbr" Jul 09 01:42:31.218198 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:31.218168 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5dd66d5ffd-wrrbr" Jul 09 01:42:31.255004 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:31.254957 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1dbf02f3-3602-4c1a-8e62-e053e932d9fa-cert\") pod \"odh-model-controller-7998c67dc4-gj4kh\" (UID: \"1dbf02f3-3602-4c1a-8e62-e053e932d9fa\") " pod="opendatahub/odh-model-controller-7998c67dc4-gj4kh" Jul 09 01:42:31.255138 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:42:31.255093 2564 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 09 01:42:31.255138 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:31.255104 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzrfd\" (UniqueName: \"kubernetes.io/projected/1dbf02f3-3602-4c1a-8e62-e053e932d9fa-kube-api-access-qzrfd\") pod \"odh-model-controller-7998c67dc4-gj4kh\" (UID: \"1dbf02f3-3602-4c1a-8e62-e053e932d9fa\") " pod="opendatahub/odh-model-controller-7998c67dc4-gj4kh" Jul 09 01:42:31.255253 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:42:31.255191 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dbf02f3-3602-4c1a-8e62-e053e932d9fa-cert podName:1dbf02f3-3602-4c1a-8e62-e053e932d9fa nodeName:}" failed. No retries permitted until 2026-07-09 01:42:31.755163676 +0000 UTC m=+284.416901150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1dbf02f3-3602-4c1a-8e62-e053e932d9fa-cert") pod "odh-model-controller-7998c67dc4-gj4kh" (UID: "1dbf02f3-3602-4c1a-8e62-e053e932d9fa") : secret "odh-model-controller-webhook-cert" not found Jul 09 01:42:31.264504 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:31.264477 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzrfd\" (UniqueName: \"kubernetes.io/projected/1dbf02f3-3602-4c1a-8e62-e053e932d9fa-kube-api-access-qzrfd\") pod \"odh-model-controller-7998c67dc4-gj4kh\" (UID: \"1dbf02f3-3602-4c1a-8e62-e053e932d9fa\") " pod="opendatahub/odh-model-controller-7998c67dc4-gj4kh" Jul 09 01:42:31.358916 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:31.358880 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5dd66d5ffd-wrrbr"] Jul 09 01:42:31.362093 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:42:31.362065 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1632a632_f6fa_4719_b641_a855966a7469.slice/crio-e15511162f3b2bf19cf2ee929b0b576a1736fdca293d057979d2a65916e69e2c WatchSource:0}: Error finding container e15511162f3b2bf19cf2ee929b0b576a1736fdca293d057979d2a65916e69e2c: Status 404 returned error can't find the container with id e15511162f3b2bf19cf2ee929b0b576a1736fdca293d057979d2a65916e69e2c Jul 09 01:42:31.759980 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:31.759942 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1dbf02f3-3602-4c1a-8e62-e053e932d9fa-cert\") pod \"odh-model-controller-7998c67dc4-gj4kh\" (UID: \"1dbf02f3-3602-4c1a-8e62-e053e932d9fa\") " pod="opendatahub/odh-model-controller-7998c67dc4-gj4kh" Jul 09 01:42:31.762353 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:31.762325 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1dbf02f3-3602-4c1a-8e62-e053e932d9fa-cert\") pod \"odh-model-controller-7998c67dc4-gj4kh\" (UID: \"1dbf02f3-3602-4c1a-8e62-e053e932d9fa\") " pod="opendatahub/odh-model-controller-7998c67dc4-gj4kh" Jul 09 01:42:31.942325 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:31.942286 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-gj4kh" Jul 09 01:42:31.953585 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:31.953556 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-j9dlv"] Jul 09 01:42:31.957298 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:31.957275 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-j9dlv" Jul 09 01:42:31.960450 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:31.960412 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-x9kqp\"" Jul 09 01:42:31.960925 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:31.960907 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 09 01:42:31.970835 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:31.970798 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-j9dlv"] Jul 09 01:42:32.062971 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.061622 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvnw6\" (UniqueName: \"kubernetes.io/projected/534db92b-5570-45b7-bccc-bc63df445251-kube-api-access-wvnw6\") pod \"model-serving-api-54d89bd5fc-j9dlv\" (UID: \"534db92b-5570-45b7-bccc-bc63df445251\") " pod="opendatahub/model-serving-api-54d89bd5fc-j9dlv" Jul 09 01:42:32.062971 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.061711 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/534db92b-5570-45b7-bccc-bc63df445251-tls-certs\") pod \"model-serving-api-54d89bd5fc-j9dlv\" (UID: \"534db92b-5570-45b7-bccc-bc63df445251\") " pod="opendatahub/model-serving-api-54d89bd5fc-j9dlv" Jul 09 01:42:32.086903 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.086875 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gj4kh"] Jul 09 01:42:32.088781 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:42:32.088747 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dbf02f3_3602_4c1a_8e62_e053e932d9fa.slice/crio-d27b8b6b694e1839ab0e5d5a413194df1e72fbba5c75b76d53b873c11078c0dc WatchSource:0}: Error finding container d27b8b6b694e1839ab0e5d5a413194df1e72fbba5c75b76d53b873c11078c0dc: Status 404 returned error can't find the container with id d27b8b6b694e1839ab0e5d5a413194df1e72fbba5c75b76d53b873c11078c0dc Jul 09 01:42:32.162748 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.162705 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvnw6\" (UniqueName: \"kubernetes.io/projected/534db92b-5570-45b7-bccc-bc63df445251-kube-api-access-wvnw6\") pod \"model-serving-api-54d89bd5fc-j9dlv\" (UID: \"534db92b-5570-45b7-bccc-bc63df445251\") " pod="opendatahub/model-serving-api-54d89bd5fc-j9dlv" Jul 09 01:42:32.162946 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.162777 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/534db92b-5570-45b7-bccc-bc63df445251-tls-certs\") pod \"model-serving-api-54d89bd5fc-j9dlv\" (UID: \"534db92b-5570-45b7-bccc-bc63df445251\") " pod="opendatahub/model-serving-api-54d89bd5fc-j9dlv" Jul 09 01:42:32.166129 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.166091 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/534db92b-5570-45b7-bccc-bc63df445251-tls-certs\") pod \"model-serving-api-54d89bd5fc-j9dlv\" (UID: \"534db92b-5570-45b7-bccc-bc63df445251\") " pod="opendatahub/model-serving-api-54d89bd5fc-j9dlv" Jul 09 01:42:32.177762 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.177729 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvnw6\" (UniqueName: \"kubernetes.io/projected/534db92b-5570-45b7-bccc-bc63df445251-kube-api-access-wvnw6\") pod \"model-serving-api-54d89bd5fc-j9dlv\" (UID: \"534db92b-5570-45b7-bccc-bc63df445251\") " pod="opendatahub/model-serving-api-54d89bd5fc-j9dlv" Jul 09 01:42:32.221566 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.221518 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5dd66d5ffd-wrrbr" event={"ID":"1632a632-f6fa-4719-b641-a855966a7469","Type":"ContainerStarted","Data":"e15511162f3b2bf19cf2ee929b0b576a1736fdca293d057979d2a65916e69e2c"} Jul 09 01:42:32.222838 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.222810 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-gj4kh" event={"ID":"1dbf02f3-3602-4c1a-8e62-e053e932d9fa","Type":"ContainerStarted","Data":"d27b8b6b694e1839ab0e5d5a413194df1e72fbba5c75b76d53b873c11078c0dc"} Jul 09 01:42:32.272353 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.272130 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-j9dlv" Jul 09 01:42:32.274559 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.274529 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp"] Jul 09 01:42:32.278204 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.278165 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" Jul 09 01:42:32.280743 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.280686 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 09 01:42:32.280960 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.280934 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 09 01:42:32.281139 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.281123 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 01:42:32.281368 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.281350 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-wjg6j\"" Jul 09 01:42:32.281647 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.281628 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 09 01:42:32.294877 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.294834 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp"] Jul 09 01:42:32.364617 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.364578 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwtf7\" (UniqueName: \"kubernetes.io/projected/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-kube-api-access-jwtf7\") pod \"istiod-openshift-gateway-7574459656-qdjlp\" (UID: \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" Jul 09 01:42:32.364778 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.364640 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-istio-token\") pod \"istiod-openshift-gateway-7574459656-qdjlp\" (UID: \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" Jul 09 01:42:32.364778 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.364714 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-local-certs\") pod \"istiod-openshift-gateway-7574459656-qdjlp\" (UID: \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" Jul 09 01:42:32.364778 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.364764 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-qdjlp\" (UID: \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" Jul 09 01:42:32.364886 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.364855 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-cacerts\") pod \"istiod-openshift-gateway-7574459656-qdjlp\" (UID: \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" Jul 09 01:42:32.364940 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.364920 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-qdjlp\" (UID: \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" Jul 09 01:42:32.364996 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.364982 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-qdjlp\" (UID: \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" Jul 09 01:42:32.439556 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.439462 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-j9dlv"] Jul 09 01:42:32.442381 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:42:32.442351 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod534db92b_5570_45b7_bccc_bc63df445251.slice/crio-06672abb42eaa3f9f8895ab93400d9137141f9772735291d535e800e56df8c69 WatchSource:0}: Error finding container 06672abb42eaa3f9f8895ab93400d9137141f9772735291d535e800e56df8c69: Status 404 returned error can't find the container with id 06672abb42eaa3f9f8895ab93400d9137141f9772735291d535e800e56df8c69 Jul 09 01:42:32.466063 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.466026 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-istio-token\") pod \"istiod-openshift-gateway-7574459656-qdjlp\" (UID: \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" Jul 09 01:42:32.466063 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.466068 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-local-certs\") pod \"istiod-openshift-gateway-7574459656-qdjlp\" (UID: \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" Jul 09 01:42:32.466325 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.466094 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-qdjlp\" (UID: \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" Jul 09 01:42:32.466325 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.466136 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-cacerts\") pod \"istiod-openshift-gateway-7574459656-qdjlp\" (UID: \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" Jul 09 01:42:32.466325 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.466179 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-qdjlp\" (UID: \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" Jul 09 01:42:32.466325 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.466210 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-qdjlp\" (UID: \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" Jul 09 01:42:32.466325 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.466249 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwtf7\" (UniqueName: \"kubernetes.io/projected/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-kube-api-access-jwtf7\") pod \"istiod-openshift-gateway-7574459656-qdjlp\" (UID: \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" Jul 09 01:42:32.467086 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.467038 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-qdjlp\" (UID: \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" Jul 09 01:42:32.469177 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.469149 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-qdjlp\" (UID: \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" Jul 09 01:42:32.469527 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.469500 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-cacerts\") pod \"istiod-openshift-gateway-7574459656-qdjlp\" (UID: \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" Jul 09 01:42:32.469995 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.469951 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-local-certs\") pod \"istiod-openshift-gateway-7574459656-qdjlp\" (UID: \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" Jul 09 01:42:32.470145 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.470123 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-qdjlp\" (UID: \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" Jul 09 01:42:32.474890 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.474859 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-istio-token\") pod \"istiod-openshift-gateway-7574459656-qdjlp\" (UID: \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" Jul 09 01:42:32.475384 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.475353 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwtf7\" (UniqueName: \"kubernetes.io/projected/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-kube-api-access-jwtf7\") pod \"istiod-openshift-gateway-7574459656-qdjlp\" (UID: \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" Jul 09 01:42:32.611865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.611781 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" Jul 09 01:42:32.766154 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:32.766120 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp"] Jul 09 01:42:32.767939 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:42:32.767911 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd21e16af_a55b_4c9c_80a7_fbb72e2d91e6.slice/crio-82404a3996e3bab1b8c8a6badca9cbc41ae070139e113fce3fc5f785f1847a6a WatchSource:0}: Error finding container 82404a3996e3bab1b8c8a6badca9cbc41ae070139e113fce3fc5f785f1847a6a: Status 404 returned error can't find the container with id 82404a3996e3bab1b8c8a6badca9cbc41ae070139e113fce3fc5f785f1847a6a Jul 09 01:42:33.231727 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:33.231623 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" event={"ID":"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6","Type":"ContainerStarted","Data":"82404a3996e3bab1b8c8a6badca9cbc41ae070139e113fce3fc5f785f1847a6a"} Jul 09 01:42:33.234006 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:33.233920 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-j9dlv" event={"ID":"534db92b-5570-45b7-bccc-bc63df445251","Type":"ContainerStarted","Data":"06672abb42eaa3f9f8895ab93400d9137141f9772735291d535e800e56df8c69"} Jul 09 01:42:37.464649 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:37.464616 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 01:42:37.464931 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:37.464695 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 01:42:38.264522 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:38.264467 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5dd66d5ffd-wrrbr" event={"ID":"1632a632-f6fa-4719-b641-a855966a7469","Type":"ContainerStarted","Data":"f2465217415d4ea0b1cbe68046ed66b8d7010e07a964a7c13379b3ef8c2810ec"} Jul 09 01:42:38.266460 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:38.266425 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" event={"ID":"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6","Type":"ContainerStarted","Data":"c5e3ef2ffa923ec1bd6c3708a264cd65874c8b77f1e806c57a76f182d72b4f39"} Jul 09 01:42:38.266587 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:38.266563 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" Jul 09 01:42:38.268372 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:38.268332 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-j9dlv" event={"ID":"534db92b-5570-45b7-bccc-bc63df445251","Type":"ContainerStarted","Data":"7b1bb18928a1d6c9839fd051db3cbc44402cfda2ed6e2e8c70a02fdbb92fec92"} Jul 09 01:42:38.268495 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:38.268468 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-j9dlv" Jul 09 01:42:38.268703 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:38.268676 2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-qdjlp container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 01:42:38.268813 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:38.268725 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" podUID="d21e16af-a55b-4c9c-80a7-fbb72e2d91e6" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 01:42:38.269906 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:38.269877 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-gj4kh" event={"ID":"1dbf02f3-3602-4c1a-8e62-e053e932d9fa","Type":"ContainerStarted","Data":"c3ee082550a71406effdbd3a157b780028cbb949f404f096480b301474ecfe21"} Jul 09 01:42:38.270088 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:38.270066 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-gj4kh" Jul 09 01:42:38.309389 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:38.309341 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-gj4kh" podStartSLOduration=1.9296075400000001 podStartE2EDuration="7.309326269s" totalImagesPullingTime="5.379718729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:42:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:42:38.307418784 +0000 UTC m=+290.969156276" watchObservedRunningTime="2026-07-09 01:42:38.309326269 +0000 UTC m=+290.971063761" Jul 09 01:42:38.309958 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:38.309921 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5dd66d5ffd-wrrbr" podStartSLOduration=2.218183169 podStartE2EDuration="8.309910351s" totalImagesPullingTime="6.091727182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:42:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:42:38.291529889 +0000 UTC m=+290.953267384" watchObservedRunningTime="2026-07-09 01:42:38.309910351 +0000 UTC m=+290.971647843" Jul 09 01:42:38.330113 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:38.330053 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" podStartSLOduration=1.636615778 podStartE2EDuration="6.330035061s" totalImagesPullingTime="4.693419283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:42:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:42:38.328903625 +0000 UTC m=+290.990641122" watchObservedRunningTime="2026-07-09 01:42:38.330035061 +0000 UTC m=+290.991772554" Jul 09 01:42:38.347764 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:38.347714 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-j9dlv" podStartSLOduration=2.332192213 podStartE2EDuration="7.347693506s" totalImagesPullingTime="5.015501293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:42:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:42:38.345816514 +0000 UTC m=+291.007554006" watchObservedRunningTime="2026-07-09 01:42:38.347693506 +0000 UTC m=+291.009430999" Jul 09 01:42:39.275559 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:39.275530 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" Jul 09 01:42:41.198551 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:41.198515 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2"] Jul 09 01:42:41.201669 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:41.201646 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2" Jul 09 01:42:41.217708 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:41.217682 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2"] Jul 09 01:42:41.349185 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:41.349148 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ccba7d12-5239-4d85-96c1-d5f54f26e905-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-ws7j2\" (UID: \"ccba7d12-5239-4d85-96c1-d5f54f26e905\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2" Jul 09 01:42:41.349474 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:41.349210 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ccba7d12-5239-4d85-96c1-d5f54f26e905-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-ws7j2\" (UID: \"ccba7d12-5239-4d85-96c1-d5f54f26e905\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2" Jul 09 01:42:41.349474 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:41.349272 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccba7d12-5239-4d85-96c1-d5f54f26e905-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-ws7j2\" (UID: \"ccba7d12-5239-4d85-96c1-d5f54f26e905\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2" Jul 09 01:42:41.349474 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:41.349316 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ccba7d12-5239-4d85-96c1-d5f54f26e905-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-ws7j2\" (UID: \"ccba7d12-5239-4d85-96c1-d5f54f26e905\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2" Jul 09 01:42:41.349474 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:41.349336 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ccba7d12-5239-4d85-96c1-d5f54f26e905-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-ws7j2\" (UID: \"ccba7d12-5239-4d85-96c1-d5f54f26e905\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2" Jul 09 01:42:41.349474 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:41.349357 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fmw9\" (UniqueName: \"kubernetes.io/projected/ccba7d12-5239-4d85-96c1-d5f54f26e905-kube-api-access-2fmw9\") pod \"istiod-openshift-gateway-94bb8fbfd-ws7j2\" (UID: \"ccba7d12-5239-4d85-96c1-d5f54f26e905\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2" Jul 09 01:42:41.349474 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:41.349383 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccba7d12-5239-4d85-96c1-d5f54f26e905-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-ws7j2\" (UID: \"ccba7d12-5239-4d85-96c1-d5f54f26e905\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2" Jul 09 01:42:41.450132 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:41.450045 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fmw9\" (UniqueName: \"kubernetes.io/projected/ccba7d12-5239-4d85-96c1-d5f54f26e905-kube-api-access-2fmw9\") pod \"istiod-openshift-gateway-94bb8fbfd-ws7j2\" (UID: \"ccba7d12-5239-4d85-96c1-d5f54f26e905\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2" Jul 09 01:42:41.450132 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:41.450101 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccba7d12-5239-4d85-96c1-d5f54f26e905-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-ws7j2\" (UID: \"ccba7d12-5239-4d85-96c1-d5f54f26e905\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2" Jul 09 01:42:41.450393 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:41.450144 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ccba7d12-5239-4d85-96c1-d5f54f26e905-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-ws7j2\" (UID: \"ccba7d12-5239-4d85-96c1-d5f54f26e905\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2" Jul 09 01:42:41.450393 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:41.450189 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ccba7d12-5239-4d85-96c1-d5f54f26e905-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-ws7j2\" (UID: \"ccba7d12-5239-4d85-96c1-d5f54f26e905\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2" Jul 09 01:42:41.450393 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:41.450227 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccba7d12-5239-4d85-96c1-d5f54f26e905-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-ws7j2\" (UID: \"ccba7d12-5239-4d85-96c1-d5f54f26e905\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2" Jul 09 01:42:41.450393 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:41.450301 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ccba7d12-5239-4d85-96c1-d5f54f26e905-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-ws7j2\" (UID: \"ccba7d12-5239-4d85-96c1-d5f54f26e905\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2" Jul 09 01:42:41.450595 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:41.450483 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ccba7d12-5239-4d85-96c1-d5f54f26e905-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-ws7j2\" (UID: \"ccba7d12-5239-4d85-96c1-d5f54f26e905\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2" Jul 09 01:42:41.451357 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:41.451287 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ccba7d12-5239-4d85-96c1-d5f54f26e905-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-ws7j2\" (UID: \"ccba7d12-5239-4d85-96c1-d5f54f26e905\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2" Jul 09 01:42:41.452614 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:41.452587 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccba7d12-5239-4d85-96c1-d5f54f26e905-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-ws7j2\" (UID: \"ccba7d12-5239-4d85-96c1-d5f54f26e905\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2" Jul 09 01:42:41.452759 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:41.452740 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ccba7d12-5239-4d85-96c1-d5f54f26e905-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-ws7j2\" (UID: \"ccba7d12-5239-4d85-96c1-d5f54f26e905\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2" Jul 09 01:42:41.452800 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:41.452744 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ccba7d12-5239-4d85-96c1-d5f54f26e905-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-ws7j2\" (UID: \"ccba7d12-5239-4d85-96c1-d5f54f26e905\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2" Jul 09 01:42:41.452858 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:41.452836 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ccba7d12-5239-4d85-96c1-d5f54f26e905-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-ws7j2\" (UID: \"ccba7d12-5239-4d85-96c1-d5f54f26e905\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2" Jul 09 01:42:41.460453 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:41.460431 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fmw9\" (UniqueName: \"kubernetes.io/projected/ccba7d12-5239-4d85-96c1-d5f54f26e905-kube-api-access-2fmw9\") pod \"istiod-openshift-gateway-94bb8fbfd-ws7j2\" (UID: \"ccba7d12-5239-4d85-96c1-d5f54f26e905\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2" Jul 09 01:42:41.469021 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:41.468998 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccba7d12-5239-4d85-96c1-d5f54f26e905-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-ws7j2\" (UID: \"ccba7d12-5239-4d85-96c1-d5f54f26e905\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2" Jul 09 01:42:41.510893 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:41.510858 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2" Jul 09 01:42:41.679805 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:41.679774 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2"] Jul 09 01:42:41.682830 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:42:41.682803 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccba7d12_5239_4d85_96c1_d5f54f26e905.slice/crio-9fc2ae8d5e0717e9c8a126e44903f143bca58fa08f5fd0bdf5af0d12b513d2df WatchSource:0}: Error finding container 9fc2ae8d5e0717e9c8a126e44903f143bca58fa08f5fd0bdf5af0d12b513d2df: Status 404 returned error can't find the container with id 9fc2ae8d5e0717e9c8a126e44903f143bca58fa08f5fd0bdf5af0d12b513d2df Jul 09 01:42:41.686442 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:41.686408 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 01:42:41.686527 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:41.686467 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 01:42:42.291445 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:42.291406 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2" event={"ID":"ccba7d12-5239-4d85-96c1-d5f54f26e905","Type":"ContainerStarted","Data":"95c602a0e818ceaeae5a7606e2731f6d68d5c52ee1525acf7d857fb5a373b202"} Jul 09 01:42:42.291947 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:42.291468 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2" event={"ID":"ccba7d12-5239-4d85-96c1-d5f54f26e905","Type":"ContainerStarted","Data":"9fc2ae8d5e0717e9c8a126e44903f143bca58fa08f5fd0bdf5af0d12b513d2df"} Jul 09 01:42:42.291947 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:42.291497 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2" Jul 09 01:42:42.292949 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:42.292917 2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-ws7j2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 01:42:42.293072 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:42.292984 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2" podUID="ccba7d12-5239-4d85-96c1-d5f54f26e905" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 01:42:42.324289 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:42.324208 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2" podStartSLOduration=1.324188959 podStartE2EDuration="1.324188959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:42:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:42:42.323062337 +0000 UTC m=+294.984799830" watchObservedRunningTime="2026-07-09 01:42:42.324188959 +0000 UTC m=+294.985926451" Jul 09 01:42:43.297330 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:43.297294 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ws7j2" Jul 09 01:42:43.412907 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:43.412874 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp"] Jul 09 01:42:43.413071 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:43.413052 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" podUID="d21e16af-a55b-4c9c-80a7-fbb72e2d91e6" containerName="discovery" containerID="cri-o://c5e3ef2ffa923ec1bd6c3708a264cd65874c8b77f1e806c57a76f182d72b4f39" gracePeriod=30 Jul 09 01:42:43.660427 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:43.660405 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" Jul 09 01:42:43.669582 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:43.669556 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-istio-token\") pod \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\" (UID: \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\") " Jul 09 01:42:43.669678 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:43.669605 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwtf7\" (UniqueName: \"kubernetes.io/projected/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-kube-api-access-jwtf7\") pod \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\" (UID: \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\") " Jul 09 01:42:43.669678 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:43.669637 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-istio-csr-ca-configmap\") pod \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\" (UID: \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\") " Jul 09 01:42:43.669678 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:43.669668 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-istio-csr-dns-cert\") pod \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\" (UID: \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\") " Jul 09 01:42:43.669836 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:43.669690 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-istio-kubeconfig\") pod \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\" (UID: \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\") " Jul 09 01:42:43.669836 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:43.669718 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-local-certs\") pod \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\" (UID: \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\") " Jul 09 01:42:43.669836 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:43.669777 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-cacerts\") pod \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\" (UID: \"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6\") " Jul 09 01:42:43.670101 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:43.670070 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "d21e16af-a55b-4c9c-80a7-fbb72e2d91e6" (UID: "d21e16af-a55b-4c9c-80a7-fbb72e2d91e6"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 01:42:43.672142 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:43.672107 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-cacerts" (OuterVolumeSpecName: "cacerts") pod "d21e16af-a55b-4c9c-80a7-fbb72e2d91e6" (UID: "d21e16af-a55b-4c9c-80a7-fbb72e2d91e6"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 01:42:43.672271 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:43.672207 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-kube-api-access-jwtf7" (OuterVolumeSpecName: "kube-api-access-jwtf7") pod "d21e16af-a55b-4c9c-80a7-fbb72e2d91e6" (UID: "d21e16af-a55b-4c9c-80a7-fbb72e2d91e6"). InnerVolumeSpecName "kube-api-access-jwtf7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 01:42:43.672345 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:43.672280 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-local-certs" (OuterVolumeSpecName: "local-certs") pod "d21e16af-a55b-4c9c-80a7-fbb72e2d91e6" (UID: "d21e16af-a55b-4c9c-80a7-fbb72e2d91e6"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 01:42:43.672395 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:43.672346 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-istio-token" (OuterVolumeSpecName: "istio-token") pod "d21e16af-a55b-4c9c-80a7-fbb72e2d91e6" (UID: "d21e16af-a55b-4c9c-80a7-fbb72e2d91e6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 01:42:43.672395 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:43.672347 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "d21e16af-a55b-4c9c-80a7-fbb72e2d91e6" (UID: "d21e16af-a55b-4c9c-80a7-fbb72e2d91e6"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 01:42:43.672461 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:43.672427 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "d21e16af-a55b-4c9c-80a7-fbb72e2d91e6" (UID: "d21e16af-a55b-4c9c-80a7-fbb72e2d91e6"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 01:42:43.770507 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:43.770475 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwtf7\" (UniqueName: \"kubernetes.io/projected/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-kube-api-access-jwtf7\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:42:43.770507 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:43.770504 2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-istio-csr-ca-configmap\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:42:43.770507 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:43.770513 2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-istio-csr-dns-cert\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:42:43.770718 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:43.770523 2564 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-istio-kubeconfig\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:42:43.770718 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:43.770541 2564 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-local-certs\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:42:43.770718 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:43.770551 2564 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-cacerts\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:42:43.770718 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:43.770558 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6-istio-token\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:42:44.302417 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:44.302382 2564 generic.go:356] "Generic (PLEG): container finished" podID="d21e16af-a55b-4c9c-80a7-fbb72e2d91e6" containerID="c5e3ef2ffa923ec1bd6c3708a264cd65874c8b77f1e806c57a76f182d72b4f39" exitCode=0 Jul 09 01:42:44.302876 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:44.302433 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" Jul 09 01:42:44.302876 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:44.302462 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" event={"ID":"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6","Type":"ContainerDied","Data":"c5e3ef2ffa923ec1bd6c3708a264cd65874c8b77f1e806c57a76f182d72b4f39"} Jul 09 01:42:44.302876 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:44.302512 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp" event={"ID":"d21e16af-a55b-4c9c-80a7-fbb72e2d91e6","Type":"ContainerDied","Data":"82404a3996e3bab1b8c8a6badca9cbc41ae070139e113fce3fc5f785f1847a6a"} Jul 09 01:42:44.302876 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:44.302532 2564 scope.go:117] "RemoveContainer" containerID="c5e3ef2ffa923ec1bd6c3708a264cd65874c8b77f1e806c57a76f182d72b4f39" Jul 09 01:42:44.310786 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:44.310771 2564 scope.go:117] "RemoveContainer" containerID="c5e3ef2ffa923ec1bd6c3708a264cd65874c8b77f1e806c57a76f182d72b4f39" Jul 09 01:42:44.311069 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:42:44.311051 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5e3ef2ffa923ec1bd6c3708a264cd65874c8b77f1e806c57a76f182d72b4f39\": container with ID starting with c5e3ef2ffa923ec1bd6c3708a264cd65874c8b77f1e806c57a76f182d72b4f39 not found: ID does not exist" containerID="c5e3ef2ffa923ec1bd6c3708a264cd65874c8b77f1e806c57a76f182d72b4f39" Jul 09 01:42:44.311137 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:44.311081 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5e3ef2ffa923ec1bd6c3708a264cd65874c8b77f1e806c57a76f182d72b4f39"} err="failed to get container status \"c5e3ef2ffa923ec1bd6c3708a264cd65874c8b77f1e806c57a76f182d72b4f39\": rpc error: code = NotFound desc = could not find container \"c5e3ef2ffa923ec1bd6c3708a264cd65874c8b77f1e806c57a76f182d72b4f39\": container with ID starting with c5e3ef2ffa923ec1bd6c3708a264cd65874c8b77f1e806c57a76f182d72b4f39 not found: ID does not exist" Jul 09 01:42:44.321216 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:44.321195 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp"] Jul 09 01:42:44.324596 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:44.324574 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qdjlp"] Jul 09 01:42:45.866946 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:45.866913 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d21e16af-a55b-4c9c-80a7-fbb72e2d91e6" path="/var/lib/kubelet/pods/d21e16af-a55b-4c9c-80a7-fbb72e2d91e6/volumes" Jul 09 01:42:47.772493 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:47.772464 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gfhk_3d8307ed-04c9-429e-a83c-7b24847e0a38/console-operator/1.log" Jul 09 01:42:47.778291 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:47.778266 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gfhk_3d8307ed-04c9-429e-a83c-7b24847e0a38/console-operator/1.log" Jul 09 01:42:47.790949 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:47.790924 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 01:42:49.277338 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:49.277304 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-gj4kh" Jul 09 01:42:49.279834 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:42:49.279400 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-j9dlv" Jul 09 01:43:31.829977 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:31.829940 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gc5v6"] Jul 09 01:43:31.830435 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:31.830308 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d21e16af-a55b-4c9c-80a7-fbb72e2d91e6" containerName="discovery" Jul 09 01:43:31.830435 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:31.830320 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d21e16af-a55b-4c9c-80a7-fbb72e2d91e6" containerName="discovery" Jul 09 01:43:31.830435 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:31.830384 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d21e16af-a55b-4c9c-80a7-fbb72e2d91e6" containerName="discovery" Jul 09 01:43:31.833485 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:31.833466 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gc5v6" Jul 09 01:43:31.835712 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:31.835686 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 01:43:31.836432 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:31.836416 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 01:43:31.836523 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:31.836416 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-dxchx\"" Jul 09 01:43:31.843768 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:31.843745 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gc5v6"] Jul 09 01:43:31.989899 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:31.989861 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lkrq\" (UniqueName: \"kubernetes.io/projected/1416cd16-bae3-48fb-b667-17c41652c02e-kube-api-access-9lkrq\") pod \"kuadrant-operator-catalog-gc5v6\" (UID: \"1416cd16-bae3-48fb-b667-17c41652c02e\") " pod="kuadrant-system/kuadrant-operator-catalog-gc5v6" Jul 09 01:43:32.091200 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:32.091119 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lkrq\" (UniqueName: \"kubernetes.io/projected/1416cd16-bae3-48fb-b667-17c41652c02e-kube-api-access-9lkrq\") pod \"kuadrant-operator-catalog-gc5v6\" (UID: \"1416cd16-bae3-48fb-b667-17c41652c02e\") " pod="kuadrant-system/kuadrant-operator-catalog-gc5v6" Jul 09 01:43:32.098453 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:32.098426 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lkrq\" (UniqueName: \"kubernetes.io/projected/1416cd16-bae3-48fb-b667-17c41652c02e-kube-api-access-9lkrq\") pod \"kuadrant-operator-catalog-gc5v6\" (UID: \"1416cd16-bae3-48fb-b667-17c41652c02e\") " pod="kuadrant-system/kuadrant-operator-catalog-gc5v6" Jul 09 01:43:32.144998 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:32.144957 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gc5v6" Jul 09 01:43:32.199680 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:32.199634 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gc5v6"] Jul 09 01:43:32.278409 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:32.278315 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gc5v6"] Jul 09 01:43:32.280819 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:43:32.280788 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1416cd16_bae3_48fb_b667_17c41652c02e.slice/crio-41698dedf11eaeb77d55b9dac1ef2d1f37a3deceadaf3e061cf4330b57346314 WatchSource:0}: Error finding container 41698dedf11eaeb77d55b9dac1ef2d1f37a3deceadaf3e061cf4330b57346314: Status 404 returned error can't find the container with id 41698dedf11eaeb77d55b9dac1ef2d1f37a3deceadaf3e061cf4330b57346314 Jul 09 01:43:32.283478 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:32.282576 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 01:43:32.410023 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:32.409938 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v7wjg"] Jul 09 01:43:32.414361 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:32.414345 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v7wjg" Jul 09 01:43:32.419953 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:32.419930 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v7wjg"] Jul 09 01:43:32.535567 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:32.535530 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gc5v6" event={"ID":"1416cd16-bae3-48fb-b667-17c41652c02e","Type":"ContainerStarted","Data":"41698dedf11eaeb77d55b9dac1ef2d1f37a3deceadaf3e061cf4330b57346314"} Jul 09 01:43:32.596543 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:32.596505 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64lsq\" (UniqueName: \"kubernetes.io/projected/30f13302-171c-4940-855c-319e460fe193-kube-api-access-64lsq\") pod \"kuadrant-operator-catalog-v7wjg\" (UID: \"30f13302-171c-4940-855c-319e460fe193\") " pod="kuadrant-system/kuadrant-operator-catalog-v7wjg" Jul 09 01:43:32.697561 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:32.697531 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64lsq\" (UniqueName: \"kubernetes.io/projected/30f13302-171c-4940-855c-319e460fe193-kube-api-access-64lsq\") pod \"kuadrant-operator-catalog-v7wjg\" (UID: \"30f13302-171c-4940-855c-319e460fe193\") " pod="kuadrant-system/kuadrant-operator-catalog-v7wjg" Jul 09 01:43:32.705748 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:32.705703 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64lsq\" (UniqueName: \"kubernetes.io/projected/30f13302-171c-4940-855c-319e460fe193-kube-api-access-64lsq\") pod \"kuadrant-operator-catalog-v7wjg\" (UID: \"30f13302-171c-4940-855c-319e460fe193\") " pod="kuadrant-system/kuadrant-operator-catalog-v7wjg" Jul 09 01:43:32.724917 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:32.724891 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v7wjg" Jul 09 01:43:32.862600 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:32.862503 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v7wjg"] Jul 09 01:43:32.864955 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:43:32.864928 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f13302_171c_4940_855c_319e460fe193.slice/crio-86e80425c037b61d984879a3843ce0248c9802f560b3185ba26b065cbf462370 WatchSource:0}: Error finding container 86e80425c037b61d984879a3843ce0248c9802f560b3185ba26b065cbf462370: Status 404 returned error can't find the container with id 86e80425c037b61d984879a3843ce0248c9802f560b3185ba26b065cbf462370 Jul 09 01:43:33.542823 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:33.542761 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v7wjg" event={"ID":"30f13302-171c-4940-855c-319e460fe193","Type":"ContainerStarted","Data":"86e80425c037b61d984879a3843ce0248c9802f560b3185ba26b065cbf462370"} Jul 09 01:43:35.554014 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:35.553971 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gc5v6" event={"ID":"1416cd16-bae3-48fb-b667-17c41652c02e","Type":"ContainerStarted","Data":"062a28816e1c84591afd01f0001512f96d045f1c46e1692db24701f5a7024921"} Jul 09 01:43:35.554517 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:35.553980 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-gc5v6" podUID="1416cd16-bae3-48fb-b667-17c41652c02e" containerName="registry-server" containerID="cri-o://062a28816e1c84591afd01f0001512f96d045f1c46e1692db24701f5a7024921" gracePeriod=2 Jul 09 01:43:35.555533 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:35.555507 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v7wjg" event={"ID":"30f13302-171c-4940-855c-319e460fe193","Type":"ContainerStarted","Data":"cb3ad4fb6f8c20a5bcb9bccc480f23efe0e3e3e6eabf1f7e8f5482fbac1bd2b2"} Jul 09 01:43:35.569609 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:35.569568 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-gc5v6" podStartSLOduration=2.189887164 podStartE2EDuration="4.569552435s" totalImagesPullingTime="2.379665271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:43:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:43:35.56808749 +0000 UTC m=+348.229825008" watchObservedRunningTime="2026-07-09 01:43:35.569552435 +0000 UTC m=+348.231289927" Jul 09 01:43:35.582581 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:35.582541 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-v7wjg" podStartSLOduration=1.783442593 podStartE2EDuration="3.582527688s" totalImagesPullingTime="1.799085095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:43:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:43:35.581789019 +0000 UTC m=+348.243526514" watchObservedRunningTime="2026-07-09 01:43:35.582527688 +0000 UTC m=+348.244265181" Jul 09 01:43:35.801360 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:35.801336 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gc5v6" Jul 09 01:43:35.823542 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:35.823483 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lkrq\" (UniqueName: \"kubernetes.io/projected/1416cd16-bae3-48fb-b667-17c41652c02e-kube-api-access-9lkrq\") pod \"1416cd16-bae3-48fb-b667-17c41652c02e\" (UID: \"1416cd16-bae3-48fb-b667-17c41652c02e\") " Jul 09 01:43:35.825553 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:35.825524 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1416cd16-bae3-48fb-b667-17c41652c02e-kube-api-access-9lkrq" (OuterVolumeSpecName: "kube-api-access-9lkrq") pod "1416cd16-bae3-48fb-b667-17c41652c02e" (UID: "1416cd16-bae3-48fb-b667-17c41652c02e"). InnerVolumeSpecName "kube-api-access-9lkrq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 01:43:35.924632 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:35.924594 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lkrq\" (UniqueName: \"kubernetes.io/projected/1416cd16-bae3-48fb-b667-17c41652c02e-kube-api-access-9lkrq\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:43:36.561216 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:36.561182 2564 generic.go:356] "Generic (PLEG): container finished" podID="1416cd16-bae3-48fb-b667-17c41652c02e" containerID="062a28816e1c84591afd01f0001512f96d045f1c46e1692db24701f5a7024921" exitCode=0 Jul 09 01:43:36.561711 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:36.561222 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gc5v6" Jul 09 01:43:36.561711 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:36.561267 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gc5v6" event={"ID":"1416cd16-bae3-48fb-b667-17c41652c02e","Type":"ContainerDied","Data":"062a28816e1c84591afd01f0001512f96d045f1c46e1692db24701f5a7024921"} Jul 09 01:43:36.561711 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:36.561320 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gc5v6" event={"ID":"1416cd16-bae3-48fb-b667-17c41652c02e","Type":"ContainerDied","Data":"41698dedf11eaeb77d55b9dac1ef2d1f37a3deceadaf3e061cf4330b57346314"} Jul 09 01:43:36.561711 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:36.561349 2564 scope.go:117] "RemoveContainer" containerID="062a28816e1c84591afd01f0001512f96d045f1c46e1692db24701f5a7024921" Jul 09 01:43:36.570414 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:36.570400 2564 scope.go:117] "RemoveContainer" containerID="062a28816e1c84591afd01f0001512f96d045f1c46e1692db24701f5a7024921" Jul 09 01:43:36.570643 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:43:36.570626 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"062a28816e1c84591afd01f0001512f96d045f1c46e1692db24701f5a7024921\": container with ID starting with 062a28816e1c84591afd01f0001512f96d045f1c46e1692db24701f5a7024921 not found: ID does not exist" containerID="062a28816e1c84591afd01f0001512f96d045f1c46e1692db24701f5a7024921" Jul 09 01:43:36.570719 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:36.570651 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"062a28816e1c84591afd01f0001512f96d045f1c46e1692db24701f5a7024921"} err="failed to get container status \"062a28816e1c84591afd01f0001512f96d045f1c46e1692db24701f5a7024921\": rpc error: code = NotFound desc = could not find container \"062a28816e1c84591afd01f0001512f96d045f1c46e1692db24701f5a7024921\": container with ID starting with 062a28816e1c84591afd01f0001512f96d045f1c46e1692db24701f5a7024921 not found: ID does not exist" Jul 09 01:43:36.576776 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:36.576753 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gc5v6"] Jul 09 01:43:36.582946 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:36.582927 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gc5v6"] Jul 09 01:43:37.866437 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:37.866403 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1416cd16-bae3-48fb-b667-17c41652c02e" path="/var/lib/kubelet/pods/1416cd16-bae3-48fb-b667-17c41652c02e/volumes" Jul 09 01:43:42.725629 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:42.725548 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-v7wjg" Jul 09 01:43:42.725629 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:42.725602 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-v7wjg" Jul 09 01:43:42.748590 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:42.748552 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-v7wjg" Jul 09 01:43:43.625522 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:43.625497 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-v7wjg" Jul 09 01:43:47.644217 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:47.644178 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4"] Jul 09 01:43:47.644605 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:47.644554 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1416cd16-bae3-48fb-b667-17c41652c02e" containerName="registry-server" Jul 09 01:43:47.644605 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:47.644565 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1416cd16-bae3-48fb-b667-17c41652c02e" containerName="registry-server" Jul 09 01:43:47.644691 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:47.644642 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1416cd16-bae3-48fb-b667-17c41652c02e" containerName="registry-server" Jul 09 01:43:47.647833 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:47.647815 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4" Jul 09 01:43:47.650111 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:47.650093 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9s292\"" Jul 09 01:43:47.655734 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:47.655694 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4"] Jul 09 01:43:47.721658 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:47.721621 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68j79\" (UniqueName: \"kubernetes.io/projected/140b7dbb-97c9-471b-a39b-2c4e69e4dd32-kube-api-access-68j79\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4\" (UID: \"140b7dbb-97c9-471b-a39b-2c4e69e4dd32\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4" Jul 09 01:43:47.721658 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:47.721660 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/140b7dbb-97c9-471b-a39b-2c4e69e4dd32-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4\" (UID: \"140b7dbb-97c9-471b-a39b-2c4e69e4dd32\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4" Jul 09 01:43:47.721868 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:47.721775 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/140b7dbb-97c9-471b-a39b-2c4e69e4dd32-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4\" (UID: \"140b7dbb-97c9-471b-a39b-2c4e69e4dd32\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4" Jul 09 01:43:47.822348 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:47.822319 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68j79\" (UniqueName: \"kubernetes.io/projected/140b7dbb-97c9-471b-a39b-2c4e69e4dd32-kube-api-access-68j79\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4\" (UID: \"140b7dbb-97c9-471b-a39b-2c4e69e4dd32\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4" Jul 09 01:43:47.822460 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:47.822352 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/140b7dbb-97c9-471b-a39b-2c4e69e4dd32-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4\" (UID: \"140b7dbb-97c9-471b-a39b-2c4e69e4dd32\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4" Jul 09 01:43:47.822499 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:47.822483 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/140b7dbb-97c9-471b-a39b-2c4e69e4dd32-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4\" (UID: \"140b7dbb-97c9-471b-a39b-2c4e69e4dd32\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4" Jul 09 01:43:47.822780 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:47.822765 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/140b7dbb-97c9-471b-a39b-2c4e69e4dd32-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4\" (UID: \"140b7dbb-97c9-471b-a39b-2c4e69e4dd32\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4" Jul 09 01:43:47.822819 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:47.822797 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/140b7dbb-97c9-471b-a39b-2c4e69e4dd32-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4\" (UID: \"140b7dbb-97c9-471b-a39b-2c4e69e4dd32\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4" Jul 09 01:43:47.830139 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:47.830119 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68j79\" (UniqueName: \"kubernetes.io/projected/140b7dbb-97c9-471b-a39b-2c4e69e4dd32-kube-api-access-68j79\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4\" (UID: \"140b7dbb-97c9-471b-a39b-2c4e69e4dd32\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4" Jul 09 01:43:47.960380 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:47.960356 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9s292\"" Jul 09 01:43:47.969096 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:47.969080 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4" Jul 09 01:43:48.101797 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:48.101775 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4"] Jul 09 01:43:48.103869 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:43:48.103836 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod140b7dbb_97c9_471b_a39b_2c4e69e4dd32.slice/crio-9f6a90a4938625b0544fb70e033e6b28a3f9a89857764d149fe0670d6350ce5d WatchSource:0}: Error finding container 9f6a90a4938625b0544fb70e033e6b28a3f9a89857764d149fe0670d6350ce5d: Status 404 returned error can't find the container with id 9f6a90a4938625b0544fb70e033e6b28a3f9a89857764d149fe0670d6350ce5d Jul 09 01:43:48.439952 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:48.439921 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg"] Jul 09 01:43:48.443437 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:48.443419 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg" Jul 09 01:43:48.450576 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:48.450517 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg"] Jul 09 01:43:48.529133 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:48.529099 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/575c6260-4c0f-4ff2-bee9-318463bec1de-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg\" (UID: \"575c6260-4c0f-4ff2-bee9-318463bec1de\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg" Jul 09 01:43:48.529322 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:48.529148 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45j7q\" (UniqueName: \"kubernetes.io/projected/575c6260-4c0f-4ff2-bee9-318463bec1de-kube-api-access-45j7q\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg\" (UID: \"575c6260-4c0f-4ff2-bee9-318463bec1de\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg" Jul 09 01:43:48.529322 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:48.529226 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/575c6260-4c0f-4ff2-bee9-318463bec1de-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg\" (UID: \"575c6260-4c0f-4ff2-bee9-318463bec1de\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg" Jul 09 01:43:48.629352 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:48.629318 2564 generic.go:356] "Generic (PLEG): container finished" podID="140b7dbb-97c9-471b-a39b-2c4e69e4dd32" containerID="16dd78042c7875bc48e83f823d2609044e7871828471390a533b43b4fe0fbf19" exitCode=0 Jul 09 01:43:48.629511 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:48.629404 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4" event={"ID":"140b7dbb-97c9-471b-a39b-2c4e69e4dd32","Type":"ContainerDied","Data":"16dd78042c7875bc48e83f823d2609044e7871828471390a533b43b4fe0fbf19"} Jul 09 01:43:48.629511 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:48.629459 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4" event={"ID":"140b7dbb-97c9-471b-a39b-2c4e69e4dd32","Type":"ContainerStarted","Data":"9f6a90a4938625b0544fb70e033e6b28a3f9a89857764d149fe0670d6350ce5d"} Jul 09 01:43:48.629727 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:48.629709 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/575c6260-4c0f-4ff2-bee9-318463bec1de-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg\" (UID: \"575c6260-4c0f-4ff2-bee9-318463bec1de\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg" Jul 09 01:43:48.629765 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:48.629744 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45j7q\" (UniqueName: \"kubernetes.io/projected/575c6260-4c0f-4ff2-bee9-318463bec1de-kube-api-access-45j7q\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg\" (UID: \"575c6260-4c0f-4ff2-bee9-318463bec1de\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg" Jul 09 01:43:48.629803 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:48.629793 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/575c6260-4c0f-4ff2-bee9-318463bec1de-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg\" (UID: \"575c6260-4c0f-4ff2-bee9-318463bec1de\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg" Jul 09 01:43:48.630265 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:48.630160 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/575c6260-4c0f-4ff2-bee9-318463bec1de-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg\" (UID: \"575c6260-4c0f-4ff2-bee9-318463bec1de\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg" Jul 09 01:43:48.630265 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:48.630156 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/575c6260-4c0f-4ff2-bee9-318463bec1de-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg\" (UID: \"575c6260-4c0f-4ff2-bee9-318463bec1de\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg" Jul 09 01:43:48.637907 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:48.637880 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45j7q\" (UniqueName: \"kubernetes.io/projected/575c6260-4c0f-4ff2-bee9-318463bec1de-kube-api-access-45j7q\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg\" (UID: \"575c6260-4c0f-4ff2-bee9-318463bec1de\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg" Jul 09 01:43:48.753889 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:48.753800 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg" Jul 09 01:43:48.848286 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:48.848255 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx"] Jul 09 01:43:48.853628 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:48.853605 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx" Jul 09 01:43:48.856723 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:48.856695 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx"] Jul 09 01:43:48.888906 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:48.888880 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg"] Jul 09 01:43:48.890587 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:43:48.890559 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod575c6260_4c0f_4ff2_bee9_318463bec1de.slice/crio-82a561caff847097e2f14ddb6155c272385df40fbbee98af57269c0187852b5d WatchSource:0}: Error finding container 82a561caff847097e2f14ddb6155c272385df40fbbee98af57269c0187852b5d: Status 404 returned error can't find the container with id 82a561caff847097e2f14ddb6155c272385df40fbbee98af57269c0187852b5d Jul 09 01:43:48.932166 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:48.932141 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8469e54-990a-4600-b631-a0fc592bb7ab-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx\" (UID: \"f8469e54-990a-4600-b631-a0fc592bb7ab\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx" Jul 09 01:43:48.932278 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:48.932208 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6xqq\" (UniqueName: \"kubernetes.io/projected/f8469e54-990a-4600-b631-a0fc592bb7ab-kube-api-access-v6xqq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx\" (UID: \"f8469e54-990a-4600-b631-a0fc592bb7ab\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx" Jul 09 01:43:48.932278 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:48.932256 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8469e54-990a-4600-b631-a0fc592bb7ab-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx\" (UID: \"f8469e54-990a-4600-b631-a0fc592bb7ab\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx" Jul 09 01:43:49.033059 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.033016 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8469e54-990a-4600-b631-a0fc592bb7ab-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx\" (UID: \"f8469e54-990a-4600-b631-a0fc592bb7ab\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx" Jul 09 01:43:49.033199 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.033083 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6xqq\" (UniqueName: \"kubernetes.io/projected/f8469e54-990a-4600-b631-a0fc592bb7ab-kube-api-access-v6xqq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx\" (UID: \"f8469e54-990a-4600-b631-a0fc592bb7ab\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx" Jul 09 01:43:49.033199 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.033112 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8469e54-990a-4600-b631-a0fc592bb7ab-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx\" (UID: \"f8469e54-990a-4600-b631-a0fc592bb7ab\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx" Jul 09 01:43:49.033480 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.033458 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8469e54-990a-4600-b631-a0fc592bb7ab-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx\" (UID: \"f8469e54-990a-4600-b631-a0fc592bb7ab\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx" Jul 09 01:43:49.033480 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.033475 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8469e54-990a-4600-b631-a0fc592bb7ab-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx\" (UID: \"f8469e54-990a-4600-b631-a0fc592bb7ab\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx" Jul 09 01:43:49.041057 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.041037 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6xqq\" (UniqueName: \"kubernetes.io/projected/f8469e54-990a-4600-b631-a0fc592bb7ab-kube-api-access-v6xqq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx\" (UID: \"f8469e54-990a-4600-b631-a0fc592bb7ab\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx" Jul 09 01:43:49.166431 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.166398 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx" Jul 09 01:43:49.244801 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.244770 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z"] Jul 09 01:43:49.248363 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.248343 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z" Jul 09 01:43:49.262607 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.262543 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z"] Jul 09 01:43:49.305169 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.305144 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx"] Jul 09 01:43:49.318004 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:43:49.317973 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8469e54_990a_4600_b631_a0fc592bb7ab.slice/crio-21fece93bfb656d67d98be17285aeb042f07e3de940cdd74226aa09a241455f8 WatchSource:0}: Error finding container 21fece93bfb656d67d98be17285aeb042f07e3de940cdd74226aa09a241455f8: Status 404 returned error can't find the container with id 21fece93bfb656d67d98be17285aeb042f07e3de940cdd74226aa09a241455f8 Jul 09 01:43:49.336991 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.336941 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86de2f78-f661-4a76-bff8-978c4452806d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z\" (UID: \"86de2f78-f661-4a76-bff8-978c4452806d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z" Jul 09 01:43:49.336991 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.336983 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df2vs\" (UniqueName: \"kubernetes.io/projected/86de2f78-f661-4a76-bff8-978c4452806d-kube-api-access-df2vs\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z\" (UID: \"86de2f78-f661-4a76-bff8-978c4452806d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z" Jul 09 01:43:49.337155 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.337015 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86de2f78-f661-4a76-bff8-978c4452806d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z\" (UID: \"86de2f78-f661-4a76-bff8-978c4452806d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z" Jul 09 01:43:49.437749 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.437723 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86de2f78-f661-4a76-bff8-978c4452806d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z\" (UID: \"86de2f78-f661-4a76-bff8-978c4452806d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z" Jul 09 01:43:49.437887 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.437755 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df2vs\" (UniqueName: \"kubernetes.io/projected/86de2f78-f661-4a76-bff8-978c4452806d-kube-api-access-df2vs\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z\" (UID: \"86de2f78-f661-4a76-bff8-978c4452806d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z" Jul 09 01:43:49.437887 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.437777 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86de2f78-f661-4a76-bff8-978c4452806d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z\" (UID: \"86de2f78-f661-4a76-bff8-978c4452806d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z" Jul 09 01:43:49.438136 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.438115 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86de2f78-f661-4a76-bff8-978c4452806d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z\" (UID: \"86de2f78-f661-4a76-bff8-978c4452806d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z" Jul 09 01:43:49.438207 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.438115 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86de2f78-f661-4a76-bff8-978c4452806d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z\" (UID: \"86de2f78-f661-4a76-bff8-978c4452806d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z" Jul 09 01:43:49.446125 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.446098 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-df2vs\" (UniqueName: \"kubernetes.io/projected/86de2f78-f661-4a76-bff8-978c4452806d-kube-api-access-df2vs\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z\" (UID: \"86de2f78-f661-4a76-bff8-978c4452806d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z" Jul 09 01:43:49.562765 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.562696 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z" Jul 09 01:43:49.636919 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.636891 2564 generic.go:356] "Generic (PLEG): container finished" podID="140b7dbb-97c9-471b-a39b-2c4e69e4dd32" containerID="078d09117dd95399718b1323922b60474e6fa091c9256b5e5fb00f7fb56207fa" exitCode=0 Jul 09 01:43:49.637077 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.636932 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4" event={"ID":"140b7dbb-97c9-471b-a39b-2c4e69e4dd32","Type":"ContainerDied","Data":"078d09117dd95399718b1323922b60474e6fa091c9256b5e5fb00f7fb56207fa"} Jul 09 01:43:49.638676 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.638635 2564 generic.go:356] "Generic (PLEG): container finished" podID="f8469e54-990a-4600-b631-a0fc592bb7ab" containerID="f579f789e2a11590fa5ebc3e687cd11f4409b895f6ca3f211a6bd5f666fb1a8e" exitCode=0 Jul 09 01:43:49.638746 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.638709 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx" event={"ID":"f8469e54-990a-4600-b631-a0fc592bb7ab","Type":"ContainerDied","Data":"f579f789e2a11590fa5ebc3e687cd11f4409b895f6ca3f211a6bd5f666fb1a8e"} Jul 09 01:43:49.638818 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.638763 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx" event={"ID":"f8469e54-990a-4600-b631-a0fc592bb7ab","Type":"ContainerStarted","Data":"21fece93bfb656d67d98be17285aeb042f07e3de940cdd74226aa09a241455f8"} Jul 09 01:43:49.640379 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.640355 2564 generic.go:356] "Generic (PLEG): container finished" podID="575c6260-4c0f-4ff2-bee9-318463bec1de" containerID="a54b759c427226c8550d55f529827cf81e0d762dbf11a991e546e3c5415e864f" exitCode=0 Jul 09 01:43:49.640523 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.640432 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg" event={"ID":"575c6260-4c0f-4ff2-bee9-318463bec1de","Type":"ContainerDied","Data":"a54b759c427226c8550d55f529827cf81e0d762dbf11a991e546e3c5415e864f"} Jul 09 01:43:49.640523 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.640516 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg" event={"ID":"575c6260-4c0f-4ff2-bee9-318463bec1de","Type":"ContainerStarted","Data":"82a561caff847097e2f14ddb6155c272385df40fbbee98af57269c0187852b5d"} Jul 09 01:43:49.699649 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:49.699620 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z"] Jul 09 01:43:49.701203 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:43:49.701175 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86de2f78_f661_4a76_bff8_978c4452806d.slice/crio-9efe524f86e96577131621360e27cad295151e675f87aae1d9fb91e6f84115f4 WatchSource:0}: Error finding container 9efe524f86e96577131621360e27cad295151e675f87aae1d9fb91e6f84115f4: Status 404 returned error can't find the container with id 9efe524f86e96577131621360e27cad295151e675f87aae1d9fb91e6f84115f4 Jul 09 01:43:50.649774 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:50.649744 2564 generic.go:356] "Generic (PLEG): container finished" podID="140b7dbb-97c9-471b-a39b-2c4e69e4dd32" containerID="fb62aee8cb15ba9005b0f4e2bd5cdccae1f21dc697628ff97e2c64e040665f05" exitCode=0 Jul 09 01:43:50.650189 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:50.649828 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4" event={"ID":"140b7dbb-97c9-471b-a39b-2c4e69e4dd32","Type":"ContainerDied","Data":"fb62aee8cb15ba9005b0f4e2bd5cdccae1f21dc697628ff97e2c64e040665f05"} Jul 09 01:43:50.651831 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:50.651800 2564 generic.go:356] "Generic (PLEG): container finished" podID="f8469e54-990a-4600-b631-a0fc592bb7ab" containerID="ae8f4836c430bd1b6b40376a07ae0c4abe13b746312ffe6bd629835f08d12933" exitCode=0 Jul 09 01:43:50.651943 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:50.651835 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx" event={"ID":"f8469e54-990a-4600-b631-a0fc592bb7ab","Type":"ContainerDied","Data":"ae8f4836c430bd1b6b40376a07ae0c4abe13b746312ffe6bd629835f08d12933"} Jul 09 01:43:50.653898 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:50.653875 2564 generic.go:356] "Generic (PLEG): container finished" podID="575c6260-4c0f-4ff2-bee9-318463bec1de" containerID="f0662f0d1bf7ecab1e90db29e76b29b32aa8fb0826824c46ff9a1987433ed6ec" exitCode=0 Jul 09 01:43:50.653998 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:50.653960 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg" event={"ID":"575c6260-4c0f-4ff2-bee9-318463bec1de","Type":"ContainerDied","Data":"f0662f0d1bf7ecab1e90db29e76b29b32aa8fb0826824c46ff9a1987433ed6ec"} Jul 09 01:43:50.655837 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:50.655812 2564 generic.go:356] "Generic (PLEG): container finished" podID="86de2f78-f661-4a76-bff8-978c4452806d" containerID="795089d5d7e64ecf86ce00feeeeb52bbe1c554a9840193402b6e33abdb32fef7" exitCode=0 Jul 09 01:43:50.655914 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:50.655866 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z" event={"ID":"86de2f78-f661-4a76-bff8-978c4452806d","Type":"ContainerDied","Data":"795089d5d7e64ecf86ce00feeeeb52bbe1c554a9840193402b6e33abdb32fef7"} Jul 09 01:43:50.655914 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:50.655891 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z" event={"ID":"86de2f78-f661-4a76-bff8-978c4452806d","Type":"ContainerStarted","Data":"9efe524f86e96577131621360e27cad295151e675f87aae1d9fb91e6f84115f4"} Jul 09 01:43:51.663751 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:51.663657 2564 generic.go:356] "Generic (PLEG): container finished" podID="f8469e54-990a-4600-b631-a0fc592bb7ab" containerID="a978d9a539aa6eb96f27f7f723c29dcd26230762332a406119b558f8310ff2f8" exitCode=0 Jul 09 01:43:51.663751 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:51.663730 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx" event={"ID":"f8469e54-990a-4600-b631-a0fc592bb7ab","Type":"ContainerDied","Data":"a978d9a539aa6eb96f27f7f723c29dcd26230762332a406119b558f8310ff2f8"} Jul 09 01:43:51.665967 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:51.665942 2564 generic.go:356] "Generic (PLEG): container finished" podID="575c6260-4c0f-4ff2-bee9-318463bec1de" containerID="287ad640c49c15b6f307d7f5cf91a0b9746e52c69a32e4f4d2836709d01d72fa" exitCode=0 Jul 09 01:43:51.666153 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:51.666012 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg" event={"ID":"575c6260-4c0f-4ff2-bee9-318463bec1de","Type":"ContainerDied","Data":"287ad640c49c15b6f307d7f5cf91a0b9746e52c69a32e4f4d2836709d01d72fa"} Jul 09 01:43:51.667955 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:51.667934 2564 generic.go:356] "Generic (PLEG): container finished" podID="86de2f78-f661-4a76-bff8-978c4452806d" containerID="91fd77e9b868db3417813d60f4278adbbdd08ef475880a58cd514e40c3ea3172" exitCode=0 Jul 09 01:43:51.668048 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:51.667999 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z" event={"ID":"86de2f78-f661-4a76-bff8-978c4452806d","Type":"ContainerDied","Data":"91fd77e9b868db3417813d60f4278adbbdd08ef475880a58cd514e40c3ea3172"} Jul 09 01:43:51.797025 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:51.796991 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4" Jul 09 01:43:51.860090 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:51.860069 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/140b7dbb-97c9-471b-a39b-2c4e69e4dd32-bundle\") pod \"140b7dbb-97c9-471b-a39b-2c4e69e4dd32\" (UID: \"140b7dbb-97c9-471b-a39b-2c4e69e4dd32\") " Jul 09 01:43:51.860225 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:51.860128 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68j79\" (UniqueName: \"kubernetes.io/projected/140b7dbb-97c9-471b-a39b-2c4e69e4dd32-kube-api-access-68j79\") pod \"140b7dbb-97c9-471b-a39b-2c4e69e4dd32\" (UID: \"140b7dbb-97c9-471b-a39b-2c4e69e4dd32\") " Jul 09 01:43:51.860225 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:51.860161 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/140b7dbb-97c9-471b-a39b-2c4e69e4dd32-util\") pod \"140b7dbb-97c9-471b-a39b-2c4e69e4dd32\" (UID: \"140b7dbb-97c9-471b-a39b-2c4e69e4dd32\") " Jul 09 01:43:51.860628 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:51.860597 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/140b7dbb-97c9-471b-a39b-2c4e69e4dd32-bundle" (OuterVolumeSpecName: "bundle") pod "140b7dbb-97c9-471b-a39b-2c4e69e4dd32" (UID: "140b7dbb-97c9-471b-a39b-2c4e69e4dd32"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 01:43:51.862358 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:51.862329 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/140b7dbb-97c9-471b-a39b-2c4e69e4dd32-kube-api-access-68j79" (OuterVolumeSpecName: "kube-api-access-68j79") pod "140b7dbb-97c9-471b-a39b-2c4e69e4dd32" (UID: "140b7dbb-97c9-471b-a39b-2c4e69e4dd32"). InnerVolumeSpecName "kube-api-access-68j79". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 01:43:51.866865 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:51.866832 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/140b7dbb-97c9-471b-a39b-2c4e69e4dd32-util" (OuterVolumeSpecName: "util") pod "140b7dbb-97c9-471b-a39b-2c4e69e4dd32" (UID: "140b7dbb-97c9-471b-a39b-2c4e69e4dd32"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 01:43:51.961873 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:51.961784 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/140b7dbb-97c9-471b-a39b-2c4e69e4dd32-bundle\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:43:51.961873 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:51.961814 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68j79\" (UniqueName: \"kubernetes.io/projected/140b7dbb-97c9-471b-a39b-2c4e69e4dd32-kube-api-access-68j79\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:43:51.961873 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:51.961830 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/140b7dbb-97c9-471b-a39b-2c4e69e4dd32-util\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:43:52.675006 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:52.674976 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4" Jul 09 01:43:52.675446 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:52.674976 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4" event={"ID":"140b7dbb-97c9-471b-a39b-2c4e69e4dd32","Type":"ContainerDied","Data":"9f6a90a4938625b0544fb70e033e6b28a3f9a89857764d149fe0670d6350ce5d"} Jul 09 01:43:52.675446 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:52.675135 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f6a90a4938625b0544fb70e033e6b28a3f9a89857764d149fe0670d6350ce5d" Jul 09 01:43:52.677270 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:52.677221 2564 generic.go:356] "Generic (PLEG): container finished" podID="86de2f78-f661-4a76-bff8-978c4452806d" containerID="d7fe3a218ef035851f3664d95e2e669a5ff966edaec4ebbbe62e71f28cde26c2" exitCode=0 Jul 09 01:43:52.677419 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:52.677276 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z" event={"ID":"86de2f78-f661-4a76-bff8-978c4452806d","Type":"ContainerDied","Data":"d7fe3a218ef035851f3664d95e2e669a5ff966edaec4ebbbe62e71f28cde26c2"} Jul 09 01:43:52.828149 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:52.828125 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg" Jul 09 01:43:52.854435 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:52.854412 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx" Jul 09 01:43:52.868974 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:52.868948 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/575c6260-4c0f-4ff2-bee9-318463bec1de-util\") pod \"575c6260-4c0f-4ff2-bee9-318463bec1de\" (UID: \"575c6260-4c0f-4ff2-bee9-318463bec1de\") " Jul 09 01:43:52.869087 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:52.869006 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/575c6260-4c0f-4ff2-bee9-318463bec1de-bundle\") pod \"575c6260-4c0f-4ff2-bee9-318463bec1de\" (UID: \"575c6260-4c0f-4ff2-bee9-318463bec1de\") " Jul 09 01:43:52.869087 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:52.869060 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45j7q\" (UniqueName: \"kubernetes.io/projected/575c6260-4c0f-4ff2-bee9-318463bec1de-kube-api-access-45j7q\") pod \"575c6260-4c0f-4ff2-bee9-318463bec1de\" (UID: \"575c6260-4c0f-4ff2-bee9-318463bec1de\") " Jul 09 01:43:52.869637 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:52.869613 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/575c6260-4c0f-4ff2-bee9-318463bec1de-bundle" (OuterVolumeSpecName: "bundle") pod "575c6260-4c0f-4ff2-bee9-318463bec1de" (UID: "575c6260-4c0f-4ff2-bee9-318463bec1de"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 01:43:52.871992 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:52.871963 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/575c6260-4c0f-4ff2-bee9-318463bec1de-kube-api-access-45j7q" (OuterVolumeSpecName: "kube-api-access-45j7q") pod "575c6260-4c0f-4ff2-bee9-318463bec1de" (UID: "575c6260-4c0f-4ff2-bee9-318463bec1de"). InnerVolumeSpecName "kube-api-access-45j7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 01:43:52.875766 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:52.875741 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/575c6260-4c0f-4ff2-bee9-318463bec1de-util" (OuterVolumeSpecName: "util") pod "575c6260-4c0f-4ff2-bee9-318463bec1de" (UID: "575c6260-4c0f-4ff2-bee9-318463bec1de"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 01:43:52.969927 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:52.969900 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8469e54-990a-4600-b631-a0fc592bb7ab-util\") pod \"f8469e54-990a-4600-b631-a0fc592bb7ab\" (UID: \"f8469e54-990a-4600-b631-a0fc592bb7ab\") " Jul 09 01:43:52.970102 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:52.969938 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8469e54-990a-4600-b631-a0fc592bb7ab-bundle\") pod \"f8469e54-990a-4600-b631-a0fc592bb7ab\" (UID: \"f8469e54-990a-4600-b631-a0fc592bb7ab\") " Jul 09 01:43:52.970102 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:52.969983 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6xqq\" (UniqueName: \"kubernetes.io/projected/f8469e54-990a-4600-b631-a0fc592bb7ab-kube-api-access-v6xqq\") pod \"f8469e54-990a-4600-b631-a0fc592bb7ab\" (UID: \"f8469e54-990a-4600-b631-a0fc592bb7ab\") " Jul 09 01:43:52.970283 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:52.970266 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45j7q\" (UniqueName: \"kubernetes.io/projected/575c6260-4c0f-4ff2-bee9-318463bec1de-kube-api-access-45j7q\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:43:52.970342 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:52.970288 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/575c6260-4c0f-4ff2-bee9-318463bec1de-util\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:43:52.970342 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:52.970301 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/575c6260-4c0f-4ff2-bee9-318463bec1de-bundle\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:43:52.970447 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:52.970355 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8469e54-990a-4600-b631-a0fc592bb7ab-bundle" (OuterVolumeSpecName: "bundle") pod "f8469e54-990a-4600-b631-a0fc592bb7ab" (UID: "f8469e54-990a-4600-b631-a0fc592bb7ab"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 01:43:52.972057 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:52.972034 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8469e54-990a-4600-b631-a0fc592bb7ab-kube-api-access-v6xqq" (OuterVolumeSpecName: "kube-api-access-v6xqq") pod "f8469e54-990a-4600-b631-a0fc592bb7ab" (UID: "f8469e54-990a-4600-b631-a0fc592bb7ab"). InnerVolumeSpecName "kube-api-access-v6xqq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 01:43:52.974861 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:52.974828 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8469e54-990a-4600-b631-a0fc592bb7ab-util" (OuterVolumeSpecName: "util") pod "f8469e54-990a-4600-b631-a0fc592bb7ab" (UID: "f8469e54-990a-4600-b631-a0fc592bb7ab"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 01:43:53.070848 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:53.070816 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6xqq\" (UniqueName: \"kubernetes.io/projected/f8469e54-990a-4600-b631-a0fc592bb7ab-kube-api-access-v6xqq\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:43:53.070848 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:53.070844 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8469e54-990a-4600-b631-a0fc592bb7ab-util\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:43:53.070848 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:53.070854 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8469e54-990a-4600-b631-a0fc592bb7ab-bundle\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:43:53.684347 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:53.684312 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx" event={"ID":"f8469e54-990a-4600-b631-a0fc592bb7ab","Type":"ContainerDied","Data":"21fece93bfb656d67d98be17285aeb042f07e3de940cdd74226aa09a241455f8"} Jul 09 01:43:53.684753 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:53.684325 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx" Jul 09 01:43:53.684753 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:53.684371 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="21fece93bfb656d67d98be17285aeb042f07e3de940cdd74226aa09a241455f8" Jul 09 01:43:53.686450 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:53.686421 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg" Jul 09 01:43:53.686450 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:53.686433 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg" event={"ID":"575c6260-4c0f-4ff2-bee9-318463bec1de","Type":"ContainerDied","Data":"82a561caff847097e2f14ddb6155c272385df40fbbee98af57269c0187852b5d"} Jul 09 01:43:53.686628 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:53.686480 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82a561caff847097e2f14ddb6155c272385df40fbbee98af57269c0187852b5d" Jul 09 01:43:53.818602 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:53.818579 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z" Jul 09 01:43:53.877863 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:53.877837 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-df2vs\" (UniqueName: \"kubernetes.io/projected/86de2f78-f661-4a76-bff8-978c4452806d-kube-api-access-df2vs\") pod \"86de2f78-f661-4a76-bff8-978c4452806d\" (UID: \"86de2f78-f661-4a76-bff8-978c4452806d\") " Jul 09 01:43:53.877991 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:53.877876 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86de2f78-f661-4a76-bff8-978c4452806d-bundle\") pod \"86de2f78-f661-4a76-bff8-978c4452806d\" (UID: \"86de2f78-f661-4a76-bff8-978c4452806d\") " Jul 09 01:43:53.877991 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:53.877918 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86de2f78-f661-4a76-bff8-978c4452806d-util\") pod \"86de2f78-f661-4a76-bff8-978c4452806d\" (UID: \"86de2f78-f661-4a76-bff8-978c4452806d\") " Jul 09 01:43:53.878519 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:53.878487 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86de2f78-f661-4a76-bff8-978c4452806d-bundle" (OuterVolumeSpecName: "bundle") pod "86de2f78-f661-4a76-bff8-978c4452806d" (UID: "86de2f78-f661-4a76-bff8-978c4452806d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 01:43:53.880047 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:53.880025 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86de2f78-f661-4a76-bff8-978c4452806d-kube-api-access-df2vs" (OuterVolumeSpecName: "kube-api-access-df2vs") pod "86de2f78-f661-4a76-bff8-978c4452806d" (UID: "86de2f78-f661-4a76-bff8-978c4452806d"). InnerVolumeSpecName "kube-api-access-df2vs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 01:43:53.883416 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:53.883396 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86de2f78-f661-4a76-bff8-978c4452806d-util" (OuterVolumeSpecName: "util") pod "86de2f78-f661-4a76-bff8-978c4452806d" (UID: "86de2f78-f661-4a76-bff8-978c4452806d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 01:43:53.978529 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:53.978495 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-df2vs\" (UniqueName: \"kubernetes.io/projected/86de2f78-f661-4a76-bff8-978c4452806d-kube-api-access-df2vs\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:43:53.978529 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:53.978524 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86de2f78-f661-4a76-bff8-978c4452806d-bundle\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:43:53.978529 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:53.978535 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86de2f78-f661-4a76-bff8-978c4452806d-util\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:43:54.693622 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:54.693593 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z" Jul 09 01:43:54.693622 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:54.693613 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z" event={"ID":"86de2f78-f661-4a76-bff8-978c4452806d","Type":"ContainerDied","Data":"9efe524f86e96577131621360e27cad295151e675f87aae1d9fb91e6f84115f4"} Jul 09 01:43:54.694126 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:43:54.693656 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9efe524f86e96577131621360e27cad295151e675f87aae1d9fb91e6f84115f4" Jul 09 01:44:03.869085 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.869053 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzzl"] Jul 09 01:44:03.869537 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.869403 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="140b7dbb-97c9-471b-a39b-2c4e69e4dd32" containerName="util" Jul 09 01:44:03.869537 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.869415 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="140b7dbb-97c9-471b-a39b-2c4e69e4dd32" containerName="util" Jul 09 01:44:03.869537 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.869424 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86de2f78-f661-4a76-bff8-978c4452806d" containerName="extract" Jul 09 01:44:03.869537 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.869431 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="86de2f78-f661-4a76-bff8-978c4452806d" containerName="extract" Jul 09 01:44:03.869537 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.869442 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8469e54-990a-4600-b631-a0fc592bb7ab" containerName="util" Jul 09 01:44:03.869537 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.869447 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8469e54-990a-4600-b631-a0fc592bb7ab" containerName="util" Jul 09 01:44:03.869537 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.869454 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="140b7dbb-97c9-471b-a39b-2c4e69e4dd32" containerName="pull" Jul 09 01:44:03.869537 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.869460 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="140b7dbb-97c9-471b-a39b-2c4e69e4dd32" containerName="pull" Jul 09 01:44:03.869537 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.869467 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="140b7dbb-97c9-471b-a39b-2c4e69e4dd32" containerName="extract" Jul 09 01:44:03.869537 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.869472 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="140b7dbb-97c9-471b-a39b-2c4e69e4dd32" containerName="extract" Jul 09 01:44:03.869537 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.869479 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="575c6260-4c0f-4ff2-bee9-318463bec1de" containerName="extract" Jul 09 01:44:03.869537 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.869484 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="575c6260-4c0f-4ff2-bee9-318463bec1de" containerName="extract" Jul 09 01:44:03.869537 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.869489 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86de2f78-f661-4a76-bff8-978c4452806d" containerName="pull" Jul 09 01:44:03.869537 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.869496 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="86de2f78-f661-4a76-bff8-978c4452806d" containerName="pull" Jul 09 01:44:03.869537 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.869508 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86de2f78-f661-4a76-bff8-978c4452806d" containerName="util" Jul 09 01:44:03.869537 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.869513 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="86de2f78-f661-4a76-bff8-978c4452806d" containerName="util" Jul 09 01:44:03.869537 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.869518 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8469e54-990a-4600-b631-a0fc592bb7ab" containerName="pull" Jul 09 01:44:03.869537 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.869523 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8469e54-990a-4600-b631-a0fc592bb7ab" containerName="pull" Jul 09 01:44:03.869537 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.869528 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8469e54-990a-4600-b631-a0fc592bb7ab" containerName="extract" Jul 09 01:44:03.869537 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.869533 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8469e54-990a-4600-b631-a0fc592bb7ab" containerName="extract" Jul 09 01:44:03.869537 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.869540 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="575c6260-4c0f-4ff2-bee9-318463bec1de" containerName="pull" Jul 09 01:44:03.869537 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.869545 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="575c6260-4c0f-4ff2-bee9-318463bec1de" containerName="pull" Jul 09 01:44:03.870148 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.869552 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="575c6260-4c0f-4ff2-bee9-318463bec1de" containerName="util" Jul 09 01:44:03.870148 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.869557 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="575c6260-4c0f-4ff2-bee9-318463bec1de" containerName="util" Jul 09 01:44:03.870148 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.869609 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8469e54-990a-4600-b631-a0fc592bb7ab" containerName="extract" Jul 09 01:44:03.870148 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.869618 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="86de2f78-f661-4a76-bff8-978c4452806d" containerName="extract" Jul 09 01:44:03.870148 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.869624 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="575c6260-4c0f-4ff2-bee9-318463bec1de" containerName="extract" Jul 09 01:44:03.870148 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.869631 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="140b7dbb-97c9-471b-a39b-2c4e69e4dd32" containerName="extract" Jul 09 01:44:03.873426 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.873409 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzzl" Jul 09 01:44:03.875840 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.875817 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-7b5kb\"" Jul 09 01:44:03.882960 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.882937 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzzl"] Jul 09 01:44:03.970430 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:03.970392 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lst8k\" (UniqueName: \"kubernetes.io/projected/2412c02f-0615-40d0-94d5-aef974b75531-kube-api-access-lst8k\") pod \"limitador-operator-controller-manager-859d7b78bd-bkzzl\" (UID: \"2412c02f-0615-40d0-94d5-aef974b75531\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzzl" Jul 09 01:44:04.071663 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:04.071622 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lst8k\" (UniqueName: \"kubernetes.io/projected/2412c02f-0615-40d0-94d5-aef974b75531-kube-api-access-lst8k\") pod \"limitador-operator-controller-manager-859d7b78bd-bkzzl\" (UID: \"2412c02f-0615-40d0-94d5-aef974b75531\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzzl" Jul 09 01:44:04.080001 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:04.079971 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lst8k\" (UniqueName: \"kubernetes.io/projected/2412c02f-0615-40d0-94d5-aef974b75531-kube-api-access-lst8k\") pod \"limitador-operator-controller-manager-859d7b78bd-bkzzl\" (UID: \"2412c02f-0615-40d0-94d5-aef974b75531\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzzl" Jul 09 01:44:04.184299 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:04.184210 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzzl" Jul 09 01:44:04.316729 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:04.316706 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzzl"] Jul 09 01:44:04.318632 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:44:04.318601 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2412c02f_0615_40d0_94d5_aef974b75531.slice/crio-37c1b8eb6a9e0530eaa9720a1a0c3a84bedeb87dd726696e567c1ca902baa05f WatchSource:0}: Error finding container 37c1b8eb6a9e0530eaa9720a1a0c3a84bedeb87dd726696e567c1ca902baa05f: Status 404 returned error can't find the container with id 37c1b8eb6a9e0530eaa9720a1a0c3a84bedeb87dd726696e567c1ca902baa05f Jul 09 01:44:04.752573 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:04.752541 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzzl" event={"ID":"2412c02f-0615-40d0-94d5-aef974b75531","Type":"ContainerStarted","Data":"37c1b8eb6a9e0530eaa9720a1a0c3a84bedeb87dd726696e567c1ca902baa05f"} Jul 09 01:44:06.765524 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:06.765490 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzzl" event={"ID":"2412c02f-0615-40d0-94d5-aef974b75531","Type":"ContainerStarted","Data":"0b241884d0c61e71f824233223cb3694e356492556fdbe3f00646f137b1cc487"} Jul 09 01:44:06.765964 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:06.765605 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzzl" Jul 09 01:44:06.784696 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:06.784647 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzzl" podStartSLOduration=2.232621921 podStartE2EDuration="3.784633141s" totalImagesPullingTime="1.55201122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:44:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:44:06.782339379 +0000 UTC m=+379.444076871" watchObservedRunningTime="2026-07-09 01:44:06.784633141 +0000 UTC m=+379.446370632" Jul 09 01:44:08.564379 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:08.564343 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n"] Jul 09 01:44:08.579044 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:08.579010 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n"] Jul 09 01:44:08.579226 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:08.579123 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n" Jul 09 01:44:08.581428 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:08.581406 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ctj2r\"" Jul 09 01:44:08.714288 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:08.714222 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9s5c\" (UniqueName: \"kubernetes.io/projected/d2512bfc-0c66-46fd-846d-820ae30d5296-kube-api-access-v9s5c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-b5q9n\" (UID: \"d2512bfc-0c66-46fd-846d-820ae30d5296\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n" Jul 09 01:44:08.714288 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:08.714287 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2512bfc-0c66-46fd-846d-820ae30d5296-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-b5q9n\" (UID: \"d2512bfc-0c66-46fd-846d-820ae30d5296\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n" Jul 09 01:44:08.815817 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:08.815719 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2512bfc-0c66-46fd-846d-820ae30d5296-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-b5q9n\" (UID: \"d2512bfc-0c66-46fd-846d-820ae30d5296\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n" Jul 09 01:44:08.815988 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:08.815840 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9s5c\" (UniqueName: \"kubernetes.io/projected/d2512bfc-0c66-46fd-846d-820ae30d5296-kube-api-access-v9s5c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-b5q9n\" (UID: \"d2512bfc-0c66-46fd-846d-820ae30d5296\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n" Jul 09 01:44:08.816119 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:08.816096 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2512bfc-0c66-46fd-846d-820ae30d5296-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-b5q9n\" (UID: \"d2512bfc-0c66-46fd-846d-820ae30d5296\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n" Jul 09 01:44:08.823941 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:08.823913 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9s5c\" (UniqueName: \"kubernetes.io/projected/d2512bfc-0c66-46fd-846d-820ae30d5296-kube-api-access-v9s5c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-b5q9n\" (UID: \"d2512bfc-0c66-46fd-846d-820ae30d5296\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n" Jul 09 01:44:08.890373 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:08.890340 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n" Jul 09 01:44:09.044348 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:09.044322 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n"] Jul 09 01:44:09.047116 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:44:09.047088 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2512bfc_0c66_46fd_846d_820ae30d5296.slice/crio-9f4be904144bbeb4e2326a1ba62a26b5be94ab319dfab5d5d9afe975d78b2980 WatchSource:0}: Error finding container 9f4be904144bbeb4e2326a1ba62a26b5be94ab319dfab5d5d9afe975d78b2980: Status 404 returned error can't find the container with id 9f4be904144bbeb4e2326a1ba62a26b5be94ab319dfab5d5d9afe975d78b2980 Jul 09 01:44:09.781921 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:09.781888 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n" event={"ID":"d2512bfc-0c66-46fd-846d-820ae30d5296","Type":"ContainerStarted","Data":"9f4be904144bbeb4e2326a1ba62a26b5be94ab319dfab5d5d9afe975d78b2980"} Jul 09 01:44:14.873654 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:14.873620 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zjbpv"] Jul 09 01:44:14.879970 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:14.879936 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zjbpv" Jul 09 01:44:14.883621 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:14.883593 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-hgkz8\"" Jul 09 01:44:14.883810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:14.883601 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 09 01:44:14.885810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:14.885788 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zjbpv"] Jul 09 01:44:14.973131 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:14.973084 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m2kz\" (UniqueName: \"kubernetes.io/projected/0df105c3-e1af-4ede-9e93-be3d8159c92e-kube-api-access-7m2kz\") pod \"dns-operator-controller-manager-864dd78c4c-zjbpv\" (UID: \"0df105c3-e1af-4ede-9e93-be3d8159c92e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zjbpv" Jul 09 01:44:15.073631 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:15.073590 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m2kz\" (UniqueName: \"kubernetes.io/projected/0df105c3-e1af-4ede-9e93-be3d8159c92e-kube-api-access-7m2kz\") pod \"dns-operator-controller-manager-864dd78c4c-zjbpv\" (UID: \"0df105c3-e1af-4ede-9e93-be3d8159c92e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zjbpv" Jul 09 01:44:15.083167 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:15.083138 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m2kz\" (UniqueName: \"kubernetes.io/projected/0df105c3-e1af-4ede-9e93-be3d8159c92e-kube-api-access-7m2kz\") pod \"dns-operator-controller-manager-864dd78c4c-zjbpv\" (UID: \"0df105c3-e1af-4ede-9e93-be3d8159c92e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zjbpv" Jul 09 01:44:15.195256 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:15.195200 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zjbpv" Jul 09 01:44:15.708963 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:15.708937 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zjbpv"] Jul 09 01:44:15.711464 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:44:15.711438 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0df105c3_e1af_4ede_9e93_be3d8159c92e.slice/crio-62a901a93d5733936a77287256e63f78b3a69be65692f3cce775e3947b3b5257 WatchSource:0}: Error finding container 62a901a93d5733936a77287256e63f78b3a69be65692f3cce775e3947b3b5257: Status 404 returned error can't find the container with id 62a901a93d5733936a77287256e63f78b3a69be65692f3cce775e3947b3b5257 Jul 09 01:44:15.819212 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:15.819173 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zjbpv" event={"ID":"0df105c3-e1af-4ede-9e93-be3d8159c92e","Type":"ContainerStarted","Data":"62a901a93d5733936a77287256e63f78b3a69be65692f3cce775e3947b3b5257"} Jul 09 01:44:15.820834 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:15.820810 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n" event={"ID":"d2512bfc-0c66-46fd-846d-820ae30d5296","Type":"ContainerStarted","Data":"4afc2ae45fcb28516c3595309bbcf19139c44be426a553babaee29f1a5f6861f"} Jul 09 01:44:15.820963 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:15.820946 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n" Jul 09 01:44:15.839116 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:15.839026 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n" podStartSLOduration=1.245751843 podStartE2EDuration="7.839010828s" totalImagesPullingTime="6.593258985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:44:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:44:15.836703269 +0000 UTC m=+388.498440788" watchObservedRunningTime="2026-07-09 01:44:15.839010828 +0000 UTC m=+388.500748381" Jul 09 01:44:17.772897 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:17.772861 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzzl" Jul 09 01:44:18.840075 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:18.840030 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zjbpv" event={"ID":"0df105c3-e1af-4ede-9e93-be3d8159c92e","Type":"ContainerStarted","Data":"8a7ab4dba3ea881bc00f75851c0aec7f4301b712dab50da1a9daff0933e20564"} Jul 09 01:44:18.840493 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:18.840142 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zjbpv" Jul 09 01:44:18.856126 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:18.856074 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zjbpv" podStartSLOduration=2.366362246 podStartE2EDuration="4.856054294s" totalImagesPullingTime="2.489692048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:44:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:44:18.85534766 +0000 UTC m=+391.517085152" watchObservedRunningTime="2026-07-09 01:44:18.856054294 +0000 UTC m=+391.517791795" Jul 09 01:44:26.829409 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:26.829376 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n" Jul 09 01:44:28.217762 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.217733 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q4jdg"] Jul 09 01:44:28.222650 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.222625 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q4jdg" Jul 09 01:44:28.236299 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.236274 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q4jdg"] Jul 09 01:44:28.290356 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.290324 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/98fc71ec-05d1-4ea5-864f-16b8832a2c6e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-q4jdg\" (UID: \"98fc71ec-05d1-4ea5-864f-16b8832a2c6e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q4jdg" Jul 09 01:44:28.290539 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.290451 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pz4j\" (UniqueName: \"kubernetes.io/projected/98fc71ec-05d1-4ea5-864f-16b8832a2c6e-kube-api-access-4pz4j\") pod \"kuadrant-operator-controller-manager-55467d9f7-q4jdg\" (UID: \"98fc71ec-05d1-4ea5-864f-16b8832a2c6e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q4jdg" Jul 09 01:44:28.391180 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.391139 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pz4j\" (UniqueName: \"kubernetes.io/projected/98fc71ec-05d1-4ea5-864f-16b8832a2c6e-kube-api-access-4pz4j\") pod \"kuadrant-operator-controller-manager-55467d9f7-q4jdg\" (UID: \"98fc71ec-05d1-4ea5-864f-16b8832a2c6e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q4jdg" Jul 09 01:44:28.391396 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.391194 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/98fc71ec-05d1-4ea5-864f-16b8832a2c6e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-q4jdg\" (UID: \"98fc71ec-05d1-4ea5-864f-16b8832a2c6e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q4jdg" Jul 09 01:44:28.391600 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.391578 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/98fc71ec-05d1-4ea5-864f-16b8832a2c6e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-q4jdg\" (UID: \"98fc71ec-05d1-4ea5-864f-16b8832a2c6e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q4jdg" Jul 09 01:44:28.402176 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.402148 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pz4j\" (UniqueName: \"kubernetes.io/projected/98fc71ec-05d1-4ea5-864f-16b8832a2c6e-kube-api-access-4pz4j\") pod \"kuadrant-operator-controller-manager-55467d9f7-q4jdg\" (UID: \"98fc71ec-05d1-4ea5-864f-16b8832a2c6e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q4jdg" Jul 09 01:44:28.522055 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.521965 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q4jdg"] Jul 09 01:44:28.522284 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.522254 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q4jdg" Jul 09 01:44:28.527159 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.527133 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q4jdg"] Jul 09 01:44:28.534787 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.534761 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n"] Jul 09 01:44:28.534953 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.534928 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n" podUID="d2512bfc-0c66-46fd-846d-820ae30d5296" containerName="manager" containerID="cri-o://4afc2ae45fcb28516c3595309bbcf19139c44be426a553babaee29f1a5f6861f" gracePeriod=2 Jul 09 01:44:28.556793 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:44:28.556709 2564 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d2512bfc-0c66-46fd-846d-820ae30d5296\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-b5q9n\": pods \"kuadrant-operator-controller-manager-8684c9ff49-b5q9n\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n" Jul 09 01:44:28.557279 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.557259 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-slh5s"] Jul 09 01:44:28.562113 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.562093 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n"] Jul 09 01:44:28.562210 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.562197 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-slh5s" Jul 09 01:44:28.565005 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:44:28.564969 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-b5q9n\" is forbidden: User \"system:node:ip-10-0-131-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-181.ec2.internal' and this object" podUID="d2512bfc-0c66-46fd-846d-820ae30d5296" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n" Jul 09 01:44:28.570042 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.566882 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4mtm"] Jul 09 01:44:28.575511 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.575160 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2512bfc-0c66-46fd-846d-820ae30d5296" containerName="manager" Jul 09 01:44:28.575511 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.575192 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2512bfc-0c66-46fd-846d-820ae30d5296" containerName="manager" Jul 09 01:44:28.575511 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.575481 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2512bfc-0c66-46fd-846d-820ae30d5296" containerName="manager" Jul 09 01:44:28.579201 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.579180 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-slh5s"] Jul 09 01:44:28.579584 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.579564 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4mtm" Jul 09 01:44:28.579747 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.579727 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzzl"] Jul 09 01:44:28.580109 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.580064 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzzl" podUID="2412c02f-0615-40d0-94d5-aef974b75531" containerName="manager" containerID="cri-o://0b241884d0c61e71f824233223cb3694e356492556fdbe3f00646f137b1cc487" gracePeriod=2 Jul 09 01:44:28.582920 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.582898 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4mtm"] Jul 09 01:44:28.585285 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.585262 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzzl"] Jul 09 01:44:28.593204 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.593182 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29bb04b1-f0c0-4a73-a29b-efe3b872bcf1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-f4mtm\" (UID: \"29bb04b1-f0c0-4a73-a29b-efe3b872bcf1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4mtm" Jul 09 01:44:28.593318 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.593220 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hkk2\" (UniqueName: \"kubernetes.io/projected/1ce07575-d204-4148-8ead-e9b921c24a27-kube-api-access-7hkk2\") pod \"kuadrant-operator-controller-manager-55467d9f7-slh5s\" (UID: \"1ce07575-d204-4148-8ead-e9b921c24a27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-slh5s" Jul 09 01:44:28.593373 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.593335 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxc8v\" (UniqueName: \"kubernetes.io/projected/29bb04b1-f0c0-4a73-a29b-efe3b872bcf1-kube-api-access-fxc8v\") pod \"kuadrant-operator-controller-manager-8684c9ff49-f4mtm\" (UID: \"29bb04b1-f0c0-4a73-a29b-efe3b872bcf1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4mtm" Jul 09 01:44:28.593423 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.593381 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ce07575-d204-4148-8ead-e9b921c24a27-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-slh5s\" (UID: \"1ce07575-d204-4148-8ead-e9b921c24a27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-slh5s" Jul 09 01:44:28.603611 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:44:28.603582 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-b5q9n\" is forbidden: User \"system:node:ip-10-0-131-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-181.ec2.internal' and this object" podUID="d2512bfc-0c66-46fd-846d-820ae30d5296" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n" Jul 09 01:44:28.618653 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.618623 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mddc9"] Jul 09 01:44:28.619259 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.619224 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2412c02f-0615-40d0-94d5-aef974b75531" containerName="manager" Jul 09 01:44:28.619259 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.619260 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2412c02f-0615-40d0-94d5-aef974b75531" containerName="manager" Jul 09 01:44:28.619403 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.619391 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2412c02f-0615-40d0-94d5-aef974b75531" containerName="manager" Jul 09 01:44:28.622844 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.622824 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mddc9" Jul 09 01:44:28.628333 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:44:28.628297 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bkzzl\" is forbidden: User \"system:node:ip-10-0-131-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-181.ec2.internal' and this object" podUID="2412c02f-0615-40d0-94d5-aef974b75531" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzzl" Jul 09 01:44:28.630651 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:44:28.630357 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bkzzl\" is forbidden: User \"system:node:ip-10-0-131-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-181.ec2.internal' and this object" podUID="2412c02f-0615-40d0-94d5-aef974b75531" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzzl" Jul 09 01:44:28.634759 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.634735 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mddc9"] Jul 09 01:44:28.654379 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:44:28.654349 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-b5q9n\" is forbidden: User \"system:node:ip-10-0-131-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-181.ec2.internal' and this object" podUID="d2512bfc-0c66-46fd-846d-820ae30d5296" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n" Jul 09 01:44:28.693897 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.693868 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hkk2\" (UniqueName: \"kubernetes.io/projected/1ce07575-d204-4148-8ead-e9b921c24a27-kube-api-access-7hkk2\") pod \"kuadrant-operator-controller-manager-55467d9f7-slh5s\" (UID: \"1ce07575-d204-4148-8ead-e9b921c24a27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-slh5s" Jul 09 01:44:28.693999 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.693934 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxc8v\" (UniqueName: \"kubernetes.io/projected/29bb04b1-f0c0-4a73-a29b-efe3b872bcf1-kube-api-access-fxc8v\") pod \"kuadrant-operator-controller-manager-8684c9ff49-f4mtm\" (UID: \"29bb04b1-f0c0-4a73-a29b-efe3b872bcf1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4mtm" Jul 09 01:44:28.693999 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.693973 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ce07575-d204-4148-8ead-e9b921c24a27-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-slh5s\" (UID: \"1ce07575-d204-4148-8ead-e9b921c24a27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-slh5s" Jul 09 01:44:28.694120 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.694000 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cblw4\" (UniqueName: \"kubernetes.io/projected/218fed09-3f69-40c9-855e-55402a404371-kube-api-access-cblw4\") pod \"limitador-operator-controller-manager-859d7b78bd-mddc9\" (UID: \"218fed09-3f69-40c9-855e-55402a404371\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mddc9" Jul 09 01:44:28.694120 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.694053 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29bb04b1-f0c0-4a73-a29b-efe3b872bcf1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-f4mtm\" (UID: \"29bb04b1-f0c0-4a73-a29b-efe3b872bcf1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4mtm" Jul 09 01:44:28.694512 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.694485 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ce07575-d204-4148-8ead-e9b921c24a27-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-slh5s\" (UID: \"1ce07575-d204-4148-8ead-e9b921c24a27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-slh5s" Jul 09 01:44:28.694600 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.694540 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29bb04b1-f0c0-4a73-a29b-efe3b872bcf1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-f4mtm\" (UID: \"29bb04b1-f0c0-4a73-a29b-efe3b872bcf1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4mtm" Jul 09 01:44:28.707423 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.707383 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hkk2\" (UniqueName: \"kubernetes.io/projected/1ce07575-d204-4148-8ead-e9b921c24a27-kube-api-access-7hkk2\") pod \"kuadrant-operator-controller-manager-55467d9f7-slh5s\" (UID: \"1ce07575-d204-4148-8ead-e9b921c24a27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-slh5s" Jul 09 01:44:28.707836 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.707819 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxc8v\" (UniqueName: \"kubernetes.io/projected/29bb04b1-f0c0-4a73-a29b-efe3b872bcf1-kube-api-access-fxc8v\") pod \"kuadrant-operator-controller-manager-8684c9ff49-f4mtm\" (UID: \"29bb04b1-f0c0-4a73-a29b-efe3b872bcf1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4mtm" Jul 09 01:44:28.794972 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.794894 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cblw4\" (UniqueName: \"kubernetes.io/projected/218fed09-3f69-40c9-855e-55402a404371-kube-api-access-cblw4\") pod \"limitador-operator-controller-manager-859d7b78bd-mddc9\" (UID: \"218fed09-3f69-40c9-855e-55402a404371\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mddc9" Jul 09 01:44:28.814557 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.814528 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cblw4\" (UniqueName: \"kubernetes.io/projected/218fed09-3f69-40c9-855e-55402a404371-kube-api-access-cblw4\") pod \"limitador-operator-controller-manager-859d7b78bd-mddc9\" (UID: \"218fed09-3f69-40c9-855e-55402a404371\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mddc9" Jul 09 01:44:28.817816 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.817792 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n" Jul 09 01:44:28.819691 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:44:28.819665 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bkzzl\" is forbidden: User \"system:node:ip-10-0-131-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-181.ec2.internal' and this object" podUID="2412c02f-0615-40d0-94d5-aef974b75531" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzzl" Jul 09 01:44:28.821145 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:44:28.821120 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-b5q9n\" is forbidden: User \"system:node:ip-10-0-131-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-181.ec2.internal' and this object" podUID="d2512bfc-0c66-46fd-846d-820ae30d5296" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n" Jul 09 01:44:28.826607 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.826589 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzzl" Jul 09 01:44:28.828418 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:44:28.828396 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bkzzl\" is forbidden: User \"system:node:ip-10-0-131-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-181.ec2.internal' and this object" podUID="2412c02f-0615-40d0-94d5-aef974b75531" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzzl" Jul 09 01:44:28.830029 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:44:28.830011 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-b5q9n\" is forbidden: User \"system:node:ip-10-0-131-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-181.ec2.internal' and this object" podUID="d2512bfc-0c66-46fd-846d-820ae30d5296" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n" Jul 09 01:44:28.892788 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.892754 2564 generic.go:356] "Generic (PLEG): container finished" podID="d2512bfc-0c66-46fd-846d-820ae30d5296" containerID="4afc2ae45fcb28516c3595309bbcf19139c44be426a553babaee29f1a5f6861f" exitCode=0 Jul 09 01:44:28.892937 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.892800 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n" Jul 09 01:44:28.892937 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.892858 2564 scope.go:117] "RemoveContainer" containerID="4afc2ae45fcb28516c3595309bbcf19139c44be426a553babaee29f1a5f6861f" Jul 09 01:44:28.897580 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:44:28.897546 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bkzzl\" is forbidden: User \"system:node:ip-10-0-131-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-181.ec2.internal' and this object" podUID="2412c02f-0615-40d0-94d5-aef974b75531" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzzl" Jul 09 01:44:28.897718 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.897600 2564 generic.go:356] "Generic (PLEG): container finished" podID="2412c02f-0615-40d0-94d5-aef974b75531" containerID="0b241884d0c61e71f824233223cb3694e356492556fdbe3f00646f137b1cc487" exitCode=0 Jul 09 01:44:28.897718 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.897693 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzzl" Jul 09 01:44:28.897834 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.897732 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2512bfc-0c66-46fd-846d-820ae30d5296-extensions-socket-volume\") pod \"d2512bfc-0c66-46fd-846d-820ae30d5296\" (UID: \"d2512bfc-0c66-46fd-846d-820ae30d5296\") " Jul 09 01:44:28.897834 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.897781 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9s5c\" (UniqueName: \"kubernetes.io/projected/d2512bfc-0c66-46fd-846d-820ae30d5296-kube-api-access-v9s5c\") pod \"d2512bfc-0c66-46fd-846d-820ae30d5296\" (UID: \"d2512bfc-0c66-46fd-846d-820ae30d5296\") " Jul 09 01:44:28.897936 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.897860 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lst8k\" (UniqueName: \"kubernetes.io/projected/2412c02f-0615-40d0-94d5-aef974b75531-kube-api-access-lst8k\") pod \"2412c02f-0615-40d0-94d5-aef974b75531\" (UID: \"2412c02f-0615-40d0-94d5-aef974b75531\") " Jul 09 01:44:28.898401 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.898373 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2512bfc-0c66-46fd-846d-820ae30d5296-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d2512bfc-0c66-46fd-846d-820ae30d5296" (UID: "d2512bfc-0c66-46fd-846d-820ae30d5296"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 01:44:28.899461 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:44:28.899403 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-b5q9n\" is forbidden: User \"system:node:ip-10-0-131-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-181.ec2.internal' and this object" podUID="d2512bfc-0c66-46fd-846d-820ae30d5296" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n" Jul 09 01:44:28.900091 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.900070 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2512bfc-0c66-46fd-846d-820ae30d5296-kube-api-access-v9s5c" (OuterVolumeSpecName: "kube-api-access-v9s5c") pod "d2512bfc-0c66-46fd-846d-820ae30d5296" (UID: "d2512bfc-0c66-46fd-846d-820ae30d5296"). InnerVolumeSpecName "kube-api-access-v9s5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 01:44:28.900188 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.900092 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2412c02f-0615-40d0-94d5-aef974b75531-kube-api-access-lst8k" (OuterVolumeSpecName: "kube-api-access-lst8k") pod "2412c02f-0615-40d0-94d5-aef974b75531" (UID: "2412c02f-0615-40d0-94d5-aef974b75531"). InnerVolumeSpecName "kube-api-access-lst8k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 01:44:28.901214 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:44:28.901189 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-b5q9n\" is forbidden: User \"system:node:ip-10-0-131-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-181.ec2.internal' and this object" podUID="d2512bfc-0c66-46fd-846d-820ae30d5296" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n" Jul 09 01:44:28.902724 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:44:28.902698 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bkzzl\" is forbidden: User \"system:node:ip-10-0-131-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-181.ec2.internal' and this object" podUID="2412c02f-0615-40d0-94d5-aef974b75531" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzzl" Jul 09 01:44:28.903363 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.903344 2564 scope.go:117] "RemoveContainer" containerID="4afc2ae45fcb28516c3595309bbcf19139c44be426a553babaee29f1a5f6861f" Jul 09 01:44:28.903607 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:44:28.903590 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4afc2ae45fcb28516c3595309bbcf19139c44be426a553babaee29f1a5f6861f\": container with ID starting with 4afc2ae45fcb28516c3595309bbcf19139c44be426a553babaee29f1a5f6861f not found: ID does not exist" containerID="4afc2ae45fcb28516c3595309bbcf19139c44be426a553babaee29f1a5f6861f" Jul 09 01:44:28.903660 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.903617 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4afc2ae45fcb28516c3595309bbcf19139c44be426a553babaee29f1a5f6861f"} err="failed to get container status \"4afc2ae45fcb28516c3595309bbcf19139c44be426a553babaee29f1a5f6861f\": rpc error: code = NotFound desc = could not find container \"4afc2ae45fcb28516c3595309bbcf19139c44be426a553babaee29f1a5f6861f\": container with ID starting with 4afc2ae45fcb28516c3595309bbcf19139c44be426a553babaee29f1a5f6861f not found: ID does not exist" Jul 09 01:44:28.903660 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.903640 2564 scope.go:117] "RemoveContainer" containerID="0b241884d0c61e71f824233223cb3694e356492556fdbe3f00646f137b1cc487" Jul 09 01:44:28.911068 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.911053 2564 scope.go:117] "RemoveContainer" containerID="0b241884d0c61e71f824233223cb3694e356492556fdbe3f00646f137b1cc487" Jul 09 01:44:28.911285 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:44:28.911267 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b241884d0c61e71f824233223cb3694e356492556fdbe3f00646f137b1cc487\": container with ID starting with 0b241884d0c61e71f824233223cb3694e356492556fdbe3f00646f137b1cc487 not found: ID does not exist" containerID="0b241884d0c61e71f824233223cb3694e356492556fdbe3f00646f137b1cc487" Jul 09 01:44:28.911355 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.911289 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b241884d0c61e71f824233223cb3694e356492556fdbe3f00646f137b1cc487"} err="failed to get container status \"0b241884d0c61e71f824233223cb3694e356492556fdbe3f00646f137b1cc487\": rpc error: code = NotFound desc = could not find container \"0b241884d0c61e71f824233223cb3694e356492556fdbe3f00646f137b1cc487\": container with ID starting with 0b241884d0c61e71f824233223cb3694e356492556fdbe3f00646f137b1cc487 not found: ID does not exist" Jul 09 01:44:28.986458 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.986426 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-slh5s" Jul 09 01:44:28.995678 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.995652 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4mtm" Jul 09 01:44:28.998644 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.998531 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2512bfc-0c66-46fd-846d-820ae30d5296-extensions-socket-volume\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:44:28.998644 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.998548 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9s5c\" (UniqueName: \"kubernetes.io/projected/d2512bfc-0c66-46fd-846d-820ae30d5296-kube-api-access-v9s5c\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:44:28.998644 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:28.998558 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lst8k\" (UniqueName: \"kubernetes.io/projected/2412c02f-0615-40d0-94d5-aef974b75531-kube-api-access-lst8k\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:44:29.003704 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:29.003675 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mddc9" Jul 09 01:44:29.156611 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:29.156581 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-slh5s"] Jul 09 01:44:29.157710 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:44:29.157684 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ce07575_d204_4148_8ead_e9b921c24a27.slice/crio-14f1a8d6779713ba9bdd538ef94e20e6d1a04c67d366fc187c9a459665335bee WatchSource:0}: Error finding container 14f1a8d6779713ba9bdd538ef94e20e6d1a04c67d366fc187c9a459665335bee: Status 404 returned error can't find the container with id 14f1a8d6779713ba9bdd538ef94e20e6d1a04c67d366fc187c9a459665335bee Jul 09 01:44:29.171794 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:29.171769 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4mtm"] Jul 09 01:44:29.173853 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:44:29.173826 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29bb04b1_f0c0_4a73_a29b_efe3b872bcf1.slice/crio-bd3bb03332c133b29b6d50e7fd11b7a95c7ef57dfbff6df547c24eba0d5ce547 WatchSource:0}: Error finding container bd3bb03332c133b29b6d50e7fd11b7a95c7ef57dfbff6df547c24eba0d5ce547: Status 404 returned error can't find the container with id bd3bb03332c133b29b6d50e7fd11b7a95c7ef57dfbff6df547c24eba0d5ce547 Jul 09 01:44:29.186624 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:29.186515 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mddc9"] Jul 09 01:44:29.187811 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:44:29.187783 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod218fed09_3f69_40c9_855e_55402a404371.slice/crio-623b6aa6fe9336edb4f963d8cc29f8d0acfffa61c1c759c2ae68c283f85fe0c5 WatchSource:0}: Error finding container 623b6aa6fe9336edb4f963d8cc29f8d0acfffa61c1c759c2ae68c283f85fe0c5: Status 404 returned error can't find the container with id 623b6aa6fe9336edb4f963d8cc29f8d0acfffa61c1c759c2ae68c283f85fe0c5 Jul 09 01:44:29.211654 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:44:29.211612 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-b5q9n\" is forbidden: User \"system:node:ip-10-0-131-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-181.ec2.internal' and this object" podUID="d2512bfc-0c66-46fd-846d-820ae30d5296" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n" Jul 09 01:44:29.213518 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:44:29.213303 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bkzzl\" is forbidden: User \"system:node:ip-10-0-131-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-181.ec2.internal' and this object" podUID="2412c02f-0615-40d0-94d5-aef974b75531" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzzl" Jul 09 01:44:29.214994 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:44:29.214968 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bkzzl\" is forbidden: User \"system:node:ip-10-0-131-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-181.ec2.internal' and this object" podUID="2412c02f-0615-40d0-94d5-aef974b75531" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzzl" Jul 09 01:44:29.216569 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:44:29.216542 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-b5q9n\" is forbidden: User \"system:node:ip-10-0-131-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-181.ec2.internal' and this object" podUID="d2512bfc-0c66-46fd-846d-820ae30d5296" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n" Jul 09 01:44:29.848038 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:29.848009 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zjbpv" Jul 09 01:44:29.849870 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:44:29.849847 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bkzzl\" is forbidden: User \"system:node:ip-10-0-131-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-181.ec2.internal' and this object" podUID="2412c02f-0615-40d0-94d5-aef974b75531" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bkzzl" Jul 09 01:44:29.868404 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:29.868365 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2412c02f-0615-40d0-94d5-aef974b75531" path="/var/lib/kubelet/pods/2412c02f-0615-40d0-94d5-aef974b75531/volumes" Jul 09 01:44:29.868975 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:29.868944 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2512bfc-0c66-46fd-846d-820ae30d5296" path="/var/lib/kubelet/pods/d2512bfc-0c66-46fd-846d-820ae30d5296/volumes" Jul 09 01:44:29.870114 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:44:29.870086 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-b5q9n\" is forbidden: User \"system:node:ip-10-0-131-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-181.ec2.internal' and this object" podUID="d2512bfc-0c66-46fd-846d-820ae30d5296" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b5q9n" Jul 09 01:44:29.908305 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:29.908269 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mddc9" event={"ID":"218fed09-3f69-40c9-855e-55402a404371","Type":"ContainerStarted","Data":"c90e3c936ba475b65f39702a48a13b4dd1befb9aeec7b6fde53df848ede66c6e"} Jul 09 01:44:29.908461 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:29.908331 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mddc9" event={"ID":"218fed09-3f69-40c9-855e-55402a404371","Type":"ContainerStarted","Data":"623b6aa6fe9336edb4f963d8cc29f8d0acfffa61c1c759c2ae68c283f85fe0c5"} Jul 09 01:44:29.908461 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:29.908437 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mddc9" Jul 09 01:44:29.911078 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:29.911052 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-slh5s" event={"ID":"1ce07575-d204-4148-8ead-e9b921c24a27","Type":"ContainerStarted","Data":"6f0d96c16bf9798d74acb76c86914c7b2d5a78dd8a980d053f0cfe1dc4d0d18f"} Jul 09 01:44:29.911250 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:29.911100 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-slh5s" event={"ID":"1ce07575-d204-4148-8ead-e9b921c24a27","Type":"ContainerStarted","Data":"14f1a8d6779713ba9bdd538ef94e20e6d1a04c67d366fc187c9a459665335bee"} Jul 09 01:44:29.911250 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:29.911206 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-slh5s" Jul 09 01:44:29.912720 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:29.912698 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4mtm" event={"ID":"29bb04b1-f0c0-4a73-a29b-efe3b872bcf1","Type":"ContainerStarted","Data":"eaef34ee609ec124405fc7120f4a21f1962f1f2294cd2a7f1ca96041ae5d0cb1"} Jul 09 01:44:29.912850 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:29.912732 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4mtm" event={"ID":"29bb04b1-f0c0-4a73-a29b-efe3b872bcf1","Type":"ContainerStarted","Data":"bd3bb03332c133b29b6d50e7fd11b7a95c7ef57dfbff6df547c24eba0d5ce547"} Jul 09 01:44:29.912850 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:29.912836 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4mtm" Jul 09 01:44:29.942473 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:29.942403 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mddc9" podStartSLOduration=1.942363797 podStartE2EDuration="1.942363797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:44:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:44:29.92445167 +0000 UTC m=+402.586189158" watchObservedRunningTime="2026-07-09 01:44:29.942363797 +0000 UTC m=+402.604101290" Jul 09 01:44:29.943921 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:29.943881 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4mtm" podStartSLOduration=1.943864681 podStartE2EDuration="1.943864681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:44:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:44:29.941730938 +0000 UTC m=+402.603468442" watchObservedRunningTime="2026-07-09 01:44:29.943864681 +0000 UTC m=+402.605602164" Jul 09 01:44:29.961584 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:29.961532 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-slh5s" podStartSLOduration=1.9615138060000001 podStartE2EDuration="1.961513806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:44:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:44:29.958558655 +0000 UTC m=+402.620296148" watchObservedRunningTime="2026-07-09 01:44:29.961513806 +0000 UTC m=+402.623251302" Jul 09 01:44:31.070739 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:44:31.070700 2564 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-q4jdg_kuadrant-system_98fc71ec-05d1-4ea5-864f-16b8832a2c6e_0(148cdb5abaf7ad4b5299491d16b7205590b9c0da6bdea8c40bb53523b9a47f2b): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-q4jdg to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" Jul 09 01:44:31.071036 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:44:31.070772 2564 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-q4jdg_kuadrant-system_98fc71ec-05d1-4ea5-864f-16b8832a2c6e_0(148cdb5abaf7ad4b5299491d16b7205590b9c0da6bdea8c40bb53523b9a47f2b): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-q4jdg to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q4jdg" Jul 09 01:44:31.924002 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:31.923970 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q4jdg" Jul 09 01:44:31.931897 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:31.931876 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q4jdg" Jul 09 01:44:31.933897 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:44:31.933875 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-q4jdg\" is forbidden: User \"system:node:ip-10-0-131-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-181.ec2.internal' and this object" podUID="98fc71ec-05d1-4ea5-864f-16b8832a2c6e" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q4jdg" Jul 09 01:44:32.023879 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:32.023847 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pz4j\" (UniqueName: \"kubernetes.io/projected/98fc71ec-05d1-4ea5-864f-16b8832a2c6e-kube-api-access-4pz4j\") pod \"98fc71ec-05d1-4ea5-864f-16b8832a2c6e\" (UID: \"98fc71ec-05d1-4ea5-864f-16b8832a2c6e\") " Jul 09 01:44:32.024015 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:32.023910 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/98fc71ec-05d1-4ea5-864f-16b8832a2c6e-extensions-socket-volume\") pod \"98fc71ec-05d1-4ea5-864f-16b8832a2c6e\" (UID: \"98fc71ec-05d1-4ea5-864f-16b8832a2c6e\") " Jul 09 01:44:32.024158 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:32.024137 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98fc71ec-05d1-4ea5-864f-16b8832a2c6e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "98fc71ec-05d1-4ea5-864f-16b8832a2c6e" (UID: "98fc71ec-05d1-4ea5-864f-16b8832a2c6e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 01:44:32.026021 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:32.025996 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98fc71ec-05d1-4ea5-864f-16b8832a2c6e-kube-api-access-4pz4j" (OuterVolumeSpecName: "kube-api-access-4pz4j") pod "98fc71ec-05d1-4ea5-864f-16b8832a2c6e" (UID: "98fc71ec-05d1-4ea5-864f-16b8832a2c6e"). InnerVolumeSpecName "kube-api-access-4pz4j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 01:44:32.125100 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:32.125062 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pz4j\" (UniqueName: \"kubernetes.io/projected/98fc71ec-05d1-4ea5-864f-16b8832a2c6e-kube-api-access-4pz4j\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:44:32.125100 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:32.125094 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/98fc71ec-05d1-4ea5-864f-16b8832a2c6e-extensions-socket-volume\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:44:32.929383 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:32.929348 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q4jdg" Jul 09 01:44:32.931704 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:44:32.931668 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-q4jdg\" is forbidden: User \"system:node:ip-10-0-131-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-181.ec2.internal' and this object" podUID="98fc71ec-05d1-4ea5-864f-16b8832a2c6e" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q4jdg" Jul 09 01:44:32.937402 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:44:32.937376 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-q4jdg\" is forbidden: User \"system:node:ip-10-0-131-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-181.ec2.internal' and this object" podUID="98fc71ec-05d1-4ea5-864f-16b8832a2c6e" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q4jdg" Jul 09 01:44:33.866554 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:33.866517 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98fc71ec-05d1-4ea5-864f-16b8832a2c6e" path="/var/lib/kubelet/pods/98fc71ec-05d1-4ea5-864f-16b8832a2c6e/volumes" Jul 09 01:44:40.921313 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:40.921284 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mddc9" Jul 09 01:44:40.921848 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:40.921353 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4mtm" Jul 09 01:44:40.921848 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:40.921385 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-slh5s" Jul 09 01:44:40.991461 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:40.991430 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4mtm"] Jul 09 01:44:40.991670 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:40.991645 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4mtm" podUID="29bb04b1-f0c0-4a73-a29b-efe3b872bcf1" containerName="manager" containerID="cri-o://eaef34ee609ec124405fc7120f4a21f1962f1f2294cd2a7f1ca96041ae5d0cb1" gracePeriod=10 Jul 09 01:44:41.208333 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:41.208302 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k956x"] Jul 09 01:44:41.212022 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:41.212004 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k956x" Jul 09 01:44:41.228813 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:41.228778 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k956x"] Jul 09 01:44:41.246637 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:41.246603 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4mtm" Jul 09 01:44:41.301788 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:41.301758 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxc8v\" (UniqueName: \"kubernetes.io/projected/29bb04b1-f0c0-4a73-a29b-efe3b872bcf1-kube-api-access-fxc8v\") pod \"29bb04b1-f0c0-4a73-a29b-efe3b872bcf1\" (UID: \"29bb04b1-f0c0-4a73-a29b-efe3b872bcf1\") " Jul 09 01:44:41.301930 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:41.301828 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29bb04b1-f0c0-4a73-a29b-efe3b872bcf1-extensions-socket-volume\") pod \"29bb04b1-f0c0-4a73-a29b-efe3b872bcf1\" (UID: \"29bb04b1-f0c0-4a73-a29b-efe3b872bcf1\") " Jul 09 01:44:41.301930 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:41.301909 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgs4p\" (UniqueName: \"kubernetes.io/projected/288a2954-164c-4038-bbb5-32c629c265f4-kube-api-access-pgs4p\") pod \"kuadrant-operator-controller-manager-86878c769f-k956x\" (UID: \"288a2954-164c-4038-bbb5-32c629c265f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k956x" Jul 09 01:44:41.302326 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:41.301960 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/288a2954-164c-4038-bbb5-32c629c265f4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k956x\" (UID: \"288a2954-164c-4038-bbb5-32c629c265f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k956x" Jul 09 01:44:41.302326 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:41.302165 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29bb04b1-f0c0-4a73-a29b-efe3b872bcf1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "29bb04b1-f0c0-4a73-a29b-efe3b872bcf1" (UID: "29bb04b1-f0c0-4a73-a29b-efe3b872bcf1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 01:44:41.303748 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:41.303722 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29bb04b1-f0c0-4a73-a29b-efe3b872bcf1-kube-api-access-fxc8v" (OuterVolumeSpecName: "kube-api-access-fxc8v") pod "29bb04b1-f0c0-4a73-a29b-efe3b872bcf1" (UID: "29bb04b1-f0c0-4a73-a29b-efe3b872bcf1"). InnerVolumeSpecName "kube-api-access-fxc8v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 01:44:41.403458 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:41.403429 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgs4p\" (UniqueName: \"kubernetes.io/projected/288a2954-164c-4038-bbb5-32c629c265f4-kube-api-access-pgs4p\") pod \"kuadrant-operator-controller-manager-86878c769f-k956x\" (UID: \"288a2954-164c-4038-bbb5-32c629c265f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k956x" Jul 09 01:44:41.403633 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:41.403481 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/288a2954-164c-4038-bbb5-32c629c265f4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k956x\" (UID: \"288a2954-164c-4038-bbb5-32c629c265f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k956x" Jul 09 01:44:41.403633 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:41.403517 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxc8v\" (UniqueName: \"kubernetes.io/projected/29bb04b1-f0c0-4a73-a29b-efe3b872bcf1-kube-api-access-fxc8v\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:44:41.403633 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:41.403528 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29bb04b1-f0c0-4a73-a29b-efe3b872bcf1-extensions-socket-volume\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:44:41.403846 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:41.403832 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/288a2954-164c-4038-bbb5-32c629c265f4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k956x\" (UID: \"288a2954-164c-4038-bbb5-32c629c265f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k956x" Jul 09 01:44:41.414101 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:41.414080 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgs4p\" (UniqueName: \"kubernetes.io/projected/288a2954-164c-4038-bbb5-32c629c265f4-kube-api-access-pgs4p\") pod \"kuadrant-operator-controller-manager-86878c769f-k956x\" (UID: \"288a2954-164c-4038-bbb5-32c629c265f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k956x" Jul 09 01:44:41.542324 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:41.542212 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k956x" Jul 09 01:44:41.682175 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:41.682145 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k956x"] Jul 09 01:44:41.685597 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:44:41.685573 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod288a2954_164c_4038_bbb5_32c629c265f4.slice/crio-1a7422bcfcf9a9e511c9470b5ade29b5f4e7605206af25b032c22dc23cc41bfd WatchSource:0}: Error finding container 1a7422bcfcf9a9e511c9470b5ade29b5f4e7605206af25b032c22dc23cc41bfd: Status 404 returned error can't find the container with id 1a7422bcfcf9a9e511c9470b5ade29b5f4e7605206af25b032c22dc23cc41bfd Jul 09 01:44:41.977794 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:41.977763 2564 generic.go:356] "Generic (PLEG): container finished" podID="29bb04b1-f0c0-4a73-a29b-efe3b872bcf1" containerID="eaef34ee609ec124405fc7120f4a21f1962f1f2294cd2a7f1ca96041ae5d0cb1" exitCode=0 Jul 09 01:44:41.978282 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:41.977820 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4mtm" Jul 09 01:44:41.978282 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:41.977839 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4mtm" event={"ID":"29bb04b1-f0c0-4a73-a29b-efe3b872bcf1","Type":"ContainerDied","Data":"eaef34ee609ec124405fc7120f4a21f1962f1f2294cd2a7f1ca96041ae5d0cb1"} Jul 09 01:44:41.978282 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:41.977883 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4mtm" event={"ID":"29bb04b1-f0c0-4a73-a29b-efe3b872bcf1","Type":"ContainerDied","Data":"bd3bb03332c133b29b6d50e7fd11b7a95c7ef57dfbff6df547c24eba0d5ce547"} Jul 09 01:44:41.978282 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:41.977911 2564 scope.go:117] "RemoveContainer" containerID="eaef34ee609ec124405fc7120f4a21f1962f1f2294cd2a7f1ca96041ae5d0cb1" Jul 09 01:44:41.979779 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:41.979744 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k956x" event={"ID":"288a2954-164c-4038-bbb5-32c629c265f4","Type":"ContainerStarted","Data":"8ae6ee202805ac905a732fd2aa76db6c8c015876e4d453a4869d6940d7a9f9ff"} Jul 09 01:44:41.979904 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:41.979788 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k956x" event={"ID":"288a2954-164c-4038-bbb5-32c629c265f4","Type":"ContainerStarted","Data":"1a7422bcfcf9a9e511c9470b5ade29b5f4e7605206af25b032c22dc23cc41bfd"} Jul 09 01:44:41.979904 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:41.979876 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k956x" Jul 09 01:44:41.987143 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:41.987126 2564 scope.go:117] "RemoveContainer" containerID="eaef34ee609ec124405fc7120f4a21f1962f1f2294cd2a7f1ca96041ae5d0cb1" Jul 09 01:44:41.987424 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:44:41.987398 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaef34ee609ec124405fc7120f4a21f1962f1f2294cd2a7f1ca96041ae5d0cb1\": container with ID starting with eaef34ee609ec124405fc7120f4a21f1962f1f2294cd2a7f1ca96041ae5d0cb1 not found: ID does not exist" containerID="eaef34ee609ec124405fc7120f4a21f1962f1f2294cd2a7f1ca96041ae5d0cb1" Jul 09 01:44:41.987491 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:41.987425 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaef34ee609ec124405fc7120f4a21f1962f1f2294cd2a7f1ca96041ae5d0cb1"} err="failed to get container status \"eaef34ee609ec124405fc7120f4a21f1962f1f2294cd2a7f1ca96041ae5d0cb1\": rpc error: code = NotFound desc = could not find container \"eaef34ee609ec124405fc7120f4a21f1962f1f2294cd2a7f1ca96041ae5d0cb1\": container with ID starting with eaef34ee609ec124405fc7120f4a21f1962f1f2294cd2a7f1ca96041ae5d0cb1 not found: ID does not exist" Jul 09 01:44:42.000185 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:42.000138 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k956x" podStartSLOduration=1.000122998 podStartE2EDuration="1.000122998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:44:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:44:41.998551878 +0000 UTC m=+414.660289371" watchObservedRunningTime="2026-07-09 01:44:42.000122998 +0000 UTC m=+414.661860502" Jul 09 01:44:42.015828 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:42.015797 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4mtm"] Jul 09 01:44:42.023364 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:42.023337 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f4mtm"] Jul 09 01:44:42.987967 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:42.987921 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5445498bf7-xbjsl"] Jul 09 01:44:43.867208 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:43.867176 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29bb04b1-f0c0-4a73-a29b-efe3b872bcf1" path="/var/lib/kubelet/pods/29bb04b1-f0c0-4a73-a29b-efe3b872bcf1/volumes" Jul 09 01:44:52.990566 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:52.990536 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k956x" Jul 09 01:44:53.040425 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:53.040391 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-slh5s"] Jul 09 01:44:53.040621 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:53.040580 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-slh5s" podUID="1ce07575-d204-4148-8ead-e9b921c24a27" containerName="manager" containerID="cri-o://6f0d96c16bf9798d74acb76c86914c7b2d5a78dd8a980d053f0cfe1dc4d0d18f" gracePeriod=10 Jul 09 01:44:53.294593 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:53.294568 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-slh5s" Jul 09 01:44:53.406580 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:53.406543 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hkk2\" (UniqueName: \"kubernetes.io/projected/1ce07575-d204-4148-8ead-e9b921c24a27-kube-api-access-7hkk2\") pod \"1ce07575-d204-4148-8ead-e9b921c24a27\" (UID: \"1ce07575-d204-4148-8ead-e9b921c24a27\") " Jul 09 01:44:53.406580 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:53.406588 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ce07575-d204-4148-8ead-e9b921c24a27-extensions-socket-volume\") pod \"1ce07575-d204-4148-8ead-e9b921c24a27\" (UID: \"1ce07575-d204-4148-8ead-e9b921c24a27\") " Jul 09 01:44:53.406980 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:53.406954 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ce07575-d204-4148-8ead-e9b921c24a27-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1ce07575-d204-4148-8ead-e9b921c24a27" (UID: "1ce07575-d204-4148-8ead-e9b921c24a27"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 01:44:53.408633 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:53.408610 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ce07575-d204-4148-8ead-e9b921c24a27-kube-api-access-7hkk2" (OuterVolumeSpecName: "kube-api-access-7hkk2") pod "1ce07575-d204-4148-8ead-e9b921c24a27" (UID: "1ce07575-d204-4148-8ead-e9b921c24a27"). InnerVolumeSpecName "kube-api-access-7hkk2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 01:44:53.507286 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:53.507226 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hkk2\" (UniqueName: \"kubernetes.io/projected/1ce07575-d204-4148-8ead-e9b921c24a27-kube-api-access-7hkk2\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:44:53.507286 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:53.507277 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ce07575-d204-4148-8ead-e9b921c24a27-extensions-socket-volume\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:44:54.049967 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:54.049935 2564 generic.go:356] "Generic (PLEG): container finished" podID="1ce07575-d204-4148-8ead-e9b921c24a27" containerID="6f0d96c16bf9798d74acb76c86914c7b2d5a78dd8a980d053f0cfe1dc4d0d18f" exitCode=0 Jul 09 01:44:54.049967 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:54.049972 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-slh5s" event={"ID":"1ce07575-d204-4148-8ead-e9b921c24a27","Type":"ContainerDied","Data":"6f0d96c16bf9798d74acb76c86914c7b2d5a78dd8a980d053f0cfe1dc4d0d18f"} Jul 09 01:44:54.050484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:54.049975 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-slh5s" Jul 09 01:44:54.050484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:54.050016 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-slh5s" event={"ID":"1ce07575-d204-4148-8ead-e9b921c24a27","Type":"ContainerDied","Data":"14f1a8d6779713ba9bdd538ef94e20e6d1a04c67d366fc187c9a459665335bee"} Jul 09 01:44:54.050484 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:54.050038 2564 scope.go:117] "RemoveContainer" containerID="6f0d96c16bf9798d74acb76c86914c7b2d5a78dd8a980d053f0cfe1dc4d0d18f" Jul 09 01:44:54.059645 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:54.059619 2564 scope.go:117] "RemoveContainer" containerID="6f0d96c16bf9798d74acb76c86914c7b2d5a78dd8a980d053f0cfe1dc4d0d18f" Jul 09 01:44:54.059964 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:44:54.059941 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f0d96c16bf9798d74acb76c86914c7b2d5a78dd8a980d053f0cfe1dc4d0d18f\": container with ID starting with 6f0d96c16bf9798d74acb76c86914c7b2d5a78dd8a980d053f0cfe1dc4d0d18f not found: ID does not exist" containerID="6f0d96c16bf9798d74acb76c86914c7b2d5a78dd8a980d053f0cfe1dc4d0d18f" Jul 09 01:44:54.060028 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:54.059977 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f0d96c16bf9798d74acb76c86914c7b2d5a78dd8a980d053f0cfe1dc4d0d18f"} err="failed to get container status \"6f0d96c16bf9798d74acb76c86914c7b2d5a78dd8a980d053f0cfe1dc4d0d18f\": rpc error: code = NotFound desc = could not find container \"6f0d96c16bf9798d74acb76c86914c7b2d5a78dd8a980d053f0cfe1dc4d0d18f\": container with ID starting with 6f0d96c16bf9798d74acb76c86914c7b2d5a78dd8a980d053f0cfe1dc4d0d18f not found: ID does not exist" Jul 09 01:44:54.071190 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:54.071164 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-slh5s"] Jul 09 01:44:54.075471 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:54.075449 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-slh5s"] Jul 09 01:44:55.867242 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:44:55.867200 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ce07575-d204-4148-8ead-e9b921c24a27" path="/var/lib/kubelet/pods/1ce07575-d204-4148-8ead-e9b921c24a27/volumes" Jul 09 01:45:08.018296 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:08.018208 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5445498bf7-xbjsl" podUID="2200fc69-5995-46b7-b8e3-e7f14f66fd36" containerName="console" containerID="cri-o://073f70347d39725f4bf3aff2f140bd5a9a32a69b097770f2a5d879dbaefb3b56" gracePeriod=15 Jul 09 01:45:08.275766 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:08.275702 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5445498bf7-xbjsl" Jul 09 01:45:08.434300 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:08.434263 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2200fc69-5995-46b7-b8e3-e7f14f66fd36-console-config\") pod \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\" (UID: \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\") " Jul 09 01:45:08.434640 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:08.434311 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2200fc69-5995-46b7-b8e3-e7f14f66fd36-trusted-ca-bundle\") pod \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\" (UID: \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\") " Jul 09 01:45:08.434640 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:08.434334 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2200fc69-5995-46b7-b8e3-e7f14f66fd36-service-ca\") pod \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\" (UID: \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\") " Jul 09 01:45:08.434640 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:08.434375 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2200fc69-5995-46b7-b8e3-e7f14f66fd36-console-oauth-config\") pod \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\" (UID: \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\") " Jul 09 01:45:08.434640 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:08.434436 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2xw6\" (UniqueName: \"kubernetes.io/projected/2200fc69-5995-46b7-b8e3-e7f14f66fd36-kube-api-access-b2xw6\") pod \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\" (UID: \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\") " Jul 09 01:45:08.434640 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:08.434464 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2200fc69-5995-46b7-b8e3-e7f14f66fd36-console-serving-cert\") pod \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\" (UID: \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\") " Jul 09 01:45:08.434640 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:08.434494 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2200fc69-5995-46b7-b8e3-e7f14f66fd36-oauth-serving-cert\") pod \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\" (UID: \"2200fc69-5995-46b7-b8e3-e7f14f66fd36\") " Jul 09 01:45:08.435052 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:08.434735 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2200fc69-5995-46b7-b8e3-e7f14f66fd36-service-ca" (OuterVolumeSpecName: "service-ca") pod "2200fc69-5995-46b7-b8e3-e7f14f66fd36" (UID: "2200fc69-5995-46b7-b8e3-e7f14f66fd36"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 01:45:08.435052 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:08.434769 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2200fc69-5995-46b7-b8e3-e7f14f66fd36-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2200fc69-5995-46b7-b8e3-e7f14f66fd36" (UID: "2200fc69-5995-46b7-b8e3-e7f14f66fd36"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 01:45:08.435214 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:08.435109 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2200fc69-5995-46b7-b8e3-e7f14f66fd36-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2200fc69-5995-46b7-b8e3-e7f14f66fd36" (UID: "2200fc69-5995-46b7-b8e3-e7f14f66fd36"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 01:45:08.435214 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:08.435176 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2200fc69-5995-46b7-b8e3-e7f14f66fd36-console-config" (OuterVolumeSpecName: "console-config") pod "2200fc69-5995-46b7-b8e3-e7f14f66fd36" (UID: "2200fc69-5995-46b7-b8e3-e7f14f66fd36"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 01:45:08.436917 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:08.436886 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2200fc69-5995-46b7-b8e3-e7f14f66fd36-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2200fc69-5995-46b7-b8e3-e7f14f66fd36" (UID: "2200fc69-5995-46b7-b8e3-e7f14f66fd36"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 01:45:08.437193 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:08.437172 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2200fc69-5995-46b7-b8e3-e7f14f66fd36-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2200fc69-5995-46b7-b8e3-e7f14f66fd36" (UID: "2200fc69-5995-46b7-b8e3-e7f14f66fd36"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 01:45:08.437280 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:08.437184 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2200fc69-5995-46b7-b8e3-e7f14f66fd36-kube-api-access-b2xw6" (OuterVolumeSpecName: "kube-api-access-b2xw6") pod "2200fc69-5995-46b7-b8e3-e7f14f66fd36" (UID: "2200fc69-5995-46b7-b8e3-e7f14f66fd36"). InnerVolumeSpecName "kube-api-access-b2xw6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 01:45:08.535910 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:08.535821 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2200fc69-5995-46b7-b8e3-e7f14f66fd36-console-serving-cert\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:45:08.535910 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:08.535849 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2200fc69-5995-46b7-b8e3-e7f14f66fd36-oauth-serving-cert\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:45:08.535910 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:08.535861 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2200fc69-5995-46b7-b8e3-e7f14f66fd36-console-config\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:45:08.535910 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:08.535873 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2200fc69-5995-46b7-b8e3-e7f14f66fd36-trusted-ca-bundle\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:45:08.535910 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:08.535884 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2200fc69-5995-46b7-b8e3-e7f14f66fd36-service-ca\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:45:08.535910 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:08.535895 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2200fc69-5995-46b7-b8e3-e7f14f66fd36-console-oauth-config\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:45:08.535910 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:08.535912 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2xw6\" (UniqueName: \"kubernetes.io/projected/2200fc69-5995-46b7-b8e3-e7f14f66fd36-kube-api-access-b2xw6\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:45:09.130041 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:09.130008 2564 generic.go:356] "Generic (PLEG): container finished" podID="2200fc69-5995-46b7-b8e3-e7f14f66fd36" containerID="073f70347d39725f4bf3aff2f140bd5a9a32a69b097770f2a5d879dbaefb3b56" exitCode=0 Jul 09 01:45:09.130487 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:09.130056 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5445498bf7-xbjsl" Jul 09 01:45:09.130487 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:09.130089 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5445498bf7-xbjsl" event={"ID":"2200fc69-5995-46b7-b8e3-e7f14f66fd36","Type":"ContainerDied","Data":"073f70347d39725f4bf3aff2f140bd5a9a32a69b097770f2a5d879dbaefb3b56"} Jul 09 01:45:09.130487 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:09.130140 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5445498bf7-xbjsl" event={"ID":"2200fc69-5995-46b7-b8e3-e7f14f66fd36","Type":"ContainerDied","Data":"7284c9b2e06b52a62101310dd37fb71ea7f649fab78c97ca42c1ef4e2a232958"} Jul 09 01:45:09.130487 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:09.130159 2564 scope.go:117] "RemoveContainer" containerID="073f70347d39725f4bf3aff2f140bd5a9a32a69b097770f2a5d879dbaefb3b56" Jul 09 01:45:09.139377 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:09.139359 2564 scope.go:117] "RemoveContainer" containerID="073f70347d39725f4bf3aff2f140bd5a9a32a69b097770f2a5d879dbaefb3b56" Jul 09 01:45:09.139619 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:45:09.139603 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"073f70347d39725f4bf3aff2f140bd5a9a32a69b097770f2a5d879dbaefb3b56\": container with ID starting with 073f70347d39725f4bf3aff2f140bd5a9a32a69b097770f2a5d879dbaefb3b56 not found: ID does not exist" containerID="073f70347d39725f4bf3aff2f140bd5a9a32a69b097770f2a5d879dbaefb3b56" Jul 09 01:45:09.139678 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:09.139627 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"073f70347d39725f4bf3aff2f140bd5a9a32a69b097770f2a5d879dbaefb3b56"} err="failed to get container status \"073f70347d39725f4bf3aff2f140bd5a9a32a69b097770f2a5d879dbaefb3b56\": rpc error: code = NotFound desc = could not find container \"073f70347d39725f4bf3aff2f140bd5a9a32a69b097770f2a5d879dbaefb3b56\": container with ID starting with 073f70347d39725f4bf3aff2f140bd5a9a32a69b097770f2a5d879dbaefb3b56 not found: ID does not exist" Jul 09 01:45:09.150541 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:09.150509 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5445498bf7-xbjsl"] Jul 09 01:45:09.152736 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:09.152715 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5445498bf7-xbjsl"] Jul 09 01:45:09.868494 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:09.867405 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2200fc69-5995-46b7-b8e3-e7f14f66fd36" path="/var/lib/kubelet/pods/2200fc69-5995-46b7-b8e3-e7f14f66fd36/volumes" Jul 09 01:45:12.227683 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:12.227622 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r6rbd"] Jul 09 01:45:12.228334 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:12.228296 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2200fc69-5995-46b7-b8e3-e7f14f66fd36" containerName="console" Jul 09 01:45:12.228334 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:12.228318 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2200fc69-5995-46b7-b8e3-e7f14f66fd36" containerName="console" Jul 09 01:45:12.228477 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:12.228353 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ce07575-d204-4148-8ead-e9b921c24a27" containerName="manager" Jul 09 01:45:12.228477 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:12.228362 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ce07575-d204-4148-8ead-e9b921c24a27" containerName="manager" Jul 09 01:45:12.228477 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:12.228379 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29bb04b1-f0c0-4a73-a29b-efe3b872bcf1" containerName="manager" Jul 09 01:45:12.228477 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:12.228387 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="29bb04b1-f0c0-4a73-a29b-efe3b872bcf1" containerName="manager" Jul 09 01:45:12.228675 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:12.228487 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ce07575-d204-4148-8ead-e9b921c24a27" containerName="manager" Jul 09 01:45:12.228675 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:12.228503 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="29bb04b1-f0c0-4a73-a29b-efe3b872bcf1" containerName="manager" Jul 09 01:45:12.228675 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:12.228513 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2200fc69-5995-46b7-b8e3-e7f14f66fd36" containerName="console" Jul 09 01:45:12.231300 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:12.231278 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6rbd" Jul 09 01:45:12.233522 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:12.233498 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 09 01:45:12.233688 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:12.233670 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9s292\"" Jul 09 01:45:12.239667 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:12.239644 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r6rbd"] Jul 09 01:45:12.323559 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:12.323523 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r6rbd"] Jul 09 01:45:12.369064 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:12.369029 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8881899b-1d9b-4d84-a965-e2caa277e2c2-config-file\") pod \"limitador-limitador-64c94fd64f-r6rbd\" (UID: \"8881899b-1d9b-4d84-a965-e2caa277e2c2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r6rbd" Jul 09 01:45:12.369226 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:12.369081 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zqql\" (UniqueName: \"kubernetes.io/projected/8881899b-1d9b-4d84-a965-e2caa277e2c2-kube-api-access-2zqql\") pod \"limitador-limitador-64c94fd64f-r6rbd\" (UID: \"8881899b-1d9b-4d84-a965-e2caa277e2c2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r6rbd" Jul 09 01:45:12.469546 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:12.469514 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8881899b-1d9b-4d84-a965-e2caa277e2c2-config-file\") pod \"limitador-limitador-64c94fd64f-r6rbd\" (UID: \"8881899b-1d9b-4d84-a965-e2caa277e2c2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r6rbd" Jul 09 01:45:12.469713 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:12.469594 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zqql\" (UniqueName: \"kubernetes.io/projected/8881899b-1d9b-4d84-a965-e2caa277e2c2-kube-api-access-2zqql\") pod \"limitador-limitador-64c94fd64f-r6rbd\" (UID: \"8881899b-1d9b-4d84-a965-e2caa277e2c2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r6rbd" Jul 09 01:45:12.470145 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:12.470127 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8881899b-1d9b-4d84-a965-e2caa277e2c2-config-file\") pod \"limitador-limitador-64c94fd64f-r6rbd\" (UID: \"8881899b-1d9b-4d84-a965-e2caa277e2c2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r6rbd" Jul 09 01:45:12.477745 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:12.477689 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zqql\" (UniqueName: \"kubernetes.io/projected/8881899b-1d9b-4d84-a965-e2caa277e2c2-kube-api-access-2zqql\") pod \"limitador-limitador-64c94fd64f-r6rbd\" (UID: \"8881899b-1d9b-4d84-a965-e2caa277e2c2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r6rbd" Jul 09 01:45:12.542282 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:12.542228 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6rbd" Jul 09 01:45:12.680273 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:12.680246 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r6rbd"] Jul 09 01:45:12.682033 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:45:12.682009 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8881899b_1d9b_4d84_a965_e2caa277e2c2.slice/crio-db653f521b79a11d3d1519fd87fb07f06a787bc384ae8f53e186801ae4b14b13 WatchSource:0}: Error finding container db653f521b79a11d3d1519fd87fb07f06a787bc384ae8f53e186801ae4b14b13: Status 404 returned error can't find the container with id db653f521b79a11d3d1519fd87fb07f06a787bc384ae8f53e186801ae4b14b13 Jul 09 01:45:13.154273 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:13.154222 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6rbd" event={"ID":"8881899b-1d9b-4d84-a965-e2caa277e2c2","Type":"ContainerStarted","Data":"db653f521b79a11d3d1519fd87fb07f06a787bc384ae8f53e186801ae4b14b13"} Jul 09 01:45:16.174462 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:16.174426 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6rbd" event={"ID":"8881899b-1d9b-4d84-a965-e2caa277e2c2","Type":"ContainerStarted","Data":"4633e9875d9d3b1ddb4058f32b4d844125b19ba1d856b29cfad7c3561c3adc65"} Jul 09 01:45:16.174958 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:16.174561 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6rbd" Jul 09 01:45:16.189513 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:16.189433 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6rbd" podStartSLOduration=1.4660584 podStartE2EDuration="4.18941529s" totalImagesPullingTime="2.72335689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:45:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:45:16.188506826 +0000 UTC m=+448.850244320" watchObservedRunningTime="2026-07-09 01:45:16.18941529 +0000 UTC m=+448.851152783" Jul 09 01:45:27.181471 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:27.181440 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6rbd" Jul 09 01:45:27.430429 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:27.430393 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r6rbd"] Jul 09 01:45:27.430620 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:27.430578 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6rbd" podUID="8881899b-1d9b-4d84-a965-e2caa277e2c2" containerName="limitador" containerID="cri-o://4633e9875d9d3b1ddb4058f32b4d844125b19ba1d856b29cfad7c3561c3adc65" gracePeriod=30 Jul 09 01:45:27.989010 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:27.988958 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6rbd" Jul 09 01:45:27.998489 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:27.998467 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zqql\" (UniqueName: \"kubernetes.io/projected/8881899b-1d9b-4d84-a965-e2caa277e2c2-kube-api-access-2zqql\") pod \"8881899b-1d9b-4d84-a965-e2caa277e2c2\" (UID: \"8881899b-1d9b-4d84-a965-e2caa277e2c2\") " Jul 09 01:45:27.998611 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:27.998515 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8881899b-1d9b-4d84-a965-e2caa277e2c2-config-file\") pod \"8881899b-1d9b-4d84-a965-e2caa277e2c2\" (UID: \"8881899b-1d9b-4d84-a965-e2caa277e2c2\") " Jul 09 01:45:27.998875 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:27.998842 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8881899b-1d9b-4d84-a965-e2caa277e2c2-config-file" (OuterVolumeSpecName: "config-file") pod "8881899b-1d9b-4d84-a965-e2caa277e2c2" (UID: "8881899b-1d9b-4d84-a965-e2caa277e2c2"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 01:45:28.000461 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:28.000440 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8881899b-1d9b-4d84-a965-e2caa277e2c2-kube-api-access-2zqql" (OuterVolumeSpecName: "kube-api-access-2zqql") pod "8881899b-1d9b-4d84-a965-e2caa277e2c2" (UID: "8881899b-1d9b-4d84-a965-e2caa277e2c2"). InnerVolumeSpecName "kube-api-access-2zqql". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 01:45:28.099284 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:28.099251 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zqql\" (UniqueName: \"kubernetes.io/projected/8881899b-1d9b-4d84-a965-e2caa277e2c2-kube-api-access-2zqql\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:45:28.099284 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:28.099279 2564 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8881899b-1d9b-4d84-a965-e2caa277e2c2-config-file\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:45:28.247031 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:28.246939 2564 generic.go:356] "Generic (PLEG): container finished" podID="8881899b-1d9b-4d84-a965-e2caa277e2c2" containerID="4633e9875d9d3b1ddb4058f32b4d844125b19ba1d856b29cfad7c3561c3adc65" exitCode=0 Jul 09 01:45:28.247031 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:28.246979 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6rbd" event={"ID":"8881899b-1d9b-4d84-a965-e2caa277e2c2","Type":"ContainerDied","Data":"4633e9875d9d3b1ddb4058f32b4d844125b19ba1d856b29cfad7c3561c3adc65"} Jul 09 01:45:28.247031 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:28.246985 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6rbd" Jul 09 01:45:28.247031 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:28.247030 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6rbd" event={"ID":"8881899b-1d9b-4d84-a965-e2caa277e2c2","Type":"ContainerDied","Data":"db653f521b79a11d3d1519fd87fb07f06a787bc384ae8f53e186801ae4b14b13"} Jul 09 01:45:28.247666 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:28.247061 2564 scope.go:117] "RemoveContainer" containerID="4633e9875d9d3b1ddb4058f32b4d844125b19ba1d856b29cfad7c3561c3adc65" Jul 09 01:45:28.257017 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:28.257002 2564 scope.go:117] "RemoveContainer" containerID="4633e9875d9d3b1ddb4058f32b4d844125b19ba1d856b29cfad7c3561c3adc65" Jul 09 01:45:28.257279 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:45:28.257260 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4633e9875d9d3b1ddb4058f32b4d844125b19ba1d856b29cfad7c3561c3adc65\": container with ID starting with 4633e9875d9d3b1ddb4058f32b4d844125b19ba1d856b29cfad7c3561c3adc65 not found: ID does not exist" containerID="4633e9875d9d3b1ddb4058f32b4d844125b19ba1d856b29cfad7c3561c3adc65" Jul 09 01:45:28.257331 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:28.257288 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4633e9875d9d3b1ddb4058f32b4d844125b19ba1d856b29cfad7c3561c3adc65"} err="failed to get container status \"4633e9875d9d3b1ddb4058f32b4d844125b19ba1d856b29cfad7c3561c3adc65\": rpc error: code = NotFound desc = could not find container \"4633e9875d9d3b1ddb4058f32b4d844125b19ba1d856b29cfad7c3561c3adc65\": container with ID starting with 4633e9875d9d3b1ddb4058f32b4d844125b19ba1d856b29cfad7c3561c3adc65 not found: ID does not exist" Jul 09 01:45:28.269918 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:28.269891 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r6rbd"] Jul 09 01:45:28.274483 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:28.274462 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r6rbd"] Jul 09 01:45:29.867195 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:29.867160 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8881899b-1d9b-4d84-a965-e2caa277e2c2" path="/var/lib/kubelet/pods/8881899b-1d9b-4d84-a965-e2caa277e2c2/volumes" Jul 09 01:45:31.276664 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:31.276631 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-g498d"] Jul 09 01:45:31.277080 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:31.276983 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8881899b-1d9b-4d84-a965-e2caa277e2c2" containerName="limitador" Jul 09 01:45:31.277080 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:31.276994 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8881899b-1d9b-4d84-a965-e2caa277e2c2" containerName="limitador" Jul 09 01:45:31.277080 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:31.277054 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8881899b-1d9b-4d84-a965-e2caa277e2c2" containerName="limitador" Jul 09 01:45:31.281155 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:31.281134 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g498d" Jul 09 01:45:31.283791 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:31.283770 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-6krbj\"" Jul 09 01:45:31.284264 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:31.284249 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 09 01:45:31.284653 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:31.284636 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 09 01:45:31.284994 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:31.284974 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 09 01:45:31.287754 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:31.287731 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-g498d"] Jul 09 01:45:31.323286 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:31.323252 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/94dfc2a3-6026-4960-883c-5622251798eb-data\") pod \"postgres-69fb4594cf-g498d\" (UID: \"94dfc2a3-6026-4960-883c-5622251798eb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g498d" Jul 09 01:45:31.323443 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:31.323303 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx422\" (UniqueName: \"kubernetes.io/projected/94dfc2a3-6026-4960-883c-5622251798eb-kube-api-access-cx422\") pod \"postgres-69fb4594cf-g498d\" (UID: \"94dfc2a3-6026-4960-883c-5622251798eb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g498d" Jul 09 01:45:31.424443 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:31.424407 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/94dfc2a3-6026-4960-883c-5622251798eb-data\") pod \"postgres-69fb4594cf-g498d\" (UID: \"94dfc2a3-6026-4960-883c-5622251798eb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g498d" Jul 09 01:45:31.424648 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:31.424454 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx422\" (UniqueName: \"kubernetes.io/projected/94dfc2a3-6026-4960-883c-5622251798eb-kube-api-access-cx422\") pod \"postgres-69fb4594cf-g498d\" (UID: \"94dfc2a3-6026-4960-883c-5622251798eb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g498d" Jul 09 01:45:31.424862 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:31.424836 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/94dfc2a3-6026-4960-883c-5622251798eb-data\") pod \"postgres-69fb4594cf-g498d\" (UID: \"94dfc2a3-6026-4960-883c-5622251798eb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g498d" Jul 09 01:45:31.433007 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:31.432976 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx422\" (UniqueName: \"kubernetes.io/projected/94dfc2a3-6026-4960-883c-5622251798eb-kube-api-access-cx422\") pod \"postgres-69fb4594cf-g498d\" (UID: \"94dfc2a3-6026-4960-883c-5622251798eb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g498d" Jul 09 01:45:31.592907 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:31.592812 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g498d" Jul 09 01:45:31.727717 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:31.727687 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-g498d"] Jul 09 01:45:31.729276 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:45:31.729226 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94dfc2a3_6026_4960_883c_5622251798eb.slice/crio-0bcd919733facb22681ef0fe4674739bbbe7ab05d43b4e3563e608930dc1a6fe WatchSource:0}: Error finding container 0bcd919733facb22681ef0fe4674739bbbe7ab05d43b4e3563e608930dc1a6fe: Status 404 returned error can't find the container with id 0bcd919733facb22681ef0fe4674739bbbe7ab05d43b4e3563e608930dc1a6fe Jul 09 01:45:32.271659 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:32.271621 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g498d" event={"ID":"94dfc2a3-6026-4960-883c-5622251798eb","Type":"ContainerStarted","Data":"0bcd919733facb22681ef0fe4674739bbbe7ab05d43b4e3563e608930dc1a6fe"} Jul 09 01:45:37.311879 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:37.311845 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g498d" event={"ID":"94dfc2a3-6026-4960-883c-5622251798eb","Type":"ContainerStarted","Data":"d6bc3880a4b3f206fc41686498a27a7692fad37cdb19847611e2742bdf655534"} Jul 09 01:45:37.312358 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:37.311922 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g498d" Jul 09 01:45:37.328972 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:37.328924 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g498d" podStartSLOduration=1.645356199 podStartE2EDuration="6.328908927s" totalImagesPullingTime="4.683552728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:45:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:45:37.326432433 +0000 UTC m=+469.988169925" watchObservedRunningTime="2026-07-09 01:45:37.328908927 +0000 UTC m=+469.990646418" Jul 09 01:45:43.348019 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:43.347990 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g498d" Jul 09 01:45:49.780517 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:49.780482 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f4c84696-94c5v"] Jul 09 01:45:49.806628 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:49.806596 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f4c84696-94c5v"] Jul 09 01:45:49.806788 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:49.806690 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f4c84696-94c5v" Jul 09 01:45:49.809035 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:49.809009 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 09 01:45:49.809858 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:49.809835 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4qxh5\"" Jul 09 01:45:49.809858 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:49.809853 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 09 01:45:49.887590 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:49.887557 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/182c4d60-e14f-495d-a721-9c7476b38d5f-webhook-cert\") pod \"maas-controller-6f4c84696-94c5v\" (UID: \"182c4d60-e14f-495d-a721-9c7476b38d5f\") " pod="opendatahub/maas-controller-6f4c84696-94c5v" Jul 09 01:45:49.887590 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:49.887594 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pnxb\" (UniqueName: \"kubernetes.io/projected/182c4d60-e14f-495d-a721-9c7476b38d5f-kube-api-access-4pnxb\") pod \"maas-controller-6f4c84696-94c5v\" (UID: \"182c4d60-e14f-495d-a721-9c7476b38d5f\") " pod="opendatahub/maas-controller-6f4c84696-94c5v" Jul 09 01:45:49.958600 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:49.958570 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5b8f9fb5db-crqj5"] Jul 09 01:45:49.962292 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:49.962268 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8f9fb5db-crqj5" Jul 09 01:45:49.970978 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:49.970951 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b8f9fb5db-crqj5"] Jul 09 01:45:49.988827 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:49.988803 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/182c4d60-e14f-495d-a721-9c7476b38d5f-webhook-cert\") pod \"maas-controller-6f4c84696-94c5v\" (UID: \"182c4d60-e14f-495d-a721-9c7476b38d5f\") " pod="opendatahub/maas-controller-6f4c84696-94c5v" Jul 09 01:45:49.988963 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:49.988841 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pnxb\" (UniqueName: \"kubernetes.io/projected/182c4d60-e14f-495d-a721-9c7476b38d5f-kube-api-access-4pnxb\") pod \"maas-controller-6f4c84696-94c5v\" (UID: \"182c4d60-e14f-495d-a721-9c7476b38d5f\") " pod="opendatahub/maas-controller-6f4c84696-94c5v" Jul 09 01:45:49.991192 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:49.991162 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/182c4d60-e14f-495d-a721-9c7476b38d5f-webhook-cert\") pod \"maas-controller-6f4c84696-94c5v\" (UID: \"182c4d60-e14f-495d-a721-9c7476b38d5f\") " pod="opendatahub/maas-controller-6f4c84696-94c5v" Jul 09 01:45:49.996645 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:49.996622 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pnxb\" (UniqueName: \"kubernetes.io/projected/182c4d60-e14f-495d-a721-9c7476b38d5f-kube-api-access-4pnxb\") pod \"maas-controller-6f4c84696-94c5v\" (UID: \"182c4d60-e14f-495d-a721-9c7476b38d5f\") " pod="opendatahub/maas-controller-6f4c84696-94c5v" Jul 09 01:45:50.089723 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:50.089637 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjtfk\" (UniqueName: \"kubernetes.io/projected/1a2e0898-4505-4f60-82b5-45b65e440074-kube-api-access-zjtfk\") pod \"maas-controller-5b8f9fb5db-crqj5\" (UID: \"1a2e0898-4505-4f60-82b5-45b65e440074\") " pod="opendatahub/maas-controller-5b8f9fb5db-crqj5" Jul 09 01:45:50.089723 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:50.089686 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a2e0898-4505-4f60-82b5-45b65e440074-webhook-cert\") pod \"maas-controller-5b8f9fb5db-crqj5\" (UID: \"1a2e0898-4505-4f60-82b5-45b65e440074\") " pod="opendatahub/maas-controller-5b8f9fb5db-crqj5" Jul 09 01:45:50.117739 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:50.117712 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f4c84696-94c5v" Jul 09 01:45:50.190421 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:50.190390 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjtfk\" (UniqueName: \"kubernetes.io/projected/1a2e0898-4505-4f60-82b5-45b65e440074-kube-api-access-zjtfk\") pod \"maas-controller-5b8f9fb5db-crqj5\" (UID: \"1a2e0898-4505-4f60-82b5-45b65e440074\") " pod="opendatahub/maas-controller-5b8f9fb5db-crqj5" Jul 09 01:45:50.190594 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:50.190438 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a2e0898-4505-4f60-82b5-45b65e440074-webhook-cert\") pod \"maas-controller-5b8f9fb5db-crqj5\" (UID: \"1a2e0898-4505-4f60-82b5-45b65e440074\") " pod="opendatahub/maas-controller-5b8f9fb5db-crqj5" Jul 09 01:45:50.192872 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:50.192830 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a2e0898-4505-4f60-82b5-45b65e440074-webhook-cert\") pod \"maas-controller-5b8f9fb5db-crqj5\" (UID: \"1a2e0898-4505-4f60-82b5-45b65e440074\") " pod="opendatahub/maas-controller-5b8f9fb5db-crqj5" Jul 09 01:45:50.198571 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:50.198547 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjtfk\" (UniqueName: \"kubernetes.io/projected/1a2e0898-4505-4f60-82b5-45b65e440074-kube-api-access-zjtfk\") pod \"maas-controller-5b8f9fb5db-crqj5\" (UID: \"1a2e0898-4505-4f60-82b5-45b65e440074\") " pod="opendatahub/maas-controller-5b8f9fb5db-crqj5" Jul 09 01:45:50.253498 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:50.253470 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f4c84696-94c5v"] Jul 09 01:45:50.255396 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:45:50.255371 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod182c4d60_e14f_495d_a721_9c7476b38d5f.slice/crio-8478bf22f111922d4f26f95b9e5427038c2362b4b0b8cd69504c09a482183e16 WatchSource:0}: Error finding container 8478bf22f111922d4f26f95b9e5427038c2362b4b0b8cd69504c09a482183e16: Status 404 returned error can't find the container with id 8478bf22f111922d4f26f95b9e5427038c2362b4b0b8cd69504c09a482183e16 Jul 09 01:45:50.274269 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:50.274248 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8f9fb5db-crqj5" Jul 09 01:45:50.384908 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:50.384873 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f4c84696-94c5v" event={"ID":"182c4d60-e14f-495d-a721-9c7476b38d5f","Type":"ContainerStarted","Data":"8478bf22f111922d4f26f95b9e5427038c2362b4b0b8cd69504c09a482183e16"} Jul 09 01:45:50.403814 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:50.403787 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b8f9fb5db-crqj5"] Jul 09 01:45:50.405285 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:45:50.405255 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a2e0898_4505_4f60_82b5_45b65e440074.slice/crio-5a9ab16e18e1fa0898253cfb54ca8c7d0cec618237851c22f5cc9484a2a60b91 WatchSource:0}: Error finding container 5a9ab16e18e1fa0898253cfb54ca8c7d0cec618237851c22f5cc9484a2a60b91: Status 404 returned error can't find the container with id 5a9ab16e18e1fa0898253cfb54ca8c7d0cec618237851c22f5cc9484a2a60b91 Jul 09 01:45:51.393582 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:51.393541 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8f9fb5db-crqj5" event={"ID":"1a2e0898-4505-4f60-82b5-45b65e440074","Type":"ContainerStarted","Data":"5a9ab16e18e1fa0898253cfb54ca8c7d0cec618237851c22f5cc9484a2a60b91"} Jul 09 01:45:53.405809 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:53.405770 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8f9fb5db-crqj5" event={"ID":"1a2e0898-4505-4f60-82b5-45b65e440074","Type":"ContainerStarted","Data":"30bd2882c8dabbcddfbe477dcdaa0f17ff302a2d22cf9369004bd4421b280386"} Jul 09 01:45:53.406296 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:53.405877 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5b8f9fb5db-crqj5" Jul 09 01:45:53.407349 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:53.407331 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f4c84696-94c5v" event={"ID":"182c4d60-e14f-495d-a721-9c7476b38d5f","Type":"ContainerStarted","Data":"019b95ac4d4794ca09d12f106fac3c6c28c3e590e0fb59f63d327e75cd7a0dbc"} Jul 09 01:45:53.407453 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:53.407443 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f4c84696-94c5v" Jul 09 01:45:53.430256 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:53.427999 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5b8f9fb5db-crqj5" podStartSLOduration=2.469066688 podStartE2EDuration="4.427978938s" totalImagesPullingTime="1.95891225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:45:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:45:53.425035061 +0000 UTC m=+486.086772553" watchObservedRunningTime="2026-07-09 01:45:53.427978938 +0000 UTC m=+486.089716428" Jul 09 01:45:53.447741 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:45:53.447687 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6f4c84696-94c5v" podStartSLOduration=2.344763413 podStartE2EDuration="4.447670113s" totalImagesPullingTime="2.1029067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:45:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:45:53.445692342 +0000 UTC m=+486.107429836" watchObservedRunningTime="2026-07-09 01:45:53.447670113 +0000 UTC m=+486.109407604" Jul 09 01:46:04.418461 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:04.418431 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5b8f9fb5db-crqj5" Jul 09 01:46:04.418941 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:04.418746 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f4c84696-94c5v" Jul 09 01:46:04.482763 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:04.482725 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f4c84696-94c5v"] Jul 09 01:46:04.483017 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:04.482992 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6f4c84696-94c5v" podUID="182c4d60-e14f-495d-a721-9c7476b38d5f" containerName="manager" containerID="cri-o://019b95ac4d4794ca09d12f106fac3c6c28c3e590e0fb59f63d327e75cd7a0dbc" gracePeriod=30 Jul 09 01:46:04.735734 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:04.735711 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f4c84696-94c5v" Jul 09 01:46:04.821656 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:04.821621 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pnxb\" (UniqueName: \"kubernetes.io/projected/182c4d60-e14f-495d-a721-9c7476b38d5f-kube-api-access-4pnxb\") pod \"182c4d60-e14f-495d-a721-9c7476b38d5f\" (UID: \"182c4d60-e14f-495d-a721-9c7476b38d5f\") " Jul 09 01:46:04.821840 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:04.821704 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/182c4d60-e14f-495d-a721-9c7476b38d5f-webhook-cert\") pod \"182c4d60-e14f-495d-a721-9c7476b38d5f\" (UID: \"182c4d60-e14f-495d-a721-9c7476b38d5f\") " Jul 09 01:46:04.823876 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:04.823842 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/182c4d60-e14f-495d-a721-9c7476b38d5f-kube-api-access-4pnxb" (OuterVolumeSpecName: "kube-api-access-4pnxb") pod "182c4d60-e14f-495d-a721-9c7476b38d5f" (UID: "182c4d60-e14f-495d-a721-9c7476b38d5f"). InnerVolumeSpecName "kube-api-access-4pnxb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 01:46:04.823876 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:04.823861 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/182c4d60-e14f-495d-a721-9c7476b38d5f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "182c4d60-e14f-495d-a721-9c7476b38d5f" (UID: "182c4d60-e14f-495d-a721-9c7476b38d5f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 01:46:04.923037 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:04.923008 2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/182c4d60-e14f-495d-a721-9c7476b38d5f-webhook-cert\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:46:04.923037 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:04.923032 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pnxb\" (UniqueName: \"kubernetes.io/projected/182c4d60-e14f-495d-a721-9c7476b38d5f-kube-api-access-4pnxb\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:46:05.475779 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:05.475749 2564 generic.go:356] "Generic (PLEG): container finished" podID="182c4d60-e14f-495d-a721-9c7476b38d5f" containerID="019b95ac4d4794ca09d12f106fac3c6c28c3e590e0fb59f63d327e75cd7a0dbc" exitCode=0 Jul 09 01:46:05.476204 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:05.475798 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f4c84696-94c5v" Jul 09 01:46:05.476204 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:05.475838 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f4c84696-94c5v" event={"ID":"182c4d60-e14f-495d-a721-9c7476b38d5f","Type":"ContainerDied","Data":"019b95ac4d4794ca09d12f106fac3c6c28c3e590e0fb59f63d327e75cd7a0dbc"} Jul 09 01:46:05.476204 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:05.475891 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f4c84696-94c5v" event={"ID":"182c4d60-e14f-495d-a721-9c7476b38d5f","Type":"ContainerDied","Data":"8478bf22f111922d4f26f95b9e5427038c2362b4b0b8cd69504c09a482183e16"} Jul 09 01:46:05.476204 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:05.475920 2564 scope.go:117] "RemoveContainer" containerID="019b95ac4d4794ca09d12f106fac3c6c28c3e590e0fb59f63d327e75cd7a0dbc" Jul 09 01:46:05.485377 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:05.485177 2564 scope.go:117] "RemoveContainer" containerID="019b95ac4d4794ca09d12f106fac3c6c28c3e590e0fb59f63d327e75cd7a0dbc" Jul 09 01:46:05.485486 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:46:05.485468 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"019b95ac4d4794ca09d12f106fac3c6c28c3e590e0fb59f63d327e75cd7a0dbc\": container with ID starting with 019b95ac4d4794ca09d12f106fac3c6c28c3e590e0fb59f63d327e75cd7a0dbc not found: ID does not exist" containerID="019b95ac4d4794ca09d12f106fac3c6c28c3e590e0fb59f63d327e75cd7a0dbc" Jul 09 01:46:05.485528 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:05.485496 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"019b95ac4d4794ca09d12f106fac3c6c28c3e590e0fb59f63d327e75cd7a0dbc"} err="failed to get container status \"019b95ac4d4794ca09d12f106fac3c6c28c3e590e0fb59f63d327e75cd7a0dbc\": rpc error: code = NotFound desc = could not find container \"019b95ac4d4794ca09d12f106fac3c6c28c3e590e0fb59f63d327e75cd7a0dbc\": container with ID starting with 019b95ac4d4794ca09d12f106fac3c6c28c3e590e0fb59f63d327e75cd7a0dbc not found: ID does not exist" Jul 09 01:46:05.497705 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:05.497685 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f4c84696-94c5v"] Jul 09 01:46:05.501050 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:05.501027 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6f4c84696-94c5v"] Jul 09 01:46:05.867006 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:05.866911 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="182c4d60-e14f-495d-a721-9c7476b38d5f" path="/var/lib/kubelet/pods/182c4d60-e14f-495d-a721-9c7476b38d5f/volumes" Jul 09 01:46:25.405669 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:25.405634 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7b8b4bbb6f-d2cv4"] Jul 09 01:46:25.406165 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:25.406001 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="182c4d60-e14f-495d-a721-9c7476b38d5f" containerName="manager" Jul 09 01:46:25.406165 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:25.406013 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="182c4d60-e14f-495d-a721-9c7476b38d5f" containerName="manager" Jul 09 01:46:25.406165 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:25.406069 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="182c4d60-e14f-495d-a721-9c7476b38d5f" containerName="manager" Jul 09 01:46:25.411933 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:25.411912 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b8b4bbb6f-d2cv4" Jul 09 01:46:25.414770 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:25.414750 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 09 01:46:25.414770 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:25.414761 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dmx8z\"" Jul 09 01:46:25.422055 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:25.422029 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b8b4bbb6f-d2cv4"] Jul 09 01:46:25.487716 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:25.487687 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23b86ef4-06f3-45bb-b489-e5c3c9a1edc6-openshift-service-ca\") pod \"maas-api-7b8b4bbb6f-d2cv4\" (UID: \"23b86ef4-06f3-45bb-b489-e5c3c9a1edc6\") " pod="odh-ai-gateway-infra/maas-api-7b8b4bbb6f-d2cv4" Jul 09 01:46:25.487897 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:25.487742 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbbqd\" (UniqueName: \"kubernetes.io/projected/23b86ef4-06f3-45bb-b489-e5c3c9a1edc6-kube-api-access-fbbqd\") pod \"maas-api-7b8b4bbb6f-d2cv4\" (UID: \"23b86ef4-06f3-45bb-b489-e5c3c9a1edc6\") " pod="odh-ai-gateway-infra/maas-api-7b8b4bbb6f-d2cv4" Jul 09 01:46:25.487897 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:25.487829 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23b86ef4-06f3-45bb-b489-e5c3c9a1edc6-maas-api-tls\") pod \"maas-api-7b8b4bbb6f-d2cv4\" (UID: \"23b86ef4-06f3-45bb-b489-e5c3c9a1edc6\") " pod="odh-ai-gateway-infra/maas-api-7b8b4bbb6f-d2cv4" Jul 09 01:46:25.589219 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:25.589189 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23b86ef4-06f3-45bb-b489-e5c3c9a1edc6-maas-api-tls\") pod \"maas-api-7b8b4bbb6f-d2cv4\" (UID: \"23b86ef4-06f3-45bb-b489-e5c3c9a1edc6\") " pod="odh-ai-gateway-infra/maas-api-7b8b4bbb6f-d2cv4" Jul 09 01:46:25.589410 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:25.589291 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23b86ef4-06f3-45bb-b489-e5c3c9a1edc6-openshift-service-ca\") pod \"maas-api-7b8b4bbb6f-d2cv4\" (UID: \"23b86ef4-06f3-45bb-b489-e5c3c9a1edc6\") " pod="odh-ai-gateway-infra/maas-api-7b8b4bbb6f-d2cv4" Jul 09 01:46:25.589410 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:25.589329 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbbqd\" (UniqueName: \"kubernetes.io/projected/23b86ef4-06f3-45bb-b489-e5c3c9a1edc6-kube-api-access-fbbqd\") pod \"maas-api-7b8b4bbb6f-d2cv4\" (UID: \"23b86ef4-06f3-45bb-b489-e5c3c9a1edc6\") " pod="odh-ai-gateway-infra/maas-api-7b8b4bbb6f-d2cv4" Jul 09 01:46:25.589410 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:46:25.589341 2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 09 01:46:25.589519 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:46:25.589423 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23b86ef4-06f3-45bb-b489-e5c3c9a1edc6-maas-api-tls podName:23b86ef4-06f3-45bb-b489-e5c3c9a1edc6 nodeName:}" failed. No retries permitted until 2026-07-09 01:46:26.089403505 +0000 UTC m=+518.751140979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/23b86ef4-06f3-45bb-b489-e5c3c9a1edc6-maas-api-tls") pod "maas-api-7b8b4bbb6f-d2cv4" (UID: "23b86ef4-06f3-45bb-b489-e5c3c9a1edc6") : secret "maas-api-serving-cert" not found Jul 09 01:46:25.589971 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:25.589952 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23b86ef4-06f3-45bb-b489-e5c3c9a1edc6-openshift-service-ca\") pod \"maas-api-7b8b4bbb6f-d2cv4\" (UID: \"23b86ef4-06f3-45bb-b489-e5c3c9a1edc6\") " pod="odh-ai-gateway-infra/maas-api-7b8b4bbb6f-d2cv4" Jul 09 01:46:25.597454 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:25.597421 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbbqd\" (UniqueName: \"kubernetes.io/projected/23b86ef4-06f3-45bb-b489-e5c3c9a1edc6-kube-api-access-fbbqd\") pod \"maas-api-7b8b4bbb6f-d2cv4\" (UID: \"23b86ef4-06f3-45bb-b489-e5c3c9a1edc6\") " pod="odh-ai-gateway-infra/maas-api-7b8b4bbb6f-d2cv4" Jul 09 01:46:25.941948 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:25.941911 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-x2cmx"] Jul 09 01:46:25.946834 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:25.946810 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-x2cmx" Jul 09 01:46:25.948992 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:25.948965 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 09 01:46:25.949264 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:25.949244 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-x87hv\"" Jul 09 01:46:25.955890 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:25.955867 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-x2cmx"] Jul 09 01:46:25.993401 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:25.993347 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68t2v\" (UniqueName: \"kubernetes.io/projected/6b894618-af5b-41bb-9579-74f07f415d93-kube-api-access-68t2v\") pod \"payload-processing-58f86c7798-x2cmx\" (UID: \"6b894618-af5b-41bb-9579-74f07f415d93\") " pod="openshift-ingress/payload-processing-58f86c7798-x2cmx" Jul 09 01:46:25.993606 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:25.993517 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b894618-af5b-41bb-9579-74f07f415d93-plugins-config-volume\") pod \"payload-processing-58f86c7798-x2cmx\" (UID: \"6b894618-af5b-41bb-9579-74f07f415d93\") " pod="openshift-ingress/payload-processing-58f86c7798-x2cmx" Jul 09 01:46:26.094779 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:26.094740 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68t2v\" (UniqueName: \"kubernetes.io/projected/6b894618-af5b-41bb-9579-74f07f415d93-kube-api-access-68t2v\") pod \"payload-processing-58f86c7798-x2cmx\" (UID: \"6b894618-af5b-41bb-9579-74f07f415d93\") " pod="openshift-ingress/payload-processing-58f86c7798-x2cmx" Jul 09 01:46:26.094980 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:26.094809 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23b86ef4-06f3-45bb-b489-e5c3c9a1edc6-maas-api-tls\") pod \"maas-api-7b8b4bbb6f-d2cv4\" (UID: \"23b86ef4-06f3-45bb-b489-e5c3c9a1edc6\") " pod="odh-ai-gateway-infra/maas-api-7b8b4bbb6f-d2cv4" Jul 09 01:46:26.094980 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:26.094883 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b894618-af5b-41bb-9579-74f07f415d93-plugins-config-volume\") pod \"payload-processing-58f86c7798-x2cmx\" (UID: \"6b894618-af5b-41bb-9579-74f07f415d93\") " pod="openshift-ingress/payload-processing-58f86c7798-x2cmx" Jul 09 01:46:26.095683 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:26.095658 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b894618-af5b-41bb-9579-74f07f415d93-plugins-config-volume\") pod \"payload-processing-58f86c7798-x2cmx\" (UID: \"6b894618-af5b-41bb-9579-74f07f415d93\") " pod="openshift-ingress/payload-processing-58f86c7798-x2cmx" Jul 09 01:46:26.097711 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:26.097684 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23b86ef4-06f3-45bb-b489-e5c3c9a1edc6-maas-api-tls\") pod \"maas-api-7b8b4bbb6f-d2cv4\" (UID: \"23b86ef4-06f3-45bb-b489-e5c3c9a1edc6\") " pod="odh-ai-gateway-infra/maas-api-7b8b4bbb6f-d2cv4" Jul 09 01:46:26.102653 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:26.102629 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68t2v\" (UniqueName: \"kubernetes.io/projected/6b894618-af5b-41bb-9579-74f07f415d93-kube-api-access-68t2v\") pod \"payload-processing-58f86c7798-x2cmx\" (UID: \"6b894618-af5b-41bb-9579-74f07f415d93\") " pod="openshift-ingress/payload-processing-58f86c7798-x2cmx" Jul 09 01:46:26.258358 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:26.258278 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-x2cmx" Jul 09 01:46:26.323815 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:26.323781 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b8b4bbb6f-d2cv4" Jul 09 01:46:26.407540 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:26.407506 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-x2cmx"] Jul 09 01:46:26.409591 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:46:26.409561 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b894618_af5b_41bb_9579_74f07f415d93.slice/crio-bd41b28f2a9c9d50faedf65e49d3e1d9713eacbc40f366ff99586ebb14fe332b WatchSource:0}: Error finding container bd41b28f2a9c9d50faedf65e49d3e1d9713eacbc40f366ff99586ebb14fe332b: Status 404 returned error can't find the container with id bd41b28f2a9c9d50faedf65e49d3e1d9713eacbc40f366ff99586ebb14fe332b Jul 09 01:46:26.467148 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:26.467120 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b8b4bbb6f-d2cv4"] Jul 09 01:46:26.470841 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:46:26.470807 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23b86ef4_06f3_45bb_b489_e5c3c9a1edc6.slice/crio-402b16bc01bb12d0077f27959ce6fb69eca55aacc8b77b5fc204fb5ee4d35655 WatchSource:0}: Error finding container 402b16bc01bb12d0077f27959ce6fb69eca55aacc8b77b5fc204fb5ee4d35655: Status 404 returned error can't find the container with id 402b16bc01bb12d0077f27959ce6fb69eca55aacc8b77b5fc204fb5ee4d35655 Jul 09 01:46:26.592641 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:26.592553 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b8b4bbb6f-d2cv4" event={"ID":"23b86ef4-06f3-45bb-b489-e5c3c9a1edc6","Type":"ContainerStarted","Data":"402b16bc01bb12d0077f27959ce6fb69eca55aacc8b77b5fc204fb5ee4d35655"} Jul 09 01:46:26.593742 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:26.593718 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-x2cmx" event={"ID":"6b894618-af5b-41bb-9579-74f07f415d93","Type":"ContainerStarted","Data":"bd41b28f2a9c9d50faedf65e49d3e1d9713eacbc40f366ff99586ebb14fe332b"} Jul 09 01:46:28.608522 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:28.608486 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b8b4bbb6f-d2cv4" event={"ID":"23b86ef4-06f3-45bb-b489-e5c3c9a1edc6","Type":"ContainerStarted","Data":"174de7b60d0951eddac8d191267c4eec28cecb0297fb138ad65d0818ec0b2f17"} Jul 09 01:46:28.608976 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:28.608595 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7b8b4bbb6f-d2cv4" Jul 09 01:46:28.610386 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:28.610361 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-x2cmx" event={"ID":"6b894618-af5b-41bb-9579-74f07f415d93","Type":"ContainerStarted","Data":"8097bdb1dd85945bee4f48e160393af136745c1ee24183705ca38f69c6ed73a0"} Jul 09 01:46:28.610528 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:28.610421 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-x2cmx" Jul 09 01:46:28.624140 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:28.624096 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7b8b4bbb6f-d2cv4" podStartSLOduration=1.98393734 podStartE2EDuration="3.624084424s" totalImagesPullingTime="1.640147084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:46:28.622414996 +0000 UTC m=+521.284152489" watchObservedRunningTime="2026-07-09 01:46:28.624084424 +0000 UTC m=+521.285821915" Jul 09 01:46:28.637196 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:28.637155 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-x2cmx" podStartSLOduration=1.981948286 podStartE2EDuration="3.63714439s" totalImagesPullingTime="1.655196104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:46:28.635887181 +0000 UTC m=+521.297624675" watchObservedRunningTime="2026-07-09 01:46:28.63714439 +0000 UTC m=+521.298881913" Jul 09 01:46:34.622667 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:34.622635 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7b8b4bbb6f-d2cv4" Jul 09 01:46:39.619414 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:39.619385 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-x2cmx" Jul 09 01:46:56.255585 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:56.255553 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr"] Jul 09 01:46:56.268157 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:56.268124 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr" Jul 09 01:46:56.271268 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:56.271021 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr"] Jul 09 01:46:56.273152 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:56.273129 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 01:46:56.273702 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:56.273683 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 01:46:56.273852 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:56.273683 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wtkjc\"" Jul 09 01:46:56.273958 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:56.273736 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 09 01:46:56.348116 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:56.348080 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rq5b\" (UniqueName: \"kubernetes.io/projected/886c9df9-8f8a-4881-9fbe-9dde9c2b68d8-kube-api-access-8rq5b\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsdcr\" (UID: \"886c9df9-8f8a-4881-9fbe-9dde9c2b68d8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr" Jul 09 01:46:56.348116 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:56.348119 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/886c9df9-8f8a-4881-9fbe-9dde9c2b68d8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsdcr\" (UID: \"886c9df9-8f8a-4881-9fbe-9dde9c2b68d8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr" Jul 09 01:46:56.348367 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:56.348175 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/886c9df9-8f8a-4881-9fbe-9dde9c2b68d8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsdcr\" (UID: \"886c9df9-8f8a-4881-9fbe-9dde9c2b68d8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr" Jul 09 01:46:56.348367 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:56.348209 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/886c9df9-8f8a-4881-9fbe-9dde9c2b68d8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsdcr\" (UID: \"886c9df9-8f8a-4881-9fbe-9dde9c2b68d8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr" Jul 09 01:46:56.348367 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:56.348277 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/886c9df9-8f8a-4881-9fbe-9dde9c2b68d8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsdcr\" (UID: \"886c9df9-8f8a-4881-9fbe-9dde9c2b68d8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr" Jul 09 01:46:56.348367 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:56.348298 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/886c9df9-8f8a-4881-9fbe-9dde9c2b68d8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsdcr\" (UID: \"886c9df9-8f8a-4881-9fbe-9dde9c2b68d8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr" Jul 09 01:46:56.448699 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:56.448664 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rq5b\" (UniqueName: \"kubernetes.io/projected/886c9df9-8f8a-4881-9fbe-9dde9c2b68d8-kube-api-access-8rq5b\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsdcr\" (UID: \"886c9df9-8f8a-4881-9fbe-9dde9c2b68d8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr" Jul 09 01:46:56.448699 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:56.448701 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/886c9df9-8f8a-4881-9fbe-9dde9c2b68d8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsdcr\" (UID: \"886c9df9-8f8a-4881-9fbe-9dde9c2b68d8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr" Jul 09 01:46:56.448957 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:56.448728 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/886c9df9-8f8a-4881-9fbe-9dde9c2b68d8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsdcr\" (UID: \"886c9df9-8f8a-4881-9fbe-9dde9c2b68d8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr" Jul 09 01:46:56.448957 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:56.448755 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/886c9df9-8f8a-4881-9fbe-9dde9c2b68d8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsdcr\" (UID: \"886c9df9-8f8a-4881-9fbe-9dde9c2b68d8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr" Jul 09 01:46:56.448957 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:56.448780 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/886c9df9-8f8a-4881-9fbe-9dde9c2b68d8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsdcr\" (UID: \"886c9df9-8f8a-4881-9fbe-9dde9c2b68d8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr" Jul 09 01:46:56.448957 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:56.448811 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/886c9df9-8f8a-4881-9fbe-9dde9c2b68d8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsdcr\" (UID: \"886c9df9-8f8a-4881-9fbe-9dde9c2b68d8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr" Jul 09 01:46:56.449167 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:56.449144 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/886c9df9-8f8a-4881-9fbe-9dde9c2b68d8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsdcr\" (UID: \"886c9df9-8f8a-4881-9fbe-9dde9c2b68d8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr" Jul 09 01:46:56.449225 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:56.449191 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/886c9df9-8f8a-4881-9fbe-9dde9c2b68d8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsdcr\" (UID: \"886c9df9-8f8a-4881-9fbe-9dde9c2b68d8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr" Jul 09 01:46:56.449377 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:56.449223 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/886c9df9-8f8a-4881-9fbe-9dde9c2b68d8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsdcr\" (UID: \"886c9df9-8f8a-4881-9fbe-9dde9c2b68d8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr" Jul 09 01:46:56.451045 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:56.451015 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/886c9df9-8f8a-4881-9fbe-9dde9c2b68d8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsdcr\" (UID: \"886c9df9-8f8a-4881-9fbe-9dde9c2b68d8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr" Jul 09 01:46:56.451219 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:56.451203 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/886c9df9-8f8a-4881-9fbe-9dde9c2b68d8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsdcr\" (UID: \"886c9df9-8f8a-4881-9fbe-9dde9c2b68d8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr" Jul 09 01:46:56.459311 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:56.459264 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rq5b\" (UniqueName: \"kubernetes.io/projected/886c9df9-8f8a-4881-9fbe-9dde9c2b68d8-kube-api-access-8rq5b\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fsdcr\" (UID: \"886c9df9-8f8a-4881-9fbe-9dde9c2b68d8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr" Jul 09 01:46:56.582455 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:56.582370 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr" Jul 09 01:46:56.720826 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:56.720798 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr"] Jul 09 01:46:56.722105 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:46:56.722080 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod886c9df9_8f8a_4881_9fbe_9dde9c2b68d8.slice/crio-247f6d2b68d4ad69554442a96421c09b9ad23023b4346724813c9f8af0539ea1 WatchSource:0}: Error finding container 247f6d2b68d4ad69554442a96421c09b9ad23023b4346724813c9f8af0539ea1: Status 404 returned error can't find the container with id 247f6d2b68d4ad69554442a96421c09b9ad23023b4346724813c9f8af0539ea1 Jul 09 01:46:56.762889 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:56.762857 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr" event={"ID":"886c9df9-8f8a-4881-9fbe-9dde9c2b68d8","Type":"ContainerStarted","Data":"247f6d2b68d4ad69554442a96421c09b9ad23023b4346724813c9f8af0539ea1"} Jul 09 01:46:58.776771 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:58.776736 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr" event={"ID":"886c9df9-8f8a-4881-9fbe-9dde9c2b68d8","Type":"ContainerStarted","Data":"78f8ab0abe050fd866c1800a7343cb7675efa02c93b57afb3e4bafd5d7a4c126"} Jul 09 01:46:58.793034 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:46:58.792985 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr" podStartSLOduration=1.747697971 podStartE2EDuration="2.792968655s" totalImagesPullingTime="1.045270684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:46:58.79103212 +0000 UTC m=+551.452769609" watchObservedRunningTime="2026-07-09 01:46:58.792968655 +0000 UTC m=+551.454706207" Jul 09 01:47:06.582821 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:06.582780 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr" Jul 09 01:47:06.583259 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:06.582877 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr" Jul 09 01:47:06.595635 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:06.595603 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr" Jul 09 01:47:06.832408 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:06.832381 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fsdcr" Jul 09 01:47:15.957836 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:15.957800 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk"] Jul 09 01:47:15.963617 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:15.963592 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk" Jul 09 01:47:15.972464 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:15.972438 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 09 01:47:15.974711 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:15.974687 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk"] Jul 09 01:47:16.124710 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:16.124665 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76a6069e-f097-4004-b2ad-b34cac31e53b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk\" (UID: \"76a6069e-f097-4004-b2ad-b34cac31e53b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk" Jul 09 01:47:16.124893 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:16.124719 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slbvg\" (UniqueName: \"kubernetes.io/projected/76a6069e-f097-4004-b2ad-b34cac31e53b-kube-api-access-slbvg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk\" (UID: \"76a6069e-f097-4004-b2ad-b34cac31e53b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk" Jul 09 01:47:16.124893 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:16.124785 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76a6069e-f097-4004-b2ad-b34cac31e53b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk\" (UID: \"76a6069e-f097-4004-b2ad-b34cac31e53b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk" Jul 09 01:47:16.124893 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:16.124865 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76a6069e-f097-4004-b2ad-b34cac31e53b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk\" (UID: \"76a6069e-f097-4004-b2ad-b34cac31e53b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk" Jul 09 01:47:16.124893 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:16.124890 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76a6069e-f097-4004-b2ad-b34cac31e53b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk\" (UID: \"76a6069e-f097-4004-b2ad-b34cac31e53b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk" Jul 09 01:47:16.125035 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:16.124940 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76a6069e-f097-4004-b2ad-b34cac31e53b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk\" (UID: \"76a6069e-f097-4004-b2ad-b34cac31e53b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk" Jul 09 01:47:16.225972 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:16.225869 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76a6069e-f097-4004-b2ad-b34cac31e53b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk\" (UID: \"76a6069e-f097-4004-b2ad-b34cac31e53b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk" Jul 09 01:47:16.225972 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:16.225933 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76a6069e-f097-4004-b2ad-b34cac31e53b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk\" (UID: \"76a6069e-f097-4004-b2ad-b34cac31e53b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk" Jul 09 01:47:16.225972 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:16.225968 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slbvg\" (UniqueName: \"kubernetes.io/projected/76a6069e-f097-4004-b2ad-b34cac31e53b-kube-api-access-slbvg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk\" (UID: \"76a6069e-f097-4004-b2ad-b34cac31e53b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk" Jul 09 01:47:16.226272 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:16.226007 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76a6069e-f097-4004-b2ad-b34cac31e53b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk\" (UID: \"76a6069e-f097-4004-b2ad-b34cac31e53b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk" Jul 09 01:47:16.226272 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:16.226049 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76a6069e-f097-4004-b2ad-b34cac31e53b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk\" (UID: \"76a6069e-f097-4004-b2ad-b34cac31e53b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk" Jul 09 01:47:16.226272 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:16.226075 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76a6069e-f097-4004-b2ad-b34cac31e53b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk\" (UID: \"76a6069e-f097-4004-b2ad-b34cac31e53b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk" Jul 09 01:47:16.226441 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:16.226398 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76a6069e-f097-4004-b2ad-b34cac31e53b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk\" (UID: \"76a6069e-f097-4004-b2ad-b34cac31e53b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk" Jul 09 01:47:16.226441 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:16.226404 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76a6069e-f097-4004-b2ad-b34cac31e53b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk\" (UID: \"76a6069e-f097-4004-b2ad-b34cac31e53b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk" Jul 09 01:47:16.226549 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:16.226472 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76a6069e-f097-4004-b2ad-b34cac31e53b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk\" (UID: \"76a6069e-f097-4004-b2ad-b34cac31e53b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk" Jul 09 01:47:16.228419 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:16.228391 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76a6069e-f097-4004-b2ad-b34cac31e53b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk\" (UID: \"76a6069e-f097-4004-b2ad-b34cac31e53b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk" Jul 09 01:47:16.228586 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:16.228567 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76a6069e-f097-4004-b2ad-b34cac31e53b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk\" (UID: \"76a6069e-f097-4004-b2ad-b34cac31e53b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk" Jul 09 01:47:16.234010 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:16.233985 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slbvg\" (UniqueName: \"kubernetes.io/projected/76a6069e-f097-4004-b2ad-b34cac31e53b-kube-api-access-slbvg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk\" (UID: \"76a6069e-f097-4004-b2ad-b34cac31e53b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk" Jul 09 01:47:16.279625 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:16.279595 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk" Jul 09 01:47:16.420307 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:16.420282 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk"] Jul 09 01:47:16.422089 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:47:16.422062 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76a6069e_f097_4004_b2ad_b34cac31e53b.slice/crio-076ece17772f0e4302133c6e03e0dac76954af55f575fdd56ca5a3427c917642 WatchSource:0}: Error finding container 076ece17772f0e4302133c6e03e0dac76954af55f575fdd56ca5a3427c917642: Status 404 returned error can't find the container with id 076ece17772f0e4302133c6e03e0dac76954af55f575fdd56ca5a3427c917642 Jul 09 01:47:16.876908 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:16.876813 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk" event={"ID":"76a6069e-f097-4004-b2ad-b34cac31e53b","Type":"ContainerStarted","Data":"2680f6d7f3eb610b52a69fbb07cf8e73772bb58269ad013f23614010bee9dba8"} Jul 09 01:47:16.877045 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:16.876914 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk" event={"ID":"76a6069e-f097-4004-b2ad-b34cac31e53b","Type":"ContainerStarted","Data":"076ece17772f0e4302133c6e03e0dac76954af55f575fdd56ca5a3427c917642"} Jul 09 01:47:16.894285 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:16.894213 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk" podStartSLOduration=1.696365603 podStartE2EDuration="1.894196399s" totalImagesPullingTime="197.830796ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:47:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:47:16.891388501 +0000 UTC m=+569.553126026" watchObservedRunningTime="2026-07-09 01:47:16.894196399 +0000 UTC m=+569.555933890" Jul 09 01:47:26.280613 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:26.280583 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk" Jul 09 01:47:26.281033 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:26.280659 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk" Jul 09 01:47:26.293425 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:26.293402 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk" Jul 09 01:47:26.950543 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:26.950510 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk" Jul 09 01:47:47.819739 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:47.819708 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gfhk_3d8307ed-04c9-429e-a83c-7b24847e0a38/console-operator/1.log" Jul 09 01:47:47.822947 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:47:47.822927 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gfhk_3d8307ed-04c9-429e-a83c-7b24847e0a38/console-operator/1.log" Jul 09 01:49:58.285352 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:58.285317 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b8f9fb5db-crqj5"] Jul 09 01:49:58.285908 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:58.285539 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5b8f9fb5db-crqj5" podUID="1a2e0898-4505-4f60-82b5-45b65e440074" containerName="manager" containerID="cri-o://30bd2882c8dabbcddfbe477dcdaa0f17ff302a2d22cf9369004bd4421b280386" gracePeriod=30 Jul 09 01:49:58.539566 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:58.539507 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8f9fb5db-crqj5" Jul 09 01:49:58.614388 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:58.614356 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a2e0898-4505-4f60-82b5-45b65e440074-webhook-cert\") pod \"1a2e0898-4505-4f60-82b5-45b65e440074\" (UID: \"1a2e0898-4505-4f60-82b5-45b65e440074\") " Jul 09 01:49:58.614547 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:58.614488 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjtfk\" (UniqueName: \"kubernetes.io/projected/1a2e0898-4505-4f60-82b5-45b65e440074-kube-api-access-zjtfk\") pod \"1a2e0898-4505-4f60-82b5-45b65e440074\" (UID: \"1a2e0898-4505-4f60-82b5-45b65e440074\") " Jul 09 01:49:58.616477 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:58.616446 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a2e0898-4505-4f60-82b5-45b65e440074-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1a2e0898-4505-4f60-82b5-45b65e440074" (UID: "1a2e0898-4505-4f60-82b5-45b65e440074"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 01:49:58.616585 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:58.616469 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a2e0898-4505-4f60-82b5-45b65e440074-kube-api-access-zjtfk" (OuterVolumeSpecName: "kube-api-access-zjtfk") pod "1a2e0898-4505-4f60-82b5-45b65e440074" (UID: "1a2e0898-4505-4f60-82b5-45b65e440074"). InnerVolumeSpecName "kube-api-access-zjtfk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 01:49:58.715346 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:58.715317 2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a2e0898-4505-4f60-82b5-45b65e440074-webhook-cert\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:49:58.715346 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:58.715345 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjtfk\" (UniqueName: \"kubernetes.io/projected/1a2e0898-4505-4f60-82b5-45b65e440074-kube-api-access-zjtfk\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:49:58.774279 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:58.774214 2564 generic.go:356] "Generic (PLEG): container finished" podID="1a2e0898-4505-4f60-82b5-45b65e440074" containerID="30bd2882c8dabbcddfbe477dcdaa0f17ff302a2d22cf9369004bd4421b280386" exitCode=0 Jul 09 01:49:58.774476 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:58.774285 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8f9fb5db-crqj5" Jul 09 01:49:58.774476 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:58.774284 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8f9fb5db-crqj5" event={"ID":"1a2e0898-4505-4f60-82b5-45b65e440074","Type":"ContainerDied","Data":"30bd2882c8dabbcddfbe477dcdaa0f17ff302a2d22cf9369004bd4421b280386"} Jul 09 01:49:58.774476 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:58.774345 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8f9fb5db-crqj5" event={"ID":"1a2e0898-4505-4f60-82b5-45b65e440074","Type":"ContainerDied","Data":"5a9ab16e18e1fa0898253cfb54ca8c7d0cec618237851c22f5cc9484a2a60b91"} Jul 09 01:49:58.774476 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:58.774380 2564 scope.go:117] "RemoveContainer" containerID="30bd2882c8dabbcddfbe477dcdaa0f17ff302a2d22cf9369004bd4421b280386" Jul 09 01:49:58.784839 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:58.784820 2564 scope.go:117] "RemoveContainer" containerID="30bd2882c8dabbcddfbe477dcdaa0f17ff302a2d22cf9369004bd4421b280386" Jul 09 01:49:58.785133 ip-10-0-131-181 kubenswrapper[2564]: E0709 01:49:58.785108 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30bd2882c8dabbcddfbe477dcdaa0f17ff302a2d22cf9369004bd4421b280386\": container with ID starting with 30bd2882c8dabbcddfbe477dcdaa0f17ff302a2d22cf9369004bd4421b280386 not found: ID does not exist" containerID="30bd2882c8dabbcddfbe477dcdaa0f17ff302a2d22cf9369004bd4421b280386" Jul 09 01:49:58.785183 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:58.785143 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30bd2882c8dabbcddfbe477dcdaa0f17ff302a2d22cf9369004bd4421b280386"} err="failed to get container status \"30bd2882c8dabbcddfbe477dcdaa0f17ff302a2d22cf9369004bd4421b280386\": rpc error: code = NotFound desc = could not find container \"30bd2882c8dabbcddfbe477dcdaa0f17ff302a2d22cf9369004bd4421b280386\": container with ID starting with 30bd2882c8dabbcddfbe477dcdaa0f17ff302a2d22cf9369004bd4421b280386 not found: ID does not exist" Jul 09 01:49:58.796393 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:58.796343 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b8f9fb5db-crqj5"] Jul 09 01:49:58.799696 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:58.799675 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5b8f9fb5db-crqj5"] Jul 09 01:49:59.544084 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:59.544051 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5b8f9fb5db-fwwdd"] Jul 09 01:49:59.544552 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:59.544487 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a2e0898-4505-4f60-82b5-45b65e440074" containerName="manager" Jul 09 01:49:59.544552 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:59.544499 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a2e0898-4505-4f60-82b5-45b65e440074" containerName="manager" Jul 09 01:49:59.544628 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:59.544568 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a2e0898-4505-4f60-82b5-45b65e440074" containerName="manager" Jul 09 01:49:59.548664 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:59.548648 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8f9fb5db-fwwdd" Jul 09 01:49:59.551831 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:59.551807 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4qxh5\"" Jul 09 01:49:59.551962 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:59.551807 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 09 01:49:59.551962 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:59.551811 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 09 01:49:59.557805 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:59.557777 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b8f9fb5db-fwwdd"] Jul 09 01:49:59.623514 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:59.623480 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvrtg\" (UniqueName: \"kubernetes.io/projected/9f833809-c857-4b56-8374-6c21e6ef9073-kube-api-access-pvrtg\") pod \"maas-controller-5b8f9fb5db-fwwdd\" (UID: \"9f833809-c857-4b56-8374-6c21e6ef9073\") " pod="opendatahub/maas-controller-5b8f9fb5db-fwwdd" Jul 09 01:49:59.623514 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:59.623517 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f833809-c857-4b56-8374-6c21e6ef9073-webhook-cert\") pod \"maas-controller-5b8f9fb5db-fwwdd\" (UID: \"9f833809-c857-4b56-8374-6c21e6ef9073\") " pod="opendatahub/maas-controller-5b8f9fb5db-fwwdd" Jul 09 01:49:59.724578 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:59.724542 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvrtg\" (UniqueName: \"kubernetes.io/projected/9f833809-c857-4b56-8374-6c21e6ef9073-kube-api-access-pvrtg\") pod \"maas-controller-5b8f9fb5db-fwwdd\" (UID: \"9f833809-c857-4b56-8374-6c21e6ef9073\") " pod="opendatahub/maas-controller-5b8f9fb5db-fwwdd" Jul 09 01:49:59.724578 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:59.724581 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f833809-c857-4b56-8374-6c21e6ef9073-webhook-cert\") pod \"maas-controller-5b8f9fb5db-fwwdd\" (UID: \"9f833809-c857-4b56-8374-6c21e6ef9073\") " pod="opendatahub/maas-controller-5b8f9fb5db-fwwdd" Jul 09 01:49:59.727038 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:59.727013 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f833809-c857-4b56-8374-6c21e6ef9073-webhook-cert\") pod \"maas-controller-5b8f9fb5db-fwwdd\" (UID: \"9f833809-c857-4b56-8374-6c21e6ef9073\") " pod="opendatahub/maas-controller-5b8f9fb5db-fwwdd" Jul 09 01:49:59.732753 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:59.732727 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvrtg\" (UniqueName: \"kubernetes.io/projected/9f833809-c857-4b56-8374-6c21e6ef9073-kube-api-access-pvrtg\") pod \"maas-controller-5b8f9fb5db-fwwdd\" (UID: \"9f833809-c857-4b56-8374-6c21e6ef9073\") " pod="opendatahub/maas-controller-5b8f9fb5db-fwwdd" Jul 09 01:49:59.859300 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:59.859198 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8f9fb5db-fwwdd" Jul 09 01:49:59.868646 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:59.868619 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a2e0898-4505-4f60-82b5-45b65e440074" path="/var/lib/kubelet/pods/1a2e0898-4505-4f60-82b5-45b65e440074/volumes" Jul 09 01:49:59.996939 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:59.996899 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b8f9fb5db-fwwdd"] Jul 09 01:49:59.998394 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:49:59.998360 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f833809_c857_4b56_8374_6c21e6ef9073.slice/crio-076ceaa8f6acabfd641c47e4b9fe67de4c0c5ce8937a046f1dca5c2cef02a0a3 WatchSource:0}: Error finding container 076ceaa8f6acabfd641c47e4b9fe67de4c0c5ce8937a046f1dca5c2cef02a0a3: Status 404 returned error can't find the container with id 076ceaa8f6acabfd641c47e4b9fe67de4c0c5ce8937a046f1dca5c2cef02a0a3 Jul 09 01:49:59.999771 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:49:59.999752 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 01:50:00.788684 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:50:00.788648 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8f9fb5db-fwwdd" event={"ID":"9f833809-c857-4b56-8374-6c21e6ef9073","Type":"ContainerStarted","Data":"02bcd1dfb49fb40a22763ad8d37f2a2159f4f2594dac959abc262be03a968b48"} Jul 09 01:50:00.789135 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:50:00.788702 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8f9fb5db-fwwdd" event={"ID":"9f833809-c857-4b56-8374-6c21e6ef9073","Type":"ContainerStarted","Data":"076ceaa8f6acabfd641c47e4b9fe67de4c0c5ce8937a046f1dca5c2cef02a0a3"} Jul 09 01:50:00.789135 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:50:00.788854 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5b8f9fb5db-fwwdd" Jul 09 01:50:00.805635 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:50:00.805585 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5b8f9fb5db-fwwdd" podStartSLOduration=1.455303243 podStartE2EDuration="1.805570734s" totalImagesPullingTime="350.267491ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:49:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:50:00.804437298 +0000 UTC m=+733.466174792" watchObservedRunningTime="2026-07-09 01:50:00.805570734 +0000 UTC m=+733.467308226" Jul 09 01:50:11.799716 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:50:11.799685 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5b8f9fb5db-fwwdd" Jul 09 01:52:47.857914 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:52:47.857825 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gfhk_3d8307ed-04c9-429e-a83c-7b24847e0a38/console-operator/1.log" Jul 09 01:52:47.858758 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:52:47.858731 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gfhk_3d8307ed-04c9-429e-a83c-7b24847e0a38/console-operator/1.log" Jul 09 01:54:45.077826 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:54:45.077746 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k956x"] Jul 09 01:54:45.080265 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:54:45.077990 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k956x" podUID="288a2954-164c-4038-bbb5-32c629c265f4" containerName="manager" containerID="cri-o://8ae6ee202805ac905a732fd2aa76db6c8c015876e4d453a4869d6940d7a9f9ff" gracePeriod=10 Jul 09 01:54:47.533159 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:54:47.533136 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k956x" Jul 09 01:54:47.578620 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:54:47.578591 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/288a2954-164c-4038-bbb5-32c629c265f4-extensions-socket-volume\") pod \"288a2954-164c-4038-bbb5-32c629c265f4\" (UID: \"288a2954-164c-4038-bbb5-32c629c265f4\") " Jul 09 01:54:47.578810 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:54:47.578676 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgs4p\" (UniqueName: \"kubernetes.io/projected/288a2954-164c-4038-bbb5-32c629c265f4-kube-api-access-pgs4p\") pod \"288a2954-164c-4038-bbb5-32c629c265f4\" (UID: \"288a2954-164c-4038-bbb5-32c629c265f4\") " Jul 09 01:54:47.578952 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:54:47.578929 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/288a2954-164c-4038-bbb5-32c629c265f4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "288a2954-164c-4038-bbb5-32c629c265f4" (UID: "288a2954-164c-4038-bbb5-32c629c265f4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 01:54:47.580766 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:54:47.580737 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/288a2954-164c-4038-bbb5-32c629c265f4-kube-api-access-pgs4p" (OuterVolumeSpecName: "kube-api-access-pgs4p") pod "288a2954-164c-4038-bbb5-32c629c265f4" (UID: "288a2954-164c-4038-bbb5-32c629c265f4"). InnerVolumeSpecName "kube-api-access-pgs4p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 01:54:47.679565 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:54:47.679475 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/288a2954-164c-4038-bbb5-32c629c265f4-extensions-socket-volume\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:54:47.679565 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:54:47.679506 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgs4p\" (UniqueName: \"kubernetes.io/projected/288a2954-164c-4038-bbb5-32c629c265f4-kube-api-access-pgs4p\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 01:54:47.921138 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:54:47.921107 2564 scope.go:117] "RemoveContainer" containerID="8ae6ee202805ac905a732fd2aa76db6c8c015876e4d453a4869d6940d7a9f9ff" Jul 09 01:54:48.366764 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:54:48.366729 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k956x" event={"ID":"288a2954-164c-4038-bbb5-32c629c265f4","Type":"ContainerDied","Data":"8ae6ee202805ac905a732fd2aa76db6c8c015876e4d453a4869d6940d7a9f9ff"} Jul 09 01:54:48.366941 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:54:48.366787 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k956x" event={"ID":"288a2954-164c-4038-bbb5-32c629c265f4","Type":"ContainerDied","Data":"1a7422bcfcf9a9e511c9470b5ade29b5f4e7605206af25b032c22dc23cc41bfd"} Jul 09 01:54:48.366941 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:54:48.366791 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k956x" Jul 09 01:54:48.407250 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:54:48.407211 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k956x"] Jul 09 01:54:48.413587 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:54:48.413560 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k956x"] Jul 09 01:54:49.866929 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:54:49.866888 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="288a2954-164c-4038-bbb5-32c629c265f4" path="/var/lib/kubelet/pods/288a2954-164c-4038-bbb5-32c629c265f4/volumes" Jul 09 01:55:46.242635 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:55:46.242561 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67w2l"] Jul 09 01:55:46.243081 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:55:46.242941 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="288a2954-164c-4038-bbb5-32c629c265f4" containerName="manager" Jul 09 01:55:46.243081 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:55:46.242953 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="288a2954-164c-4038-bbb5-32c629c265f4" containerName="manager" Jul 09 01:55:46.243081 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:55:46.243029 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="288a2954-164c-4038-bbb5-32c629c265f4" containerName="manager" Jul 09 01:55:46.246023 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:55:46.246005 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67w2l" Jul 09 01:55:46.248933 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:55:46.248916 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ctj2r\"" Jul 09 01:55:46.260048 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:55:46.260026 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67w2l"] Jul 09 01:55:46.376723 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:55:46.376683 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9aa6b2b2-7eee-4e4a-a695-77428855972a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-67w2l\" (UID: \"9aa6b2b2-7eee-4e4a-a695-77428855972a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67w2l" Jul 09 01:55:46.376895 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:55:46.376748 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4525\" (UniqueName: \"kubernetes.io/projected/9aa6b2b2-7eee-4e4a-a695-77428855972a-kube-api-access-l4525\") pod \"kuadrant-operator-controller-manager-86878c769f-67w2l\" (UID: \"9aa6b2b2-7eee-4e4a-a695-77428855972a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67w2l" Jul 09 01:55:46.477583 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:55:46.477544 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4525\" (UniqueName: \"kubernetes.io/projected/9aa6b2b2-7eee-4e4a-a695-77428855972a-kube-api-access-l4525\") pod \"kuadrant-operator-controller-manager-86878c769f-67w2l\" (UID: \"9aa6b2b2-7eee-4e4a-a695-77428855972a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67w2l" Jul 09 01:55:46.477759 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:55:46.477643 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9aa6b2b2-7eee-4e4a-a695-77428855972a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-67w2l\" (UID: \"9aa6b2b2-7eee-4e4a-a695-77428855972a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67w2l" Jul 09 01:55:46.478103 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:55:46.478084 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9aa6b2b2-7eee-4e4a-a695-77428855972a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-67w2l\" (UID: \"9aa6b2b2-7eee-4e4a-a695-77428855972a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67w2l" Jul 09 01:55:46.486755 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:55:46.486730 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4525\" (UniqueName: \"kubernetes.io/projected/9aa6b2b2-7eee-4e4a-a695-77428855972a-kube-api-access-l4525\") pod \"kuadrant-operator-controller-manager-86878c769f-67w2l\" (UID: \"9aa6b2b2-7eee-4e4a-a695-77428855972a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67w2l" Jul 09 01:55:46.555917 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:55:46.555839 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67w2l" Jul 09 01:55:46.696887 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:55:46.696865 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67w2l"] Jul 09 01:55:46.698771 ip-10-0-131-181 kubenswrapper[2564]: W0709 01:55:46.698739 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aa6b2b2_7eee_4e4a_a695_77428855972a.slice/crio-414ffccfd92ec0529da73ac8ea9e75af63570961df6b2657b8f1489d757c5a6e WatchSource:0}: Error finding container 414ffccfd92ec0529da73ac8ea9e75af63570961df6b2657b8f1489d757c5a6e: Status 404 returned error can't find the container with id 414ffccfd92ec0529da73ac8ea9e75af63570961df6b2657b8f1489d757c5a6e Jul 09 01:55:47.691392 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:55:47.691350 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67w2l" event={"ID":"9aa6b2b2-7eee-4e4a-a695-77428855972a","Type":"ContainerStarted","Data":"91a8f52368dd8faa71fec2041da77bb9058f2925b9fbabee3f7fbbb34e466b2b"} Jul 09 01:55:47.691782 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:55:47.691454 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67w2l" event={"ID":"9aa6b2b2-7eee-4e4a-a695-77428855972a","Type":"ContainerStarted","Data":"414ffccfd92ec0529da73ac8ea9e75af63570961df6b2657b8f1489d757c5a6e"} Jul 09 01:55:47.691782 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:55:47.691486 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67w2l" Jul 09 01:55:47.716841 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:55:47.716794 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67w2l" podStartSLOduration=1.716775924 podStartE2EDuration="1.716775924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:55:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:55:47.713462745 +0000 UTC m=+1080.375200237" watchObservedRunningTime="2026-07-09 01:55:47.716775924 +0000 UTC m=+1080.378513416" Jul 09 01:55:58.699383 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:55:58.699350 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67w2l" Jul 09 01:57:47.899356 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:57:47.899280 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gfhk_3d8307ed-04c9-429e-a83c-7b24847e0a38/console-operator/1.log" Jul 09 01:57:47.900643 ip-10-0-131-181 kubenswrapper[2564]: I0709 01:57:47.900619 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gfhk_3d8307ed-04c9-429e-a83c-7b24847e0a38/console-operator/1.log" Jul 09 02:02:14.126605 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:14.126567 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf"] Jul 09 02:02:14.130205 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:14.130185 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf" Jul 09 02:02:14.132905 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:14.132881 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-648e4a0f-serving-cert\"" Jul 09 02:02:14.145573 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:14.145551 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf"] Jul 09 02:02:14.296176 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:14.296138 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwx65\" (UniqueName: \"kubernetes.io/projected/a342033f-70cb-4ee5-80dc-a4025efc819e-kube-api-access-kwx65\") pod \"maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf\" (UID: \"a342033f-70cb-4ee5-80dc-a4025efc819e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf" Jul 09 02:02:14.296385 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:14.296198 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a342033f-70cb-4ee5-80dc-a4025efc819e-openshift-service-ca\") pod \"maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf\" (UID: \"a342033f-70cb-4ee5-80dc-a4025efc819e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf" Jul 09 02:02:14.296385 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:14.296305 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a342033f-70cb-4ee5-80dc-a4025efc819e-maas-api-tls\") pod \"maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf\" (UID: \"a342033f-70cb-4ee5-80dc-a4025efc819e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf" Jul 09 02:02:14.397495 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:14.397400 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a342033f-70cb-4ee5-80dc-a4025efc819e-openshift-service-ca\") pod \"maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf\" (UID: \"a342033f-70cb-4ee5-80dc-a4025efc819e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf" Jul 09 02:02:14.397495 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:14.397458 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a342033f-70cb-4ee5-80dc-a4025efc819e-maas-api-tls\") pod \"maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf\" (UID: \"a342033f-70cb-4ee5-80dc-a4025efc819e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf" Jul 09 02:02:14.397704 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:14.397536 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwx65\" (UniqueName: \"kubernetes.io/projected/a342033f-70cb-4ee5-80dc-a4025efc819e-kube-api-access-kwx65\") pod \"maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf\" (UID: \"a342033f-70cb-4ee5-80dc-a4025efc819e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf" Jul 09 02:02:14.397704 ip-10-0-131-181 kubenswrapper[2564]: E0709 02:02:14.397638 2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-648e4a0f-serving-cert: secret "maas-api-e2e-ait-648e4a0f-serving-cert" not found Jul 09 02:02:14.397774 ip-10-0-131-181 kubenswrapper[2564]: E0709 02:02:14.397729 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a342033f-70cb-4ee5-80dc-a4025efc819e-maas-api-tls podName:a342033f-70cb-4ee5-80dc-a4025efc819e nodeName:}" failed. No retries permitted until 2026-07-09 02:02:14.897712665 +0000 UTC m=+1467.559450135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a342033f-70cb-4ee5-80dc-a4025efc819e-maas-api-tls") pod "maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf" (UID: "a342033f-70cb-4ee5-80dc-a4025efc819e") : secret "maas-api-e2e-ait-648e4a0f-serving-cert" not found Jul 09 02:02:14.398096 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:14.398069 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a342033f-70cb-4ee5-80dc-a4025efc819e-openshift-service-ca\") pod \"maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf\" (UID: \"a342033f-70cb-4ee5-80dc-a4025efc819e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf" Jul 09 02:02:14.408040 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:14.408016 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwx65\" (UniqueName: \"kubernetes.io/projected/a342033f-70cb-4ee5-80dc-a4025efc819e-kube-api-access-kwx65\") pod \"maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf\" (UID: \"a342033f-70cb-4ee5-80dc-a4025efc819e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf" Jul 09 02:02:14.903338 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:14.903299 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a342033f-70cb-4ee5-80dc-a4025efc819e-maas-api-tls\") pod \"maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf\" (UID: \"a342033f-70cb-4ee5-80dc-a4025efc819e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf" Jul 09 02:02:14.905890 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:14.905862 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a342033f-70cb-4ee5-80dc-a4025efc819e-maas-api-tls\") pod \"maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf\" (UID: \"a342033f-70cb-4ee5-80dc-a4025efc819e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf" Jul 09 02:02:15.041177 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:15.041149 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf" Jul 09 02:02:15.188492 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:15.188465 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf"] Jul 09 02:02:15.189562 ip-10-0-131-181 kubenswrapper[2564]: W0709 02:02:15.189523 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda342033f_70cb_4ee5_80dc_a4025efc819e.slice/crio-bd3f59c3f7e2b4730da9cb69db0b9eeac4eadbe91fde3515e40215ede0bab91a WatchSource:0}: Error finding container bd3f59c3f7e2b4730da9cb69db0b9eeac4eadbe91fde3515e40215ede0bab91a: Status 404 returned error can't find the container with id bd3f59c3f7e2b4730da9cb69db0b9eeac4eadbe91fde3515e40215ede0bab91a Jul 09 02:02:15.191412 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:15.191377 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 02:02:15.868529 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:15.868499 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf" Jul 09 02:02:15.868701 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:15.868547 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf" event={"ID":"a342033f-70cb-4ee5-80dc-a4025efc819e","Type":"ContainerStarted","Data":"2231ee1fd516550f552727132dc5aab7cfe68e64c38a45b03cc55166276828e0"} Jul 09 02:02:15.868701 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:15.868566 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf" event={"ID":"a342033f-70cb-4ee5-80dc-a4025efc819e","Type":"ContainerStarted","Data":"bd3f59c3f7e2b4730da9cb69db0b9eeac4eadbe91fde3515e40215ede0bab91a"} Jul 09 02:02:15.880242 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:15.880180 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf" podStartSLOduration=1.313777686 podStartE2EDuration="1.880165154s" totalImagesPullingTime="566.387468ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:02:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:02:15.877758929 +0000 UTC m=+1468.539496415" watchObservedRunningTime="2026-07-09 02:02:15.880165154 +0000 UTC m=+1468.541902643" Jul 09 02:02:19.705534 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:19.705497 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf"] Jul 09 02:02:19.705966 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:19.705787 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf" podUID="a342033f-70cb-4ee5-80dc-a4025efc819e" containerName="maas-api" containerID="cri-o://2231ee1fd516550f552727132dc5aab7cfe68e64c38a45b03cc55166276828e0" gracePeriod=30 Jul 09 02:02:19.894020 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:19.893992 2564 generic.go:356] "Generic (PLEG): container finished" podID="a342033f-70cb-4ee5-80dc-a4025efc819e" containerID="2231ee1fd516550f552727132dc5aab7cfe68e64c38a45b03cc55166276828e0" exitCode=0 Jul 09 02:02:19.894191 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:19.894071 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf" event={"ID":"a342033f-70cb-4ee5-80dc-a4025efc819e","Type":"ContainerDied","Data":"2231ee1fd516550f552727132dc5aab7cfe68e64c38a45b03cc55166276828e0"} Jul 09 02:02:19.960936 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:19.960882 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf" Jul 09 02:02:20.047714 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:20.047682 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwx65\" (UniqueName: \"kubernetes.io/projected/a342033f-70cb-4ee5-80dc-a4025efc819e-kube-api-access-kwx65\") pod \"a342033f-70cb-4ee5-80dc-a4025efc819e\" (UID: \"a342033f-70cb-4ee5-80dc-a4025efc819e\") " Jul 09 02:02:20.047714 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:20.047716 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a342033f-70cb-4ee5-80dc-a4025efc819e-maas-api-tls\") pod \"a342033f-70cb-4ee5-80dc-a4025efc819e\" (UID: \"a342033f-70cb-4ee5-80dc-a4025efc819e\") " Jul 09 02:02:20.047928 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:20.047797 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a342033f-70cb-4ee5-80dc-a4025efc819e-openshift-service-ca\") pod \"a342033f-70cb-4ee5-80dc-a4025efc819e\" (UID: \"a342033f-70cb-4ee5-80dc-a4025efc819e\") " Jul 09 02:02:20.048220 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:20.048183 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a342033f-70cb-4ee5-80dc-a4025efc819e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a342033f-70cb-4ee5-80dc-a4025efc819e" (UID: "a342033f-70cb-4ee5-80dc-a4025efc819e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:02:20.049880 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:20.049842 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a342033f-70cb-4ee5-80dc-a4025efc819e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a342033f-70cb-4ee5-80dc-a4025efc819e" (UID: "a342033f-70cb-4ee5-80dc-a4025efc819e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 02:02:20.049995 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:20.049941 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a342033f-70cb-4ee5-80dc-a4025efc819e-kube-api-access-kwx65" (OuterVolumeSpecName: "kube-api-access-kwx65") pod "a342033f-70cb-4ee5-80dc-a4025efc819e" (UID: "a342033f-70cb-4ee5-80dc-a4025efc819e"). InnerVolumeSpecName "kube-api-access-kwx65". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:02:20.149181 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:20.149143 2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a342033f-70cb-4ee5-80dc-a4025efc819e-openshift-service-ca\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 02:02:20.149181 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:20.149174 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwx65\" (UniqueName: \"kubernetes.io/projected/a342033f-70cb-4ee5-80dc-a4025efc819e-kube-api-access-kwx65\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 02:02:20.149403 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:20.149190 2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a342033f-70cb-4ee5-80dc-a4025efc819e-maas-api-tls\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 02:02:20.901780 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:20.901741 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf" event={"ID":"a342033f-70cb-4ee5-80dc-a4025efc819e","Type":"ContainerDied","Data":"bd3f59c3f7e2b4730da9cb69db0b9eeac4eadbe91fde3515e40215ede0bab91a"} Jul 09 02:02:20.902369 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:20.901822 2564 scope.go:117] "RemoveContainer" containerID="2231ee1fd516550f552727132dc5aab7cfe68e64c38a45b03cc55166276828e0" Jul 09 02:02:20.902369 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:20.901758 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf" Jul 09 02:02:20.926590 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:20.926567 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf"] Jul 09 02:02:20.930108 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:20.930085 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-648e4a0f-67b46ff744-4hzrf"] Jul 09 02:02:21.875835 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:21.875800 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a342033f-70cb-4ee5-80dc-a4025efc819e" path="/var/lib/kubelet/pods/a342033f-70cb-4ee5-80dc-a4025efc819e/volumes" Jul 09 02:02:26.790341 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:26.790307 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895"] Jul 09 02:02:26.790889 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:26.790868 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a342033f-70cb-4ee5-80dc-a4025efc819e" containerName="maas-api" Jul 09 02:02:26.790980 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:26.790893 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a342033f-70cb-4ee5-80dc-a4025efc819e" containerName="maas-api" Jul 09 02:02:26.791040 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:26.791019 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a342033f-70cb-4ee5-80dc-a4025efc819e" containerName="maas-api" Jul 09 02:02:26.795541 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:26.795514 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895" Jul 09 02:02:26.798200 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:26.798179 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-c2d2d4a2-serving-cert\"" Jul 09 02:02:26.811484 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:26.811462 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895"] Jul 09 02:02:26.910748 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:26.910709 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9220f5e5-627e-45f4-b209-6a2183cc1519-maas-api-tls\") pod \"maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895\" (UID: \"9220f5e5-627e-45f4-b209-6a2183cc1519\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895" Jul 09 02:02:26.910748 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:26.910750 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vlms\" (UniqueName: \"kubernetes.io/projected/9220f5e5-627e-45f4-b209-6a2183cc1519-kube-api-access-5vlms\") pod \"maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895\" (UID: \"9220f5e5-627e-45f4-b209-6a2183cc1519\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895" Jul 09 02:02:26.911010 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:26.910890 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9220f5e5-627e-45f4-b209-6a2183cc1519-openshift-service-ca\") pod \"maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895\" (UID: \"9220f5e5-627e-45f4-b209-6a2183cc1519\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895" Jul 09 02:02:27.012182 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:27.012147 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9220f5e5-627e-45f4-b209-6a2183cc1519-openshift-service-ca\") pod \"maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895\" (UID: \"9220f5e5-627e-45f4-b209-6a2183cc1519\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895" Jul 09 02:02:27.012410 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:27.012217 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9220f5e5-627e-45f4-b209-6a2183cc1519-maas-api-tls\") pod \"maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895\" (UID: \"9220f5e5-627e-45f4-b209-6a2183cc1519\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895" Jul 09 02:02:27.012410 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:27.012279 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vlms\" (UniqueName: \"kubernetes.io/projected/9220f5e5-627e-45f4-b209-6a2183cc1519-kube-api-access-5vlms\") pod \"maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895\" (UID: \"9220f5e5-627e-45f4-b209-6a2183cc1519\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895" Jul 09 02:02:27.012410 ip-10-0-131-181 kubenswrapper[2564]: E0709 02:02:27.012373 2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-c2d2d4a2-serving-cert: secret "maas-api-e2e-ait-c2d2d4a2-serving-cert" not found Jul 09 02:02:27.012585 ip-10-0-131-181 kubenswrapper[2564]: E0709 02:02:27.012454 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9220f5e5-627e-45f4-b209-6a2183cc1519-maas-api-tls podName:9220f5e5-627e-45f4-b209-6a2183cc1519 nodeName:}" failed. No retries permitted until 2026-07-09 02:02:27.512432634 +0000 UTC m=+1480.174170116 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9220f5e5-627e-45f4-b209-6a2183cc1519-maas-api-tls") pod "maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895" (UID: "9220f5e5-627e-45f4-b209-6a2183cc1519") : secret "maas-api-e2e-ait-c2d2d4a2-serving-cert" not found Jul 09 02:02:27.012822 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:27.012802 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9220f5e5-627e-45f4-b209-6a2183cc1519-openshift-service-ca\") pod \"maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895\" (UID: \"9220f5e5-627e-45f4-b209-6a2183cc1519\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895" Jul 09 02:02:27.023794 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:27.023767 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vlms\" (UniqueName: \"kubernetes.io/projected/9220f5e5-627e-45f4-b209-6a2183cc1519-kube-api-access-5vlms\") pod \"maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895\" (UID: \"9220f5e5-627e-45f4-b209-6a2183cc1519\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895" Jul 09 02:02:27.517390 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:27.517350 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9220f5e5-627e-45f4-b209-6a2183cc1519-maas-api-tls\") pod \"maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895\" (UID: \"9220f5e5-627e-45f4-b209-6a2183cc1519\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895" Jul 09 02:02:27.519847 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:27.519817 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9220f5e5-627e-45f4-b209-6a2183cc1519-maas-api-tls\") pod \"maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895\" (UID: \"9220f5e5-627e-45f4-b209-6a2183cc1519\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895" Jul 09 02:02:27.706290 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:27.706252 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895" Jul 09 02:02:27.893952 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:27.893925 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895"] Jul 09 02:02:27.895626 ip-10-0-131-181 kubenswrapper[2564]: W0709 02:02:27.895596 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9220f5e5_627e_45f4_b209_6a2183cc1519.slice/crio-ceea34ee817b9077303710d9e58dfc0a09c9f0288cca055bd1e8044301384665 WatchSource:0}: Error finding container ceea34ee817b9077303710d9e58dfc0a09c9f0288cca055bd1e8044301384665: Status 404 returned error can't find the container with id ceea34ee817b9077303710d9e58dfc0a09c9f0288cca055bd1e8044301384665 Jul 09 02:02:27.941986 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:27.941946 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895" event={"ID":"9220f5e5-627e-45f4-b209-6a2183cc1519","Type":"ContainerStarted","Data":"ceea34ee817b9077303710d9e58dfc0a09c9f0288cca055bd1e8044301384665"} Jul 09 02:02:28.949083 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:28.949046 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895" event={"ID":"9220f5e5-627e-45f4-b209-6a2183cc1519","Type":"ContainerStarted","Data":"1b9a916775f36cb03281cd3eb1cd57e311c89d9532058907ef208c3ea2445c78"} Jul 09 02:02:28.949509 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:28.949122 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895" Jul 09 02:02:28.974173 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:28.974128 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895" podStartSLOduration=2.628228375 podStartE2EDuration="2.9741126s" totalImagesPullingTime="345.884225ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:02:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:02:28.971621707 +0000 UTC m=+1481.633359199" watchObservedRunningTime="2026-07-09 02:02:28.9741126 +0000 UTC m=+1481.635850092" Jul 09 02:02:32.228124 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:32.228092 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895"] Jul 09 02:02:32.228856 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:32.228825 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895" podUID="9220f5e5-627e-45f4-b209-6a2183cc1519" containerName="maas-api" containerID="cri-o://1b9a916775f36cb03281cd3eb1cd57e311c89d9532058907ef208c3ea2445c78" gracePeriod=30 Jul 09 02:02:32.493671 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:32.493603 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895" Jul 09 02:02:32.563007 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:32.562982 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vlms\" (UniqueName: \"kubernetes.io/projected/9220f5e5-627e-45f4-b209-6a2183cc1519-kube-api-access-5vlms\") pod \"9220f5e5-627e-45f4-b209-6a2183cc1519\" (UID: \"9220f5e5-627e-45f4-b209-6a2183cc1519\") " Jul 09 02:02:32.563207 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:32.563028 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9220f5e5-627e-45f4-b209-6a2183cc1519-maas-api-tls\") pod \"9220f5e5-627e-45f4-b209-6a2183cc1519\" (UID: \"9220f5e5-627e-45f4-b209-6a2183cc1519\") " Jul 09 02:02:32.563207 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:32.563075 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9220f5e5-627e-45f4-b209-6a2183cc1519-openshift-service-ca\") pod \"9220f5e5-627e-45f4-b209-6a2183cc1519\" (UID: \"9220f5e5-627e-45f4-b209-6a2183cc1519\") " Jul 09 02:02:32.563550 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:32.563521 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9220f5e5-627e-45f4-b209-6a2183cc1519-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9220f5e5-627e-45f4-b209-6a2183cc1519" (UID: "9220f5e5-627e-45f4-b209-6a2183cc1519"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:02:32.565271 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:32.565224 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9220f5e5-627e-45f4-b209-6a2183cc1519-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9220f5e5-627e-45f4-b209-6a2183cc1519" (UID: "9220f5e5-627e-45f4-b209-6a2183cc1519"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 02:02:32.565271 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:32.565248 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9220f5e5-627e-45f4-b209-6a2183cc1519-kube-api-access-5vlms" (OuterVolumeSpecName: "kube-api-access-5vlms") pod "9220f5e5-627e-45f4-b209-6a2183cc1519" (UID: "9220f5e5-627e-45f4-b209-6a2183cc1519"). InnerVolumeSpecName "kube-api-access-5vlms". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:02:32.663862 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:32.663831 2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9220f5e5-627e-45f4-b209-6a2183cc1519-openshift-service-ca\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 02:02:32.663862 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:32.663859 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vlms\" (UniqueName: \"kubernetes.io/projected/9220f5e5-627e-45f4-b209-6a2183cc1519-kube-api-access-5vlms\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 02:02:32.663862 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:32.663871 2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9220f5e5-627e-45f4-b209-6a2183cc1519-maas-api-tls\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 02:02:32.973551 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:32.973520 2564 generic.go:356] "Generic (PLEG): container finished" podID="9220f5e5-627e-45f4-b209-6a2183cc1519" containerID="1b9a916775f36cb03281cd3eb1cd57e311c89d9532058907ef208c3ea2445c78" exitCode=0 Jul 09 02:02:32.973725 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:32.973566 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895" Jul 09 02:02:32.973725 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:32.973599 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895" event={"ID":"9220f5e5-627e-45f4-b209-6a2183cc1519","Type":"ContainerDied","Data":"1b9a916775f36cb03281cd3eb1cd57e311c89d9532058907ef208c3ea2445c78"} Jul 09 02:02:32.973725 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:32.973657 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895" event={"ID":"9220f5e5-627e-45f4-b209-6a2183cc1519","Type":"ContainerDied","Data":"ceea34ee817b9077303710d9e58dfc0a09c9f0288cca055bd1e8044301384665"} Jul 09 02:02:32.973725 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:32.973689 2564 scope.go:117] "RemoveContainer" containerID="1b9a916775f36cb03281cd3eb1cd57e311c89d9532058907ef208c3ea2445c78" Jul 09 02:02:32.983104 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:32.983087 2564 scope.go:117] "RemoveContainer" containerID="1b9a916775f36cb03281cd3eb1cd57e311c89d9532058907ef208c3ea2445c78" Jul 09 02:02:32.983359 ip-10-0-131-181 kubenswrapper[2564]: E0709 02:02:32.983341 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b9a916775f36cb03281cd3eb1cd57e311c89d9532058907ef208c3ea2445c78\": container with ID starting with 1b9a916775f36cb03281cd3eb1cd57e311c89d9532058907ef208c3ea2445c78 not found: ID does not exist" containerID="1b9a916775f36cb03281cd3eb1cd57e311c89d9532058907ef208c3ea2445c78" Jul 09 02:02:32.983408 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:32.983367 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b9a916775f36cb03281cd3eb1cd57e311c89d9532058907ef208c3ea2445c78"} err="failed to get container status \"1b9a916775f36cb03281cd3eb1cd57e311c89d9532058907ef208c3ea2445c78\": rpc error: code = NotFound desc = could not find container \"1b9a916775f36cb03281cd3eb1cd57e311c89d9532058907ef208c3ea2445c78\": container with ID starting with 1b9a916775f36cb03281cd3eb1cd57e311c89d9532058907ef208c3ea2445c78 not found: ID does not exist" Jul 09 02:02:32.995953 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:32.995929 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895"] Jul 09 02:02:32.999577 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:32.999557 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c2d2d4a2-7fbcd4fb88-hb895"] Jul 09 02:02:33.868953 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:33.868921 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9220f5e5-627e-45f4-b209-6a2183cc1519" path="/var/lib/kubelet/pods/9220f5e5-627e-45f4-b209-6a2183cc1519/volumes" Jul 09 02:02:45.178894 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:45.178860 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw"] Jul 09 02:02:45.179296 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:45.179283 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9220f5e5-627e-45f4-b209-6a2183cc1519" containerName="maas-api" Jul 09 02:02:45.179296 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:45.179297 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9220f5e5-627e-45f4-b209-6a2183cc1519" containerName="maas-api" Jul 09 02:02:45.179379 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:45.179358 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9220f5e5-627e-45f4-b209-6a2183cc1519" containerName="maas-api" Jul 09 02:02:45.183657 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:45.183639 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw" Jul 09 02:02:45.187121 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:45.187104 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-aad4ce3b-serving-cert\"" Jul 09 02:02:45.204790 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:45.204765 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw"] Jul 09 02:02:45.290117 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:45.290081 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3eed6988-091a-425e-aa68-d2970ed778a7-openshift-service-ca\") pod \"maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw\" (UID: \"3eed6988-091a-425e-aa68-d2970ed778a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw" Jul 09 02:02:45.290117 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:45.290118 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb8x7\" (UniqueName: \"kubernetes.io/projected/3eed6988-091a-425e-aa68-d2970ed778a7-kube-api-access-mb8x7\") pod \"maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw\" (UID: \"3eed6988-091a-425e-aa68-d2970ed778a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw" Jul 09 02:02:45.290368 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:45.290157 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3eed6988-091a-425e-aa68-d2970ed778a7-maas-api-tls\") pod \"maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw\" (UID: \"3eed6988-091a-425e-aa68-d2970ed778a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw" Jul 09 02:02:45.391727 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:45.391681 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3eed6988-091a-425e-aa68-d2970ed778a7-maas-api-tls\") pod \"maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw\" (UID: \"3eed6988-091a-425e-aa68-d2970ed778a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw" Jul 09 02:02:45.391916 ip-10-0-131-181 kubenswrapper[2564]: E0709 02:02:45.391837 2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-aad4ce3b-serving-cert: secret "maas-api-e2e-derive-aad4ce3b-serving-cert" not found Jul 09 02:02:45.391916 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:45.391833 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3eed6988-091a-425e-aa68-d2970ed778a7-openshift-service-ca\") pod \"maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw\" (UID: \"3eed6988-091a-425e-aa68-d2970ed778a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw" Jul 09 02:02:45.391916 ip-10-0-131-181 kubenswrapper[2564]: E0709 02:02:45.391905 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3eed6988-091a-425e-aa68-d2970ed778a7-maas-api-tls podName:3eed6988-091a-425e-aa68-d2970ed778a7 nodeName:}" failed. No retries permitted until 2026-07-09 02:02:45.891883663 +0000 UTC m=+1498.553621147 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3eed6988-091a-425e-aa68-d2970ed778a7-maas-api-tls") pod "maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw" (UID: "3eed6988-091a-425e-aa68-d2970ed778a7") : secret "maas-api-e2e-derive-aad4ce3b-serving-cert" not found Jul 09 02:02:45.392080 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:45.391968 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb8x7\" (UniqueName: \"kubernetes.io/projected/3eed6988-091a-425e-aa68-d2970ed778a7-kube-api-access-mb8x7\") pod \"maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw\" (UID: \"3eed6988-091a-425e-aa68-d2970ed778a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw" Jul 09 02:02:45.392487 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:45.392469 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3eed6988-091a-425e-aa68-d2970ed778a7-openshift-service-ca\") pod \"maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw\" (UID: \"3eed6988-091a-425e-aa68-d2970ed778a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw" Jul 09 02:02:45.402123 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:45.402010 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb8x7\" (UniqueName: \"kubernetes.io/projected/3eed6988-091a-425e-aa68-d2970ed778a7-kube-api-access-mb8x7\") pod \"maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw\" (UID: \"3eed6988-091a-425e-aa68-d2970ed778a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw" Jul 09 02:02:45.900413 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:45.900339 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3eed6988-091a-425e-aa68-d2970ed778a7-maas-api-tls\") pod \"maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw\" (UID: \"3eed6988-091a-425e-aa68-d2970ed778a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw" Jul 09 02:02:45.902866 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:45.902841 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3eed6988-091a-425e-aa68-d2970ed778a7-maas-api-tls\") pod \"maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw\" (UID: \"3eed6988-091a-425e-aa68-d2970ed778a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw" Jul 09 02:02:46.094315 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:46.094276 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw" Jul 09 02:02:46.237795 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:46.237769 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw"] Jul 09 02:02:46.239731 ip-10-0-131-181 kubenswrapper[2564]: W0709 02:02:46.239689 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eed6988_091a_425e_aa68_d2970ed778a7.slice/crio-f63447c6df038b522927ea13015d3f18497663ce59e0c68ddc2a703451e69b3c WatchSource:0}: Error finding container f63447c6df038b522927ea13015d3f18497663ce59e0c68ddc2a703451e69b3c: Status 404 returned error can't find the container with id f63447c6df038b522927ea13015d3f18497663ce59e0c68ddc2a703451e69b3c Jul 09 02:02:47.051724 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:47.051689 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw" event={"ID":"3eed6988-091a-425e-aa68-d2970ed778a7","Type":"ContainerStarted","Data":"3ba0c16646ccc07f655cc40ac2c2e48b1dbacb0904a16754541fc340fb9baa6a"} Jul 09 02:02:47.051880 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:47.051782 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw" Jul 09 02:02:47.051880 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:47.051800 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw" event={"ID":"3eed6988-091a-425e-aa68-d2970ed778a7","Type":"ContainerStarted","Data":"f63447c6df038b522927ea13015d3f18497663ce59e0c68ddc2a703451e69b3c"} Jul 09 02:02:47.071562 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:47.071515 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw" podStartSLOduration=1.641456526 podStartE2EDuration="2.071500755s" totalImagesPullingTime="430.044229ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:02:47.070442484 +0000 UTC m=+1499.732179976" watchObservedRunningTime="2026-07-09 02:02:47.071500755 +0000 UTC m=+1499.733238247" Jul 09 02:02:47.935099 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:47.935070 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gfhk_3d8307ed-04c9-429e-a83c-7b24847e0a38/console-operator/1.log" Jul 09 02:02:47.939225 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:47.939203 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gfhk_3d8307ed-04c9-429e-a83c-7b24847e0a38/console-operator/1.log" Jul 09 02:02:49.793757 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:49.793720 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw"] Jul 09 02:02:49.795025 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:49.794602 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw" podUID="3eed6988-091a-425e-aa68-d2970ed778a7" containerName="maas-api" containerID="cri-o://3ba0c16646ccc07f655cc40ac2c2e48b1dbacb0904a16754541fc340fb9baa6a" gracePeriod=30 Jul 09 02:02:50.046653 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:50.046594 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw" Jul 09 02:02:50.073560 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:50.073526 2564 generic.go:356] "Generic (PLEG): container finished" podID="3eed6988-091a-425e-aa68-d2970ed778a7" containerID="3ba0c16646ccc07f655cc40ac2c2e48b1dbacb0904a16754541fc340fb9baa6a" exitCode=0 Jul 09 02:02:50.073740 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:50.073574 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw" Jul 09 02:02:50.073740 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:50.073621 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw" event={"ID":"3eed6988-091a-425e-aa68-d2970ed778a7","Type":"ContainerDied","Data":"3ba0c16646ccc07f655cc40ac2c2e48b1dbacb0904a16754541fc340fb9baa6a"} Jul 09 02:02:50.073740 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:50.073688 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw" event={"ID":"3eed6988-091a-425e-aa68-d2970ed778a7","Type":"ContainerDied","Data":"f63447c6df038b522927ea13015d3f18497663ce59e0c68ddc2a703451e69b3c"} Jul 09 02:02:50.073740 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:50.073720 2564 scope.go:117] "RemoveContainer" containerID="3ba0c16646ccc07f655cc40ac2c2e48b1dbacb0904a16754541fc340fb9baa6a" Jul 09 02:02:50.084670 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:50.084652 2564 scope.go:117] "RemoveContainer" containerID="3ba0c16646ccc07f655cc40ac2c2e48b1dbacb0904a16754541fc340fb9baa6a" Jul 09 02:02:50.084942 ip-10-0-131-181 kubenswrapper[2564]: E0709 02:02:50.084922 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ba0c16646ccc07f655cc40ac2c2e48b1dbacb0904a16754541fc340fb9baa6a\": container with ID starting with 3ba0c16646ccc07f655cc40ac2c2e48b1dbacb0904a16754541fc340fb9baa6a not found: ID does not exist" containerID="3ba0c16646ccc07f655cc40ac2c2e48b1dbacb0904a16754541fc340fb9baa6a" Jul 09 02:02:50.085055 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:50.084948 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ba0c16646ccc07f655cc40ac2c2e48b1dbacb0904a16754541fc340fb9baa6a"} err="failed to get container status \"3ba0c16646ccc07f655cc40ac2c2e48b1dbacb0904a16754541fc340fb9baa6a\": rpc error: code = NotFound desc = could not find container \"3ba0c16646ccc07f655cc40ac2c2e48b1dbacb0904a16754541fc340fb9baa6a\": container with ID starting with 3ba0c16646ccc07f655cc40ac2c2e48b1dbacb0904a16754541fc340fb9baa6a not found: ID does not exist" Jul 09 02:02:50.139378 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:50.139348 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3eed6988-091a-425e-aa68-d2970ed778a7-maas-api-tls\") pod \"3eed6988-091a-425e-aa68-d2970ed778a7\" (UID: \"3eed6988-091a-425e-aa68-d2970ed778a7\") " Jul 09 02:02:50.139559 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:50.139391 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3eed6988-091a-425e-aa68-d2970ed778a7-openshift-service-ca\") pod \"3eed6988-091a-425e-aa68-d2970ed778a7\" (UID: \"3eed6988-091a-425e-aa68-d2970ed778a7\") " Jul 09 02:02:50.139559 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:50.139419 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mb8x7\" (UniqueName: \"kubernetes.io/projected/3eed6988-091a-425e-aa68-d2970ed778a7-kube-api-access-mb8x7\") pod \"3eed6988-091a-425e-aa68-d2970ed778a7\" (UID: \"3eed6988-091a-425e-aa68-d2970ed778a7\") " Jul 09 02:02:50.139866 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:50.139838 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3eed6988-091a-425e-aa68-d2970ed778a7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3eed6988-091a-425e-aa68-d2970ed778a7" (UID: "3eed6988-091a-425e-aa68-d2970ed778a7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:02:50.141615 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:50.141578 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3eed6988-091a-425e-aa68-d2970ed778a7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3eed6988-091a-425e-aa68-d2970ed778a7" (UID: "3eed6988-091a-425e-aa68-d2970ed778a7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 02:02:50.141713 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:50.141700 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3eed6988-091a-425e-aa68-d2970ed778a7-kube-api-access-mb8x7" (OuterVolumeSpecName: "kube-api-access-mb8x7") pod "3eed6988-091a-425e-aa68-d2970ed778a7" (UID: "3eed6988-091a-425e-aa68-d2970ed778a7"). InnerVolumeSpecName "kube-api-access-mb8x7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:02:50.240536 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:50.240507 2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3eed6988-091a-425e-aa68-d2970ed778a7-maas-api-tls\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 02:02:50.240536 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:50.240532 2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3eed6988-091a-425e-aa68-d2970ed778a7-openshift-service-ca\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 02:02:50.240536 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:50.240543 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mb8x7\" (UniqueName: \"kubernetes.io/projected/3eed6988-091a-425e-aa68-d2970ed778a7-kube-api-access-mb8x7\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 02:02:50.396753 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:50.396724 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw"] Jul 09 02:02:50.400514 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:50.400488 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-aad4ce3b-8f78c74-fv7mw"] Jul 09 02:02:51.867500 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:02:51.867469 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3eed6988-091a-425e-aa68-d2970ed778a7" path="/var/lib/kubelet/pods/3eed6988-091a-425e-aa68-d2970ed778a7/volumes" Jul 09 02:07:47.972098 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:07:47.972066 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gfhk_3d8307ed-04c9-429e-a83c-7b24847e0a38/console-operator/1.log" Jul 09 02:07:47.976250 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:07:47.976212 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gfhk_3d8307ed-04c9-429e-a83c-7b24847e0a38/console-operator/1.log" Jul 09 02:08:03.196681 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.196646 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h"] Jul 09 02:08:03.197092 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.197079 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3eed6988-091a-425e-aa68-d2970ed778a7" containerName="maas-api" Jul 09 02:08:03.197136 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.197093 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3eed6988-091a-425e-aa68-d2970ed778a7" containerName="maas-api" Jul 09 02:08:03.197171 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.197158 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3eed6988-091a-425e-aa68-d2970ed778a7" containerName="maas-api" Jul 09 02:08:03.200253 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.200225 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:03.204578 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.204558 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-65e1b4-openshift-default-dockercfg-pv7sk\"" Jul 09 02:08:03.214379 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.214361 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h"] Jul 09 02:08:03.282941 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.282902 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-credential-socket\") pod \"e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:03.283114 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.282952 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istio-token\") pod \"e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:03.283114 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.282975 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istiod-ca-cert\") pod \"e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:03.283114 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.283046 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-workload-certs\") pod \"e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:03.283114 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.283101 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istio-podinfo\") pod \"e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:03.283317 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.283126 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4br6f\" (UniqueName: \"kubernetes.io/projected/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-kube-api-access-4br6f\") pod \"e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:03.283317 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.283167 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istio-envoy\") pod \"e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:03.283317 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.283185 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-workload-socket\") pod \"e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:03.283317 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.283217 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istio-data\") pod \"e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:03.384162 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.384128 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istio-data\") pod \"e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:03.384352 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.384171 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-credential-socket\") pod \"e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:03.384352 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.384198 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istio-token\") pod \"e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:03.384352 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.384311 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istiod-ca-cert\") pod \"e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:03.384461 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.384358 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-workload-certs\") pod \"e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:03.384461 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.384419 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istio-podinfo\") pod \"e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:03.384461 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.384443 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4br6f\" (UniqueName: \"kubernetes.io/projected/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-kube-api-access-4br6f\") pod \"e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:03.384607 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.384494 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istio-envoy\") pod \"e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:03.384607 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.384525 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-workload-socket\") pod \"e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:03.384607 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.384580 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istio-data\") pod \"e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:03.384769 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.384605 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-credential-socket\") pod \"e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:03.384829 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.384797 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-workload-certs\") pod \"e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:03.384886 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.384861 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-workload-socket\") pod \"e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:03.385049 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.385030 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istiod-ca-cert\") pod \"e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:03.386691 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.386657 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istio-envoy\") pod \"e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:03.386895 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.386876 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istio-podinfo\") pod \"e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:03.392700 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.392665 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istio-token\") pod \"e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:03.392807 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.392733 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4br6f\" (UniqueName: \"kubernetes.io/projected/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-kube-api-access-4br6f\") pod \"e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:03.511086 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.510992 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:03.655834 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.655807 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h"] Jul 09 02:08:03.657256 ip-10-0-131-181 kubenswrapper[2564]: W0709 02:08:03.657196 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85e9c3e0_5759_45a7_bdf6_939a5a20a4cf.slice/crio-846e25d3bd28d5a0b1e357fc98c8b6705615ebf4f77283dba12459c1b68c0eec WatchSource:0}: Error finding container 846e25d3bd28d5a0b1e357fc98c8b6705615ebf4f77283dba12459c1b68c0eec: Status 404 returned error can't find the container with id 846e25d3bd28d5a0b1e357fc98c8b6705615ebf4f77283dba12459c1b68c0eec Jul 09 02:08:03.659282 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.659263 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 02:08:03.814665 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:03.814574 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" event={"ID":"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf","Type":"ContainerStarted","Data":"846e25d3bd28d5a0b1e357fc98c8b6705615ebf4f77283dba12459c1b68c0eec"} Jul 09 02:08:07.313571 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:07.313525 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:08:07.313874 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:07.313597 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:08:07.313874 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:07.313649 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:08:07.840622 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:07.840582 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" event={"ID":"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf","Type":"ContainerStarted","Data":"93641441a9319873f8c373e87a00a5f02f9c5515f6a1328aab0fc3d580186f78"} Jul 09 02:08:07.862276 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:07.862206 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" podStartSLOduration=1.208371037 podStartE2EDuration="4.862187353s" totalImagesPullingTime="3.653816316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:08:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:08:07.859310093 +0000 UTC m=+1820.521047588" watchObservedRunningTime="2026-07-09 02:08:07.862187353 +0000 UTC m=+1820.523924845" Jul 09 02:08:08.511247 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:08.511202 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:08.515794 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:08.515767 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:08.846377 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:08.846281 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:08.847341 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:08.847320 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:21.927611 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:21.927576 2564 generic.go:356] "Generic (PLEG): container finished" podID="85e9c3e0-5759-45a7-bdf6-939a5a20a4cf" containerID="93641441a9319873f8c373e87a00a5f02f9c5515f6a1328aab0fc3d580186f78" exitCode=0 Jul 09 02:08:21.928057 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:21.927627 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" event={"ID":"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf","Type":"ContainerDied","Data":"93641441a9319873f8c373e87a00a5f02f9c5515f6a1328aab0fc3d580186f78"} Jul 09 02:08:21.928057 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:21.927977 2564 scope.go:117] "RemoveContainer" containerID="93641441a9319873f8c373e87a00a5f02f9c5515f6a1328aab0fc3d580186f78" Jul 09 02:08:21.930037 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:21.929999 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:08:21.930134 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:21.930077 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:08:21.930134 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:21.930116 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:08:22.935346 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:22.935305 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" event={"ID":"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf","Type":"ContainerStarted","Data":"a97ae8af8185e6956791dd99eb27d8804dc9c890801a38362af6af16fa3f4a0c"} Jul 09 02:08:23.511712 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:23.511671 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:23.512782 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:23.512758 2564 patch_prober.go:28] interesting pod/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Jul 09 02:08:23.512898 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:23.512804 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" podUID="85e9c3e0-5759-45a7-bdf6-939a5a20a4cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Jul 09 02:08:23.846308 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:23.846203 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:24.511960 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:24.511925 2564 patch_prober.go:28] interesting pod/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Jul 09 02:08:24.512406 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:24.511983 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" podUID="85e9c3e0-5759-45a7-bdf6-939a5a20a4cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Jul 09 02:08:25.511967 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:25.511928 2564 patch_prober.go:28] interesting pod/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Jul 09 02:08:25.512393 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:25.511981 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" podUID="85e9c3e0-5759-45a7-bdf6-939a5a20a4cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Jul 09 02:08:26.512371 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:26.512335 2564 patch_prober.go:28] interesting pod/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Jul 09 02:08:26.512771 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:26.512388 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" podUID="85e9c3e0-5759-45a7-bdf6-939a5a20a4cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Jul 09 02:08:27.515713 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:27.515666 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:08:27.516702 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:08:27.516680 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:09:59.294940 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:09:59.294903 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h"] Jul 09 02:09:59.295440 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:09:59.295141 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" podUID="85e9c3e0-5759-45a7-bdf6-939a5a20a4cf" containerName="istio-proxy" containerID="cri-o://a97ae8af8185e6956791dd99eb27d8804dc9c890801a38362af6af16fa3f4a0c" gracePeriod=30 Jul 09 02:10:04.509636 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.509604 2564 generic.go:356] "Generic (PLEG): container finished" podID="85e9c3e0-5759-45a7-bdf6-939a5a20a4cf" containerID="a97ae8af8185e6956791dd99eb27d8804dc9c890801a38362af6af16fa3f4a0c" exitCode=0 Jul 09 02:10:04.510062 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.509672 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" event={"ID":"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf","Type":"ContainerDied","Data":"a97ae8af8185e6956791dd99eb27d8804dc9c890801a38362af6af16fa3f4a0c"} Jul 09 02:10:04.510062 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.509738 2564 scope.go:117] "RemoveContainer" containerID="93641441a9319873f8c373e87a00a5f02f9c5515f6a1328aab0fc3d580186f78" Jul 09 02:10:04.571677 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.571609 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:10:04.696045 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.696011 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istio-token\") pod \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " Jul 09 02:10:04.696045 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.696047 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istiod-ca-cert\") pod \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " Jul 09 02:10:04.696339 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.696090 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istio-envoy\") pod \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " Jul 09 02:10:04.696339 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.696117 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-workload-certs\") pod \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " Jul 09 02:10:04.696339 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.696146 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4br6f\" (UniqueName: \"kubernetes.io/projected/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-kube-api-access-4br6f\") pod \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " Jul 09 02:10:04.696339 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.696203 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istio-podinfo\") pod \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " Jul 09 02:10:04.696339 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.696227 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-workload-socket\") pod \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " Jul 09 02:10:04.696339 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.696277 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istio-data\") pod \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " Jul 09 02:10:04.696642 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.696361 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-credential-socket\") pod \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\" (UID: \"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf\") " Jul 09 02:10:04.696642 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.696459 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "85e9c3e0-5759-45a7-bdf6-939a5a20a4cf" (UID: "85e9c3e0-5759-45a7-bdf6-939a5a20a4cf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:10:04.696642 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.696532 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "85e9c3e0-5759-45a7-bdf6-939a5a20a4cf" (UID: "85e9c3e0-5759-45a7-bdf6-939a5a20a4cf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:10:04.696804 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.696791 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istiod-ca-cert\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 02:10:04.696863 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.696791 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "85e9c3e0-5759-45a7-bdf6-939a5a20a4cf" (UID: "85e9c3e0-5759-45a7-bdf6-939a5a20a4cf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:10:04.697114 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.696816 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-workload-certs\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 02:10:04.697210 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.696876 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "85e9c3e0-5759-45a7-bdf6-939a5a20a4cf" (UID: "85e9c3e0-5759-45a7-bdf6-939a5a20a4cf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:10:04.697596 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.697564 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istio-data" (OuterVolumeSpecName: "istio-data") pod "85e9c3e0-5759-45a7-bdf6-939a5a20a4cf" (UID: "85e9c3e0-5759-45a7-bdf6-939a5a20a4cf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:10:04.698483 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.698458 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istio-token" (OuterVolumeSpecName: "istio-token") pod "85e9c3e0-5759-45a7-bdf6-939a5a20a4cf" (UID: "85e9c3e0-5759-45a7-bdf6-939a5a20a4cf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:10:04.698605 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.698527 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-kube-api-access-4br6f" (OuterVolumeSpecName: "kube-api-access-4br6f") pod "85e9c3e0-5759-45a7-bdf6-939a5a20a4cf" (UID: "85e9c3e0-5759-45a7-bdf6-939a5a20a4cf"). InnerVolumeSpecName "kube-api-access-4br6f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:10:04.698605 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.698578 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "85e9c3e0-5759-45a7-bdf6-939a5a20a4cf" (UID: "85e9c3e0-5759-45a7-bdf6-939a5a20a4cf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:10:04.698850 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.698835 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "85e9c3e0-5759-45a7-bdf6-939a5a20a4cf" (UID: "85e9c3e0-5759-45a7-bdf6-939a5a20a4cf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 02:10:04.798320 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.798281 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istio-podinfo\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 02:10:04.798320 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.798310 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-workload-socket\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 02:10:04.798320 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.798322 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istio-data\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 02:10:04.798320 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.798331 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-credential-socket\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 02:10:04.798603 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.798339 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istio-token\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 02:10:04.798603 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.798349 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-istio-envoy\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 02:10:04.798603 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:04.798357 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4br6f\" (UniqueName: \"kubernetes.io/projected/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf-kube-api-access-4br6f\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 02:10:05.523128 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:05.523088 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" event={"ID":"85e9c3e0-5759-45a7-bdf6-939a5a20a4cf","Type":"ContainerDied","Data":"846e25d3bd28d5a0b1e357fc98c8b6705615ebf4f77283dba12459c1b68c0eec"} Jul 09 02:10:05.523128 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:05.523120 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h" Jul 09 02:10:05.523687 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:05.523192 2564 scope.go:117] "RemoveContainer" containerID="a97ae8af8185e6956791dd99eb27d8804dc9c890801a38362af6af16fa3f4a0c" Jul 09 02:10:05.546663 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:05.546628 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h"] Jul 09 02:10:05.557191 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:05.557162 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-65e1b4-openshift-default-58bbbdf977-4rh8h"] Jul 09 02:10:05.870161 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:05.870052 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85e9c3e0-5759-45a7-bdf6-939a5a20a4cf" path="/var/lib/kubelet/pods/85e9c3e0-5759-45a7-bdf6-939a5a20a4cf/volumes" Jul 09 02:10:46.908663 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:46.908571 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8"] Jul 09 02:10:46.909193 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:46.909113 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85e9c3e0-5759-45a7-bdf6-939a5a20a4cf" containerName="istio-proxy" Jul 09 02:10:46.909193 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:46.909133 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="85e9c3e0-5759-45a7-bdf6-939a5a20a4cf" containerName="istio-proxy" Jul 09 02:10:46.909297 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:46.909213 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="85e9c3e0-5759-45a7-bdf6-939a5a20a4cf" containerName="istio-proxy" Jul 09 02:10:46.909297 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:46.909223 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="85e9c3e0-5759-45a7-bdf6-939a5a20a4cf" containerName="istio-proxy" Jul 09 02:10:46.912584 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:46.912551 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:46.915061 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:46.915041 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-fc352a-openshift-default-dockercfg-qv7rg\"" Jul 09 02:10:46.924416 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:46.924393 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8"] Jul 09 02:10:47.045209 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.045171 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-workload-certs\") pod \"e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:47.045209 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.045206 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istio-token\") pod \"e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:47.045436 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.045277 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istio-envoy\") pod \"e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:47.045436 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.045327 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istio-podinfo\") pod \"e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:47.045436 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.045343 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istiod-ca-cert\") pod \"e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:47.045436 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.045359 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-workload-socket\") pod \"e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:47.045436 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.045416 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-credential-socket\") pod \"e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:47.045596 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.045469 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istio-data\") pod \"e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:47.045596 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.045515 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p22qw\" (UniqueName: \"kubernetes.io/projected/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-kube-api-access-p22qw\") pod \"e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:47.146695 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.146659 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istio-envoy\") pod \"e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:47.146888 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.146718 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istio-podinfo\") pod \"e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:47.146888 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.146749 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istiod-ca-cert\") pod \"e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:47.146888 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.146775 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-workload-socket\") pod \"e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:47.146888 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.146822 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-credential-socket\") pod \"e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:47.146888 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.146865 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istio-data\") pod \"e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:47.147168 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.146909 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p22qw\" (UniqueName: \"kubernetes.io/projected/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-kube-api-access-p22qw\") pod \"e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:47.147168 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.146948 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-workload-certs\") pod \"e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:47.147168 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.146979 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istio-token\") pod \"e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:47.147371 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.147299 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istio-data\") pod \"e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:47.147371 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.147327 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-credential-socket\") pod \"e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:47.147446 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.147413 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-workload-socket\") pod \"e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:47.147540 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.147516 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-workload-certs\") pod \"e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:47.147660 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.147641 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istiod-ca-cert\") pod \"e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:47.149111 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.149091 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istio-envoy\") pod \"e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:47.149359 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.149343 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istio-podinfo\") pod \"e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:47.157512 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.157481 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istio-token\") pod \"e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:47.158418 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.158392 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p22qw\" (UniqueName: \"kubernetes.io/projected/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-kube-api-access-p22qw\") pod \"e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:47.223814 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.223780 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:47.370534 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.370509 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8"] Jul 09 02:10:47.372564 ip-10-0-131-181 kubenswrapper[2564]: W0709 02:10:47.372534 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd8ddf5d_5d1c_4fa9_b110_b188a4325b40.slice/crio-9fbd6ba748dc5d4fcf412133b2d69707147075eb27929e07e3b7ef313007ae9e WatchSource:0}: Error finding container 9fbd6ba748dc5d4fcf412133b2d69707147075eb27929e07e3b7ef313007ae9e: Status 404 returned error can't find the container with id 9fbd6ba748dc5d4fcf412133b2d69707147075eb27929e07e3b7ef313007ae9e Jul 09 02:10:47.374910 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.374871 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:10:47.375002 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.374958 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:10:47.375051 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.374999 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:10:47.774872 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.774828 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" event={"ID":"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40","Type":"ContainerStarted","Data":"947aad9a52a830efce8ba7c57d355298a89956e55d2c35f3f9f528064b46c61f"} Jul 09 02:10:47.775045 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.774919 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" event={"ID":"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40","Type":"ContainerStarted","Data":"9fbd6ba748dc5d4fcf412133b2d69707147075eb27929e07e3b7ef313007ae9e"} Jul 09 02:10:47.798286 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:47.798220 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" podStartSLOduration=1.7982053690000002 podStartE2EDuration="1.798205369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:10:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:10:47.796064324 +0000 UTC m=+1980.457801806" watchObservedRunningTime="2026-07-09 02:10:47.798205369 +0000 UTC m=+1980.459942857" Jul 09 02:10:48.224738 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:48.224701 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:48.229823 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:48.229796 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:48.780857 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:48.780826 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:10:48.781851 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:10:48.781832 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:11:03.782031 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:11:03.782000 2564 patch_prober.go:28] interesting pod/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Jul 09 02:11:03.782421 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:11:03.782057 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" podUID="fd8ddf5d-5d1c-4fa9-b110-b188a4325b40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Jul 09 02:11:03.869779 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:11:03.869744 2564 generic.go:356] "Generic (PLEG): container finished" podID="fd8ddf5d-5d1c-4fa9-b110-b188a4325b40" containerID="947aad9a52a830efce8ba7c57d355298a89956e55d2c35f3f9f528064b46c61f" exitCode=0 Jul 09 02:11:03.869952 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:11:03.869813 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" event={"ID":"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40","Type":"ContainerDied","Data":"947aad9a52a830efce8ba7c57d355298a89956e55d2c35f3f9f528064b46c61f"} Jul 09 02:11:03.870188 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:11:03.870176 2564 scope.go:117] "RemoveContainer" containerID="947aad9a52a830efce8ba7c57d355298a89956e55d2c35f3f9f528064b46c61f" Jul 09 02:11:03.871311 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:11:03.871275 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:11:03.871438 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:11:03.871359 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:11:03.871438 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:11:03.871410 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 02:11:04.881607 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:11:04.881563 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" event={"ID":"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40","Type":"ContainerStarted","Data":"255a1a0d0a173d7f3f5cb0a2ea4389ebc7a14a5a52918c78d2ce35cc429709c0"} Jul 09 02:11:05.224892 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:11:05.224855 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:11:05.225090 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:11:05.225066 2564 patch_prober.go:28] interesting pod/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Jul 09 02:11:05.225138 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:11:05.225118 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" podUID="fd8ddf5d-5d1c-4fa9-b110-b188a4325b40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Jul 09 02:11:06.225078 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:11:06.225037 2564 patch_prober.go:28] interesting pod/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Jul 09 02:11:06.225514 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:11:06.225100 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" podUID="fd8ddf5d-5d1c-4fa9-b110-b188a4325b40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Jul 09 02:11:07.225088 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:11:07.225057 2564 patch_prober.go:28] interesting pod/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Jul 09 02:11:07.225486 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:11:07.225110 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" podUID="fd8ddf5d-5d1c-4fa9-b110-b188a4325b40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Jul 09 02:11:08.224547 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:11:08.224511 2564 patch_prober.go:28] interesting pod/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Jul 09 02:11:08.224758 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:11:08.224576 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" podUID="fd8ddf5d-5d1c-4fa9-b110-b188a4325b40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Jul 09 02:11:09.228111 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:11:09.228082 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:11:09.228499 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:11:09.228396 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:11:09.229102 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:11:09.229084 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:12:48.013375 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:12:48.013300 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gfhk_3d8307ed-04c9-429e-a83c-7b24847e0a38/console-operator/1.log" Jul 09 02:12:48.019919 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:12:48.019895 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gfhk_3d8307ed-04c9-429e-a83c-7b24847e0a38/console-operator/1.log" Jul 09 02:14:12.701620 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:12.701579 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8"] Jul 09 02:14:12.702142 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:12.701875 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" podUID="fd8ddf5d-5d1c-4fa9-b110-b188a4325b40" containerName="istio-proxy" containerID="cri-o://255a1a0d0a173d7f3f5cb0a2ea4389ebc7a14a5a52918c78d2ce35cc429709c0" gracePeriod=30 Jul 09 02:14:17.935622 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:17.935591 2564 generic.go:356] "Generic (PLEG): container finished" podID="fd8ddf5d-5d1c-4fa9-b110-b188a4325b40" containerID="255a1a0d0a173d7f3f5cb0a2ea4389ebc7a14a5a52918c78d2ce35cc429709c0" exitCode=0 Jul 09 02:14:17.936014 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:17.935674 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" event={"ID":"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40","Type":"ContainerDied","Data":"255a1a0d0a173d7f3f5cb0a2ea4389ebc7a14a5a52918c78d2ce35cc429709c0"} Jul 09 02:14:17.936014 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:17.935735 2564 scope.go:117] "RemoveContainer" containerID="947aad9a52a830efce8ba7c57d355298a89956e55d2c35f3f9f528064b46c61f" Jul 09 02:14:17.975271 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:17.975199 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:14:18.033054 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.033026 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p22qw\" (UniqueName: \"kubernetes.io/projected/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-kube-api-access-p22qw\") pod \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " Jul 09 02:14:18.033218 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.033093 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-workload-certs\") pod \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " Jul 09 02:14:18.033218 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.033117 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istio-podinfo\") pod \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " Jul 09 02:14:18.033218 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.033137 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istiod-ca-cert\") pod \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " Jul 09 02:14:18.033218 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.033163 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istio-token\") pod \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " Jul 09 02:14:18.033458 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.033225 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-credential-socket\") pod \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " Jul 09 02:14:18.033458 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.033269 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-workload-socket\") pod \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " Jul 09 02:14:18.033458 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.033317 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istio-envoy\") pod \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " Jul 09 02:14:18.033458 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.033361 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istio-data\") pod \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\" (UID: \"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40\") " Jul 09 02:14:18.033684 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.033487 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fd8ddf5d-5d1c-4fa9-b110-b188a4325b40" (UID: "fd8ddf5d-5d1c-4fa9-b110-b188a4325b40"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:14:18.033684 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.033554 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fd8ddf5d-5d1c-4fa9-b110-b188a4325b40" (UID: "fd8ddf5d-5d1c-4fa9-b110-b188a4325b40"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 02:14:18.033794 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.033686 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fd8ddf5d-5d1c-4fa9-b110-b188a4325b40" (UID: "fd8ddf5d-5d1c-4fa9-b110-b188a4325b40"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:14:18.033794 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.033774 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-workload-certs\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 02:14:18.033909 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.033794 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istiod-ca-cert\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 02:14:18.033909 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.033817 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fd8ddf5d-5d1c-4fa9-b110-b188a4325b40" (UID: "fd8ddf5d-5d1c-4fa9-b110-b188a4325b40"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:14:18.034416 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.034378 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istio-data" (OuterVolumeSpecName: "istio-data") pod "fd8ddf5d-5d1c-4fa9-b110-b188a4325b40" (UID: "fd8ddf5d-5d1c-4fa9-b110-b188a4325b40"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:14:18.035849 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.035820 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fd8ddf5d-5d1c-4fa9-b110-b188a4325b40" (UID: "fd8ddf5d-5d1c-4fa9-b110-b188a4325b40"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 02:14:18.035965 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.035819 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istio-token" (OuterVolumeSpecName: "istio-token") pod "fd8ddf5d-5d1c-4fa9-b110-b188a4325b40" (UID: "fd8ddf5d-5d1c-4fa9-b110-b188a4325b40"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:14:18.036256 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.036210 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fd8ddf5d-5d1c-4fa9-b110-b188a4325b40" (UID: "fd8ddf5d-5d1c-4fa9-b110-b188a4325b40"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 02:14:18.036339 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.036270 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-kube-api-access-p22qw" (OuterVolumeSpecName: "kube-api-access-p22qw") pod "fd8ddf5d-5d1c-4fa9-b110-b188a4325b40" (UID: "fd8ddf5d-5d1c-4fa9-b110-b188a4325b40"). InnerVolumeSpecName "kube-api-access-p22qw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 02:14:18.134776 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.134743 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istio-podinfo\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 02:14:18.134776 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.134770 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istio-token\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 02:14:18.134776 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.134780 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-credential-socket\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 02:14:18.135031 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.134789 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-workload-socket\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 02:14:18.135031 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.134798 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istio-envoy\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 02:14:18.135031 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.134806 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-istio-data\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 02:14:18.135031 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.134814 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p22qw\" (UniqueName: \"kubernetes.io/projected/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40-kube-api-access-p22qw\") on node \"ip-10-0-131-181.ec2.internal\" DevicePath \"\"" Jul 09 02:14:18.215038 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.215004 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5b8f9fb5db-fwwdd_9f833809-c857-4b56-8374-6c21e6ef9073/manager/0.log" Jul 09 02:14:18.336142 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.336051 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-j9dlv_534db92b-5570-45b7-bccc-bc63df445251/server/0.log" Jul 09 02:14:18.478640 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.478603 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-gj4kh_1dbf02f3-3602-4c1a-8e62-e053e932d9fa/manager/0.log" Jul 09 02:14:18.718636 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.718611 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b4b98c894-rknhq_b25ab30a-6059-4bf4-b812-add6a4ab09ec/copy-manifests/0.log" Jul 09 02:14:18.738243 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.738212 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b4b98c894-rknhq_b25ab30a-6059-4bf4-b812-add6a4ab09ec/manager/0.log" Jul 09 02:14:18.942857 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.942826 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" Jul 09 02:14:18.943364 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.942834 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8" event={"ID":"fd8ddf5d-5d1c-4fa9-b110-b188a4325b40","Type":"ContainerDied","Data":"9fbd6ba748dc5d4fcf412133b2d69707147075eb27929e07e3b7ef313007ae9e"} Jul 09 02:14:18.943364 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.942966 2564 scope.go:117] "RemoveContainer" containerID="255a1a0d0a173d7f3f5cb0a2ea4389ebc7a14a5a52918c78d2ce35cc429709c0" Jul 09 02:14:18.969842 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.969766 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8"] Jul 09 02:14:18.980961 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:18.980938 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-fc352a-openshift-default-86bc948f95-qjwb8"] Jul 09 02:14:19.645144 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:19.645112 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx_f8469e54-990a-4600-b631-a0fc592bb7ab/extract/0.log" Jul 09 02:14:19.653536 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:19.653508 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx_f8469e54-990a-4600-b631-a0fc592bb7ab/util/0.log" Jul 09 02:14:19.660815 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:19.660793 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx_f8469e54-990a-4600-b631-a0fc592bb7ab/pull/0.log" Jul 09 02:14:19.776373 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:19.776349 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4_140b7dbb-97c9-471b-a39b-2c4e69e4dd32/util/0.log" Jul 09 02:14:19.784031 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:19.784002 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4_140b7dbb-97c9-471b-a39b-2c4e69e4dd32/pull/0.log" Jul 09 02:14:19.791080 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:19.791051 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4_140b7dbb-97c9-471b-a39b-2c4e69e4dd32/extract/0.log" Jul 09 02:14:19.868291 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:19.868264 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd8ddf5d-5d1c-4fa9-b110-b188a4325b40" path="/var/lib/kubelet/pods/fd8ddf5d-5d1c-4fa9-b110-b188a4325b40/volumes" Jul 09 02:14:19.898294 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:19.898202 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg_575c6260-4c0f-4ff2-bee9-318463bec1de/util/0.log" Jul 09 02:14:19.908670 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:19.908647 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg_575c6260-4c0f-4ff2-bee9-318463bec1de/pull/0.log" Jul 09 02:14:19.919095 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:19.919077 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg_575c6260-4c0f-4ff2-bee9-318463bec1de/extract/0.log" Jul 09 02:14:20.033276 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:20.033226 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z_86de2f78-f661-4a76-bff8-978c4452806d/util/0.log" Jul 09 02:14:20.042604 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:20.042577 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z_86de2f78-f661-4a76-bff8-978c4452806d/pull/0.log" Jul 09 02:14:20.050941 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:20.050920 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z_86de2f78-f661-4a76-bff8-978c4452806d/extract/0.log" Jul 09 02:14:20.387882 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:20.387848 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-zjbpv_0df105c3-e1af-4ede-9e93-be3d8159c92e/manager/0.log" Jul 09 02:14:20.618857 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:20.618824 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-v7wjg_30f13302-171c-4940-855c-319e460fe193/registry-server/0.log" Jul 09 02:14:20.742205 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:20.742174 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-67w2l_9aa6b2b2-7eee-4e4a-a695-77428855972a/manager/0.log" Jul 09 02:14:21.013804 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:21.013720 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mddc9_218fed09-3f69-40c9-855e-55402a404371/manager/0.log" Jul 09 02:14:21.482606 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:21.482578 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-ws7j2_ccba7d12-5239-4d85-96c1-d5f54f26e905/discovery/0.log" Jul 09 02:14:21.702735 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:21.702705 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dd66d5ffd-wrrbr_1632a632-f6fa-4719-b641-a855966a7469/kube-auth-proxy/0.log" Jul 09 02:14:22.045979 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:22.045949 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-x2cmx_6b894618-af5b-41bb-9579-74f07f415d93/payload-processing/0.log" Jul 09 02:14:22.160534 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:22.160494 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b7cdbb4c5-nksgs_7f36af6b-773c-49e1-a9ff-efbd797e59f7/router/0.log" Jul 09 02:14:22.604400 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:22.604367 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-fsdcr_886c9df9-8f8a-4881-9fbe-9dde9c2b68d8/main/0.log" Jul 09 02:14:22.829012 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:22.828986 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbb5nwk_76a6069e-f097-4004-b2ad-b34cac31e53b/main/0.log" Jul 09 02:14:30.307021 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:30.306993 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6g7sx_eef45e59-8530-47b9-bdab-917bec4c3c42/global-pull-secret-syncer/0.log" Jul 09 02:14:30.482798 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:30.482758 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-c6ppx_0c28c3d4-f26a-4fb6-906a-32a30f09239e/konnectivity-agent/0.log" Jul 09 02:14:30.575425 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:30.575344 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-181.ec2.internal_bc1262adfd563bb047fb14c67b9868ad/haproxy/0.log" Jul 09 02:14:34.637410 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:34.637323 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx_f8469e54-990a-4600-b631-a0fc592bb7ab/extract/0.log" Jul 09 02:14:34.660693 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:34.660662 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx_f8469e54-990a-4600-b631-a0fc592bb7ab/util/0.log" Jul 09 02:14:34.681207 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:34.681182 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dqpjx_f8469e54-990a-4600-b631-a0fc592bb7ab/pull/0.log" Jul 09 02:14:34.717199 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:34.717162 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4_140b7dbb-97c9-471b-a39b-2c4e69e4dd32/extract/0.log" Jul 09 02:14:34.750088 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:34.750058 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4_140b7dbb-97c9-471b-a39b-2c4e69e4dd32/util/0.log" Jul 09 02:14:34.774438 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:34.774403 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09lfb4_140b7dbb-97c9-471b-a39b-2c4e69e4dd32/pull/0.log" Jul 09 02:14:34.805388 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:34.805360 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg_575c6260-4c0f-4ff2-bee9-318463bec1de/extract/0.log" Jul 09 02:14:34.824751 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:34.824725 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg_575c6260-4c0f-4ff2-bee9-318463bec1de/util/0.log" Jul 09 02:14:34.846564 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:34.846541 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z9rmg_575c6260-4c0f-4ff2-bee9-318463bec1de/pull/0.log" Jul 09 02:14:34.872831 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:34.872808 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z_86de2f78-f661-4a76-bff8-978c4452806d/extract/0.log" Jul 09 02:14:34.895081 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:34.895024 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z_86de2f78-f661-4a76-bff8-978c4452806d/util/0.log" Jul 09 02:14:34.915116 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:34.915097 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rr67z_86de2f78-f661-4a76-bff8-978c4452806d/pull/0.log" Jul 09 02:14:35.337684 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:35.337655 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-zjbpv_0df105c3-e1af-4ede-9e93-be3d8159c92e/manager/0.log" Jul 09 02:14:35.411193 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:35.411155 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-v7wjg_30f13302-171c-4940-855c-319e460fe193/registry-server/0.log" Jul 09 02:14:35.514288 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:35.514255 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-67w2l_9aa6b2b2-7eee-4e4a-a695-77428855972a/manager/0.log" Jul 09 02:14:35.639512 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:35.639430 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mddc9_218fed09-3f69-40c9-855e-55402a404371/manager/0.log" Jul 09 02:14:37.407210 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:37.407174 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-ckzls_9a6b0c11-7b7c-460a-8a34-af1ac8d924a4/cluster-monitoring-operator/0.log" Jul 09 02:14:37.805588 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:37.805560 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pj4pr_7eb4bb6e-d678-4de9-b462-d52551ae0756/node-exporter/0.log" Jul 09 02:14:37.827052 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:37.827008 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pj4pr_7eb4bb6e-d678-4de9-b462-d52551ae0756/kube-rbac-proxy/0.log" Jul 09 02:14:37.850401 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:37.850377 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pj4pr_7eb4bb6e-d678-4de9-b462-d52551ae0756/init-textfile/0.log" Jul 09 02:14:38.196433 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:38.196402 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-pl6sj_991948ab-37ab-4725-85f9-b7f43531d4c3/prometheus-operator-admission-webhook/0.log" Jul 09 02:14:39.638133 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:39.638092 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-smgrj_bbe2870c-05fa-44fd-9172-e556eb36c121/networking-console-plugin/0.log" Jul 09 02:14:40.312113 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:40.312080 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gfhk_3d8307ed-04c9-429e-a83c-7b24847e0a38/console-operator/1.log" Jul 09 02:14:40.319159 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:40.319100 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gfhk_3d8307ed-04c9-429e-a83c-7b24847e0a38/console-operator/2.log" Jul 09 02:14:40.940201 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:40.940170 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-t26wx_e614a865-02c6-4419-b5b0-065bffaa7c8e/download-server/0.log" Jul 09 02:14:41.522359 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:41.522327 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-rxlj9_f827dc20-03eb-481b-98bd-52e34499e298/volume-data-source-validator/0.log" Jul 09 02:14:41.670376 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:41.670346 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-k9hbz/perf-node-gather-daemonset-55tp5"] Jul 09 02:14:41.670849 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:41.670830 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd8ddf5d-5d1c-4fa9-b110-b188a4325b40" containerName="istio-proxy" Jul 09 02:14:41.670849 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:41.670850 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd8ddf5d-5d1c-4fa9-b110-b188a4325b40" containerName="istio-proxy" Jul 09 02:14:41.670968 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:41.670867 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85e9c3e0-5759-45a7-bdf6-939a5a20a4cf" containerName="istio-proxy" Jul 09 02:14:41.670968 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:41.670873 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="85e9c3e0-5759-45a7-bdf6-939a5a20a4cf" containerName="istio-proxy" Jul 09 02:14:41.670968 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:41.670950 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd8ddf5d-5d1c-4fa9-b110-b188a4325b40" containerName="istio-proxy" Jul 09 02:14:41.670968 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:41.670957 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd8ddf5d-5d1c-4fa9-b110-b188a4325b40" containerName="istio-proxy" Jul 09 02:14:41.674197 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:41.674181 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-55tp5" Jul 09 02:14:41.676279 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:41.676262 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k9hbz\"/\"openshift-service-ca.crt\"" Jul 09 02:14:41.676379 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:41.676288 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-k9hbz\"/\"default-dockercfg-txlpg\"" Jul 09 02:14:41.676379 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:41.676268 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k9hbz\"/\"kube-root-ca.crt\"" Jul 09 02:14:41.685705 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:41.685684 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k9hbz/perf-node-gather-daemonset-55tp5"] Jul 09 02:14:41.736142 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:41.736112 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3458f674-e755-4feb-b30a-627e640ee52e-proc\") pod \"perf-node-gather-daemonset-55tp5\" (UID: \"3458f674-e755-4feb-b30a-627e640ee52e\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-55tp5" Jul 09 02:14:41.736341 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:41.736158 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3458f674-e755-4feb-b30a-627e640ee52e-lib-modules\") pod \"perf-node-gather-daemonset-55tp5\" (UID: \"3458f674-e755-4feb-b30a-627e640ee52e\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-55tp5" Jul 09 02:14:41.736341 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:41.736271 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3458f674-e755-4feb-b30a-627e640ee52e-sys\") pod \"perf-node-gather-daemonset-55tp5\" (UID: \"3458f674-e755-4feb-b30a-627e640ee52e\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-55tp5" Jul 09 02:14:41.736341 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:41.736297 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3458f674-e755-4feb-b30a-627e640ee52e-podres\") pod \"perf-node-gather-daemonset-55tp5\" (UID: \"3458f674-e755-4feb-b30a-627e640ee52e\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-55tp5" Jul 09 02:14:41.736341 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:41.736314 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kltt\" (UniqueName: \"kubernetes.io/projected/3458f674-e755-4feb-b30a-627e640ee52e-kube-api-access-6kltt\") pod \"perf-node-gather-daemonset-55tp5\" (UID: \"3458f674-e755-4feb-b30a-627e640ee52e\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-55tp5" Jul 09 02:14:41.836781 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:41.836694 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3458f674-e755-4feb-b30a-627e640ee52e-proc\") pod \"perf-node-gather-daemonset-55tp5\" (UID: \"3458f674-e755-4feb-b30a-627e640ee52e\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-55tp5" Jul 09 02:14:41.836781 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:41.836735 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3458f674-e755-4feb-b30a-627e640ee52e-lib-modules\") pod \"perf-node-gather-daemonset-55tp5\" (UID: \"3458f674-e755-4feb-b30a-627e640ee52e\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-55tp5" Jul 09 02:14:41.836781 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:41.836772 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3458f674-e755-4feb-b30a-627e640ee52e-sys\") pod \"perf-node-gather-daemonset-55tp5\" (UID: \"3458f674-e755-4feb-b30a-627e640ee52e\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-55tp5" Jul 09 02:14:41.837036 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:41.836794 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3458f674-e755-4feb-b30a-627e640ee52e-podres\") pod \"perf-node-gather-daemonset-55tp5\" (UID: \"3458f674-e755-4feb-b30a-627e640ee52e\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-55tp5" Jul 09 02:14:41.837036 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:41.836815 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3458f674-e755-4feb-b30a-627e640ee52e-proc\") pod \"perf-node-gather-daemonset-55tp5\" (UID: \"3458f674-e755-4feb-b30a-627e640ee52e\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-55tp5" Jul 09 02:14:41.837036 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:41.836854 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kltt\" (UniqueName: \"kubernetes.io/projected/3458f674-e755-4feb-b30a-627e640ee52e-kube-api-access-6kltt\") pod \"perf-node-gather-daemonset-55tp5\" (UID: \"3458f674-e755-4feb-b30a-627e640ee52e\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-55tp5" Jul 09 02:14:41.837036 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:41.836865 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3458f674-e755-4feb-b30a-627e640ee52e-sys\") pod \"perf-node-gather-daemonset-55tp5\" (UID: \"3458f674-e755-4feb-b30a-627e640ee52e\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-55tp5" Jul 09 02:14:41.837036 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:41.836892 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3458f674-e755-4feb-b30a-627e640ee52e-podres\") pod \"perf-node-gather-daemonset-55tp5\" (UID: \"3458f674-e755-4feb-b30a-627e640ee52e\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-55tp5" Jul 09 02:14:41.837036 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:41.836895 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3458f674-e755-4feb-b30a-627e640ee52e-lib-modules\") pod \"perf-node-gather-daemonset-55tp5\" (UID: \"3458f674-e755-4feb-b30a-627e640ee52e\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-55tp5" Jul 09 02:14:41.845019 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:41.844991 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kltt\" (UniqueName: \"kubernetes.io/projected/3458f674-e755-4feb-b30a-627e640ee52e-kube-api-access-6kltt\") pod \"perf-node-gather-daemonset-55tp5\" (UID: \"3458f674-e755-4feb-b30a-627e640ee52e\") " pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-55tp5" Jul 09 02:14:41.986560 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:41.986529 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-55tp5" Jul 09 02:14:42.119624 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:42.119600 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k9hbz/perf-node-gather-daemonset-55tp5"] Jul 09 02:14:42.124612 ip-10-0-131-181 kubenswrapper[2564]: W0709 02:14:42.124581 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3458f674_e755_4feb_b30a_627e640ee52e.slice/crio-87fe43839642350bc0566cb6e55831d5678781797ae41c8c77e0c28845304491 WatchSource:0}: Error finding container 87fe43839642350bc0566cb6e55831d5678781797ae41c8c77e0c28845304491: Status 404 returned error can't find the container with id 87fe43839642350bc0566cb6e55831d5678781797ae41c8c77e0c28845304491 Jul 09 02:14:42.656321 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:42.656288 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fzl7v_e36c83c0-d80b-4f03-957e-f8fa2186bc55/dns/0.log" Jul 09 02:14:42.676107 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:42.676079 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fzl7v_e36c83c0-d80b-4f03-957e-f8fa2186bc55/kube-rbac-proxy/0.log" Jul 09 02:14:42.799609 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:42.799582 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wwf2c_2a07af9d-8807-44f2-9185-2a4f5f57e0e3/dns-node-resolver/0.log" Jul 09 02:14:43.086979 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:43.086942 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-55tp5" event={"ID":"3458f674-e755-4feb-b30a-627e640ee52e","Type":"ContainerStarted","Data":"685f058bfa3c45733c9314fb554d6e55534b2b563fa040a63a38bf9a6c369d14"} Jul 09 02:14:43.087481 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:43.086995 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-55tp5" event={"ID":"3458f674-e755-4feb-b30a-627e640ee52e","Type":"ContainerStarted","Data":"87fe43839642350bc0566cb6e55831d5678781797ae41c8c77e0c28845304491"} Jul 09 02:14:43.087481 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:43.087107 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-55tp5" Jul 09 02:14:43.102188 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:43.102063 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-55tp5" podStartSLOduration=2.102043888 podStartE2EDuration="2.102043888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 02:14:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:14:43.101455994 +0000 UTC m=+2215.763193487" watchObservedRunningTime="2026-07-09 02:14:43.102043888 +0000 UTC m=+2215.763781382" Jul 09 02:14:43.371222 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:43.371128 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zj4qk_872d30ee-57a3-4820-b761-38485e5bfcc0/node-ca/0.log" Jul 09 02:14:44.522375 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:44.522343 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-ws7j2_ccba7d12-5239-4d85-96c1-d5f54f26e905/discovery/0.log" Jul 09 02:14:44.571453 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:44.571424 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dd66d5ffd-wrrbr_1632a632-f6fa-4719-b641-a855966a7469/kube-auth-proxy/0.log" Jul 09 02:14:44.754119 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:44.754083 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-x2cmx_6b894618-af5b-41bb-9579-74f07f415d93/payload-processing/0.log" Jul 09 02:14:44.777505 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:44.777414 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b7cdbb4c5-nksgs_7f36af6b-773c-49e1-a9ff-efbd797e59f7/router/0.log" Jul 09 02:14:45.526784 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:45.526752 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qpvvm_440a2154-c6ac-4974-86c3-e61735bfe17b/serve-healthcheck-canary/0.log" Jul 09 02:14:45.991008 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:45.990976 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-h8pb8_18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662/insights-operator/0.log" Jul 09 02:14:45.993909 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:45.993884 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-h8pb8_18cdf55a-4f6c-4cbf-92c3-59b7e8fa5662/insights-operator/1.log" Jul 09 02:14:46.085281 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:46.085252 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mr7jk_abfdb912-0143-469c-87e1-53fed7b4c2fd/kube-rbac-proxy/0.log" Jul 09 02:14:46.105246 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:46.105211 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mr7jk_abfdb912-0143-469c-87e1-53fed7b4c2fd/exporter/0.log" Jul 09 02:14:46.128581 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:46.128550 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mr7jk_abfdb912-0143-469c-87e1-53fed7b4c2fd/extractor/0.log" Jul 09 02:14:48.795737 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:48.795700 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5b8f9fb5db-fwwdd_9f833809-c857-4b56-8374-6c21e6ef9073/manager/0.log" Jul 09 02:14:48.817355 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:48.817331 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-j9dlv_534db92b-5570-45b7-bccc-bc63df445251/server/0.log" Jul 09 02:14:48.914675 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:48.914634 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-gj4kh_1dbf02f3-3602-4c1a-8e62-e053e932d9fa/manager/0.log" Jul 09 02:14:49.081052 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:49.080948 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b4b98c894-rknhq_b25ab30a-6059-4bf4-b812-add6a4ab09ec/manager/0.log" Jul 09 02:14:49.098081 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:49.098061 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b4b98c894-rknhq_b25ab30a-6059-4bf4-b812-add6a4ab09ec/copy-manifests/0.log" Jul 09 02:14:49.103063 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:49.103043 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-k9hbz/perf-node-gather-daemonset-55tp5" Jul 09 02:14:50.388957 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:50.388927 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-lkpdk_d94005a1-4364-49b3-8380-72bc96206ada/openshift-lws-operator/0.log" Jul 09 02:14:50.414008 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:50.413982 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-ws7j2_ccba7d12-5239-4d85-96c1-d5f54f26e905/discovery/0.log" Jul 09 02:14:50.443219 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:50.443184 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dd66d5ffd-wrrbr_1632a632-f6fa-4719-b641-a855966a7469/kube-auth-proxy/0.log" Jul 09 02:14:50.599589 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:50.599502 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-x2cmx_6b894618-af5b-41bb-9579-74f07f415d93/payload-processing/0.log" Jul 09 02:14:50.612703 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:50.612680 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b7cdbb4c5-nksgs_7f36af6b-773c-49e1-a9ff-efbd797e59f7/router/0.log" Jul 09 02:14:52.134510 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:52.134419 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-ws7j2_ccba7d12-5239-4d85-96c1-d5f54f26e905/discovery/0.log" Jul 09 02:14:52.165896 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:52.165869 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dd66d5ffd-wrrbr_1632a632-f6fa-4719-b641-a855966a7469/kube-auth-proxy/0.log" Jul 09 02:14:52.316111 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:52.316074 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-x2cmx_6b894618-af5b-41bb-9579-74f07f415d93/payload-processing/0.log" Jul 09 02:14:52.332904 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:52.332868 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b7cdbb4c5-nksgs_7f36af6b-773c-49e1-a9ff-efbd797e59f7/router/0.log" Jul 09 02:14:55.913320 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:55.913292 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-9z9g5_fa5bc969-c6e4-4e77-a7e5-268e982bc0b4/kube-storage-version-migrator-operator/1.log" Jul 09 02:14:55.915018 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:55.914995 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-9z9g5_fa5bc969-c6e4-4e77-a7e5-268e982bc0b4/kube-storage-version-migrator-operator/0.log" Jul 09 02:14:57.052889 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:57.052861 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6c85z_96cec375-64d5-4eca-b8dd-fbcd6203396f/kube-multus/0.log" Jul 09 02:14:57.266128 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:57.266055 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fkgtm_3289febf-366d-4f6b-857c-be94e8771fba/kube-multus-additional-cni-plugins/0.log" Jul 09 02:14:57.287206 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:57.287181 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fkgtm_3289febf-366d-4f6b-857c-be94e8771fba/egress-router-binary-copy/0.log" Jul 09 02:14:57.315268 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:57.315221 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fkgtm_3289febf-366d-4f6b-857c-be94e8771fba/cni-plugins/0.log" Jul 09 02:14:57.334987 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:57.334957 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fkgtm_3289febf-366d-4f6b-857c-be94e8771fba/bond-cni-plugin/0.log" Jul 09 02:14:57.355602 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:57.355576 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fkgtm_3289febf-366d-4f6b-857c-be94e8771fba/routeoverride-cni/0.log" Jul 09 02:14:57.376573 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:57.376544 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fkgtm_3289febf-366d-4f6b-857c-be94e8771fba/whereabouts-cni-bincopy/0.log" Jul 09 02:14:57.396110 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:57.396084 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fkgtm_3289febf-366d-4f6b-857c-be94e8771fba/whereabouts-cni/0.log" Jul 09 02:14:57.635320 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:57.635227 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b2d6x_d06ec329-9c7d-418a-b019-385ecf29cc79/network-metrics-daemon/0.log" Jul 09 02:14:57.699224 ip-10-0-131-181 kubenswrapper[2564]: I0709 02:14:57.699199 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b2d6x_d06ec329-9c7d-418a-b019-385ecf29cc79/kube-rbac-proxy/0.log"