Jul 07 17:34:27.993497 ip-10-0-131-96 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 07 17:34:27.993513 ip-10-0-131-96 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 07 17:34:27.993522 ip-10-0-131-96 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 07 17:34:27.993852 ip-10-0-131-96 systemd[1]: Failed to start Kubernetes Kubelet. Jul 07 17:34:38.239355 ip-10-0-131-96 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 07 17:34:38.239370 ip-10-0-131-96 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 001c62317ab346ed848fb0218c3f1ad1 -- Jul 07 17:36:39.307543 ip-10-0-131-96 systemd[1]: Starting Kubernetes Kubelet... Jul 07 17:36:39.672225 ip-10-0-131-96 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 17:36:39.672225 ip-10-0-131-96 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 17:36:39.672225 ip-10-0-131-96 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 17:36:39.672225 ip-10-0-131-96 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 17:36:39.672225 ip-10-0-131-96 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 17:36:39.673110 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.672971 2552 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 17:36:39.679018 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679000 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 17:36:39.679018 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679014 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 17:36:39.679018 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679018 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 17:36:39.679018 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679021 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 17:36:39.679141 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679024 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 17:36:39.679141 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679027 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 17:36:39.679141 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679030 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 17:36:39.679141 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679033 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 17:36:39.679141 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679035 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 17:36:39.679141 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679043 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 17:36:39.679141 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679046 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 17:36:39.679141 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679049 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 17:36:39.679141 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679051 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 17:36:39.679141 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679055 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 17:36:39.679141 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679058 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 17:36:39.679141 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679061 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 17:36:39.679141 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679063 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 17:36:39.679141 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679066 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 17:36:39.679141 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679069 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 17:36:39.679141 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679072 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 17:36:39.679141 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679074 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 17:36:39.679141 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679077 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 17:36:39.679141 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679080 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 17:36:39.679141 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679083 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 17:36:39.679627 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679086 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 17:36:39.679627 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679089 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 17:36:39.679627 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679091 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 17:36:39.679627 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679094 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 17:36:39.679627 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679096 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 17:36:39.679627 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679098 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 17:36:39.679627 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679101 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 17:36:39.679627 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679103 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 17:36:39.679627 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679106 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 17:36:39.679627 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679108 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 17:36:39.679627 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679110 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 17:36:39.679627 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679113 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 17:36:39.679627 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679115 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 17:36:39.679627 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679118 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 17:36:39.679627 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679121 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 17:36:39.679627 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679124 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 17:36:39.679627 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679128 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 17:36:39.679627 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679132 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 17:36:39.679627 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679135 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 17:36:39.680058 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679137 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 17:36:39.680058 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679140 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 17:36:39.680058 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679142 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 17:36:39.680058 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679145 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 17:36:39.680058 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679147 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 17:36:39.680058 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679150 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 17:36:39.680058 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679153 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 17:36:39.680058 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679155 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 17:36:39.680058 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679158 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 17:36:39.680058 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679160 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 17:36:39.680058 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679163 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 17:36:39.680058 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679165 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 17:36:39.680058 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679168 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 17:36:39.680058 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679170 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 17:36:39.680058 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679173 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 17:36:39.680058 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679176 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 17:36:39.680058 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679178 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 17:36:39.680058 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679181 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 17:36:39.680058 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679183 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 17:36:39.680058 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679185 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 17:36:39.680558 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679188 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 17:36:39.680558 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679190 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 17:36:39.680558 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679193 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 17:36:39.680558 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679197 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 17:36:39.680558 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679200 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 17:36:39.680558 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679204 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 17:36:39.680558 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679208 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 17:36:39.680558 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679211 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 17:36:39.680558 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679214 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 17:36:39.680558 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679217 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 17:36:39.680558 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679219 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 17:36:39.680558 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679222 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 17:36:39.680558 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679224 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 17:36:39.680558 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679226 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 17:36:39.680558 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679229 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 17:36:39.680558 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679231 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 17:36:39.680558 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679234 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 07 17:36:39.680558 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679237 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 17:36:39.680558 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679239 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 17:36:39.680558 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679242 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 17:36:39.681048 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679244 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 17:36:39.681048 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679247 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 17:36:39.681048 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679249 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 17:36:39.681048 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679252 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 17:36:39.681048 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679255 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 17:36:39.681048 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679258 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 17:36:39.681048 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679262 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 17:36:39.681048 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679265 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 17:36:39.681048 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679268 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 17:36:39.681048 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679271 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 17:36:39.681048 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679273 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 17:36:39.681048 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679276 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 17:36:39.681048 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679279 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 17:36:39.681048 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679281 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 17:36:39.681048 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679284 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 17:36:39.681048 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679286 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 17:36:39.681048 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679985 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 17:36:39.681048 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679991 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 17:36:39.681048 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679995 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 17:36:39.681048 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.679998 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 17:36:39.681555 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680000 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 17:36:39.681555 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680004 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 17:36:39.681555 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680007 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 17:36:39.681555 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680009 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 17:36:39.681555 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680012 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 17:36:39.681555 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680014 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 17:36:39.681555 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680017 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 17:36:39.681555 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680019 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 17:36:39.681555 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680022 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 17:36:39.681555 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680024 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 17:36:39.681555 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680027 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 17:36:39.681555 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680029 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 17:36:39.681555 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680031 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 17:36:39.681555 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680034 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 17:36:39.681555 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680037 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 17:36:39.681555 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680040 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 17:36:39.681555 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680042 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 17:36:39.681555 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680046 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 17:36:39.681555 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680049 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 17:36:39.681995 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680051 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 17:36:39.681995 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680054 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 17:36:39.681995 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680057 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 17:36:39.681995 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680059 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 17:36:39.681995 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680062 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 17:36:39.681995 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680064 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 17:36:39.681995 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680067 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 17:36:39.681995 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680069 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 17:36:39.681995 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680072 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 17:36:39.681995 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680075 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 17:36:39.681995 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680077 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 17:36:39.681995 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680080 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 17:36:39.681995 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680082 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 17:36:39.681995 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680085 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 17:36:39.681995 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680088 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 17:36:39.681995 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680091 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 17:36:39.681995 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680093 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 17:36:39.681995 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680097 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 17:36:39.681995 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680099 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 17:36:39.681995 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680102 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 17:36:39.682501 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680104 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 17:36:39.682501 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680107 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 17:36:39.682501 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680109 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 17:36:39.682501 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680112 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 17:36:39.682501 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680114 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 17:36:39.682501 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680116 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 17:36:39.682501 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680119 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 07 17:36:39.682501 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680121 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 17:36:39.682501 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680125 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 17:36:39.682501 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680129 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 17:36:39.682501 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680132 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 17:36:39.682501 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680135 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 17:36:39.682501 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680138 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 17:36:39.682501 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680141 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 17:36:39.682501 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680144 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 17:36:39.682501 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680147 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 17:36:39.682501 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680149 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 17:36:39.682501 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680151 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 17:36:39.682501 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680154 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 17:36:39.682501 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680156 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 17:36:39.682967 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680159 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 17:36:39.682967 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680161 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 17:36:39.682967 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680164 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 17:36:39.682967 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680167 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 17:36:39.682967 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680169 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 17:36:39.682967 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680173 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 17:36:39.682967 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680175 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 17:36:39.682967 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680178 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 17:36:39.682967 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680180 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 17:36:39.682967 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680183 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 17:36:39.682967 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680185 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 17:36:39.682967 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680188 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 17:36:39.682967 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680190 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 17:36:39.682967 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680194 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 17:36:39.682967 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680197 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 17:36:39.682967 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680200 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 17:36:39.682967 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680202 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 17:36:39.682967 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680205 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 17:36:39.682967 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680207 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 17:36:39.683439 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680210 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 17:36:39.683439 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680213 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 17:36:39.683439 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680215 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 17:36:39.683439 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680218 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 17:36:39.683439 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680221 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 17:36:39.683439 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680224 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 17:36:39.683439 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680226 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 17:36:39.683439 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680229 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 17:36:39.683439 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680231 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 17:36:39.683439 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680233 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 17:36:39.683439 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680236 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 17:36:39.683439 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680239 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 17:36:39.683439 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680241 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 17:36:39.683439 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680244 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 17:36:39.683439 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680246 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 17:36:39.683439 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680249 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 17:36:39.683439 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680251 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 17:36:39.683439 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680614 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 17:36:39.683439 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680619 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 17:36:39.683439 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680621 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 17:36:39.683897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680624 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 17:36:39.683897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680627 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 17:36:39.683897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680630 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 17:36:39.683897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680633 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 17:36:39.683897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680635 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 07 17:36:39.683897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680638 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 17:36:39.683897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680640 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 17:36:39.683897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680643 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 17:36:39.683897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680645 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 17:36:39.683897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680648 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 17:36:39.683897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680650 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 17:36:39.683897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680652 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 17:36:39.683897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680655 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 17:36:39.683897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680657 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 17:36:39.683897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680659 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 17:36:39.683897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680662 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 17:36:39.683897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680665 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 17:36:39.683897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680667 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 17:36:39.683897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680670 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 17:36:39.683897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680673 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 17:36:39.684368 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680675 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 17:36:39.684368 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680678 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 17:36:39.684368 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680680 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 17:36:39.684368 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680683 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 17:36:39.684368 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680688 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 17:36:39.684368 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680690 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 17:36:39.684368 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680693 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 17:36:39.684368 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680696 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 17:36:39.684368 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680698 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 17:36:39.684368 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680700 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 17:36:39.684368 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680703 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 17:36:39.684368 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680705 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 17:36:39.684368 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680708 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 17:36:39.684368 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680710 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 17:36:39.684368 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680719 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 17:36:39.684368 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680721 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 17:36:39.684368 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680724 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 17:36:39.684368 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680726 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 17:36:39.684368 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680731 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 17:36:39.684368 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680734 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 17:36:39.684840 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680738 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 17:36:39.684840 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680741 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 17:36:39.684840 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680743 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 17:36:39.684840 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680746 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 17:36:39.684840 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680749 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 17:36:39.684840 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680752 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 17:36:39.684840 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680754 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 17:36:39.684840 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680757 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 17:36:39.684840 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680759 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 17:36:39.684840 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680762 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 17:36:39.684840 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680764 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 17:36:39.684840 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680767 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 17:36:39.684840 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680769 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 17:36:39.684840 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680772 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 17:36:39.684840 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680774 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 17:36:39.684840 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680777 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 17:36:39.684840 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680780 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 17:36:39.684840 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680783 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 17:36:39.684840 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680785 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 17:36:39.684840 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680787 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 17:36:39.685322 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680790 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 17:36:39.685322 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680792 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 17:36:39.685322 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680794 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 17:36:39.685322 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680797 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 17:36:39.685322 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680800 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 17:36:39.685322 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680802 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 17:36:39.685322 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680805 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 17:36:39.685322 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680812 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 17:36:39.685322 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680815 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 17:36:39.685322 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680818 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 17:36:39.685322 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680820 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 17:36:39.685322 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680823 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 17:36:39.685322 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680829 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 17:36:39.685322 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680832 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 17:36:39.685322 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680835 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 17:36:39.685322 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680838 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 17:36:39.685322 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680840 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 17:36:39.685322 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680844 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 17:36:39.685322 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680846 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 17:36:39.685854 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680849 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 17:36:39.685854 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680852 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 17:36:39.685854 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680854 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 17:36:39.685854 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680857 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 17:36:39.685854 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680861 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 17:36:39.685854 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680864 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 17:36:39.685854 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680867 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 17:36:39.685854 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680870 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 17:36:39.685854 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680873 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 17:36:39.685854 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680878 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 17:36:39.685854 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680880 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 17:36:39.685854 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680890 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 17:36:39.685854 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680893 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 17:36:39.685854 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680896 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 17:36:39.685854 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680898 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 17:36:39.685854 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680901 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 17:36:39.685854 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.680904 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 17:36:39.685854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.680975 2552 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 17:36:39.685854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.680982 2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 17:36:39.685854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.680988 2552 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 17:36:39.686331 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.680992 2552 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 17:36:39.686331 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.680996 2552 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 17:36:39.686331 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.680999 2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 17:36:39.686331 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681003 2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 17:36:39.686331 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681007 2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 17:36:39.686331 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681012 2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 17:36:39.686331 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681015 2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 17:36:39.686331 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681018 2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 17:36:39.686331 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681021 2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 17:36:39.686331 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681024 2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 17:36:39.686331 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681027 2552 flags.go:64] FLAG: --cgroup-root="" Jul 07 17:36:39.686331 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681029 2552 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 17:36:39.686331 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681032 2552 flags.go:64] FLAG: --client-ca-file="" Jul 07 17:36:39.686331 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681035 2552 flags.go:64] FLAG: --cloud-provider="external" Jul 07 17:36:39.686331 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681037 2552 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 17:36:39.686331 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681041 2552 flags.go:64] FLAG: --cluster-domain="" Jul 07 17:36:39.686331 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681043 2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 17:36:39.686331 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681046 2552 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 17:36:39.686331 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681049 2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 17:36:39.686331 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681053 2552 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 17:36:39.686331 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681056 2552 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 17:36:39.686331 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681060 2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 17:36:39.686331 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681063 2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 17:36:39.686854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681066 2552 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 17:36:39.686854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681069 2552 flags.go:64] FLAG: --contention-profiling="false" Jul 07 17:36:39.686854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681072 2552 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 17:36:39.686854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681075 2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 17:36:39.686854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681078 2552 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 17:36:39.686854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681081 2552 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 17:36:39.686854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681089 2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 17:36:39.686854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681092 2552 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 17:36:39.686854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681094 2552 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 17:36:39.686854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681097 2552 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 17:36:39.686854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681100 2552 flags.go:64] FLAG: --enable-server="true" Jul 07 17:36:39.686854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681103 2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 17:36:39.686854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681107 2552 flags.go:64] FLAG: --event-burst="100" Jul 07 17:36:39.686854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681110 2552 flags.go:64] FLAG: --event-qps="50" Jul 07 17:36:39.686854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681114 2552 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 17:36:39.686854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681117 2552 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 17:36:39.686854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681120 2552 flags.go:64] FLAG: --eviction-hard="" Jul 07 17:36:39.686854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681123 2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 17:36:39.686854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681126 2552 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 17:36:39.686854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681129 2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 17:36:39.686854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681132 2552 flags.go:64] FLAG: --eviction-soft="" Jul 07 17:36:39.686854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681135 2552 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 17:36:39.686854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681137 2552 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 17:36:39.686854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681140 2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 17:36:39.686854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681143 2552 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 17:36:39.687511 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681146 2552 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 17:36:39.687511 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681149 2552 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 17:36:39.687511 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681151 2552 flags.go:64] FLAG: --feature-gates="" Jul 07 17:36:39.687511 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681155 2552 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 17:36:39.687511 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681157 2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 17:36:39.687511 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681161 2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 17:36:39.687511 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681164 2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 17:36:39.687511 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681167 2552 flags.go:64] FLAG: --healthz-port="10248" Jul 07 17:36:39.687511 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681170 2552 flags.go:64] FLAG: --help="false" Jul 07 17:36:39.687511 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681172 2552 flags.go:64] FLAG: --hostname-override="ip-10-0-131-96.ec2.internal" Jul 07 17:36:39.687511 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681175 2552 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 17:36:39.687511 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681178 2552 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 17:36:39.687511 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681181 2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 17:36:39.687511 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681184 2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 17:36:39.687511 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681187 2552 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 17:36:39.687511 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681190 2552 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 17:36:39.687511 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681192 2552 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 17:36:39.687511 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681195 2552 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 17:36:39.687511 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681198 2552 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 17:36:39.687511 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681201 2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 17:36:39.687511 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681204 2552 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 17:36:39.687511 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681207 2552 flags.go:64] FLAG: --kube-reserved="" Jul 07 17:36:39.687511 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681210 2552 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 17:36:39.687511 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681213 2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 17:36:39.688076 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681216 2552 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 17:36:39.688076 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681218 2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 17:36:39.688076 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681221 2552 flags.go:64] FLAG: --lock-file="" Jul 07 17:36:39.688076 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681224 2552 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 17:36:39.688076 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681227 2552 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 17:36:39.688076 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681229 2552 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 17:36:39.688076 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681234 2552 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 17:36:39.688076 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681237 2552 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 17:36:39.688076 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681240 2552 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 17:36:39.688076 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681242 2552 flags.go:64] FLAG: --logging-format="text" Jul 07 17:36:39.688076 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681245 2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 17:36:39.688076 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681248 2552 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 17:36:39.688076 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681251 2552 flags.go:64] FLAG: --manifest-url="" Jul 07 17:36:39.688076 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681254 2552 flags.go:64] FLAG: --manifest-url-header="" Jul 07 17:36:39.688076 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681258 2552 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 17:36:39.688076 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681261 2552 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 17:36:39.688076 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681265 2552 flags.go:64] FLAG: --max-pods="110" Jul 07 17:36:39.688076 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681267 2552 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 17:36:39.688076 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681270 2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 17:36:39.688076 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681273 2552 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 17:36:39.688076 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681276 2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 17:36:39.688076 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681279 2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 17:36:39.688076 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681281 2552 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 17:36:39.688076 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681284 2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 17:36:39.688076 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681290 2552 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 17:36:39.688676 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681293 2552 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 17:36:39.688676 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681309 2552 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 17:36:39.688676 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681312 2552 flags.go:64] FLAG: --pod-cidr="" Jul 07 17:36:39.688676 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681315 2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 17:36:39.688676 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681320 2552 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 17:36:39.688676 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681323 2552 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 17:36:39.688676 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681326 2552 flags.go:64] FLAG: --pods-per-core="0" Jul 07 17:36:39.688676 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681329 2552 flags.go:64] FLAG: --port="10250" Jul 07 17:36:39.688676 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681331 2552 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 17:36:39.688676 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681334 2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07591bccbf1fcb442" Jul 07 17:36:39.688676 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681337 2552 flags.go:64] FLAG: --qos-reserved="" Jul 07 17:36:39.688676 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681340 2552 flags.go:64] FLAG: --read-only-port="10255" Jul 07 17:36:39.688676 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681343 2552 flags.go:64] FLAG: --register-node="true" Jul 07 17:36:39.688676 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681345 2552 flags.go:64] FLAG: --register-with-taints="" Jul 07 17:36:39.688676 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681349 2552 flags.go:64] FLAG: --registry-burst="10" Jul 07 17:36:39.688676 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681351 2552 flags.go:64] FLAG: --registry-qps="5" Jul 07 17:36:39.688676 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681354 2552 flags.go:64] FLAG: --reserved-cpus="" Jul 07 17:36:39.688676 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681357 2552 flags.go:64] FLAG: --reserved-memory="" Jul 07 17:36:39.688676 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681360 2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 17:36:39.688676 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681363 2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 17:36:39.688676 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681366 2552 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 17:36:39.688676 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681369 2552 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 17:36:39.688676 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681372 2552 flags.go:64] FLAG: --runonce="false" Jul 07 17:36:39.688676 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681374 2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 17:36:39.688676 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681377 2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 17:36:39.689280 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681380 2552 flags.go:64] FLAG: --seccomp-default="false" Jul 07 17:36:39.689280 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681382 2552 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 17:36:39.689280 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681385 2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 17:36:39.689280 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681388 2552 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 17:36:39.689280 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681391 2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 17:36:39.689280 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681393 2552 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 17:36:39.689280 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681396 2552 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 17:36:39.689280 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681399 2552 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 17:36:39.689280 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681401 2552 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 17:36:39.689280 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681404 2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 17:36:39.689280 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681407 2552 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 17:36:39.689280 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681416 2552 flags.go:64] FLAG: --system-cgroups="" Jul 07 17:36:39.689280 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681419 2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 17:36:39.689280 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681424 2552 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 17:36:39.689280 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681427 2552 flags.go:64] FLAG: --tls-cert-file="" Jul 07 17:36:39.689280 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681429 2552 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 17:36:39.689280 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681433 2552 flags.go:64] FLAG: --tls-min-version="" Jul 07 17:36:39.689280 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681435 2552 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 17:36:39.689280 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681438 2552 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 17:36:39.689280 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681440 2552 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 17:36:39.689280 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681443 2552 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 17:36:39.689280 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681446 2552 flags.go:64] FLAG: --v="2" Jul 07 17:36:39.689280 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681449 2552 flags.go:64] FLAG: --version="false" Jul 07 17:36:39.689280 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681453 2552 flags.go:64] FLAG: --vmodule="" Jul 07 17:36:39.689280 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681456 2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 17:36:39.689865 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681459 2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 17:36:39.689865 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681567 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 17:36:39.689865 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681573 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 17:36:39.689865 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681576 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 17:36:39.689865 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681578 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 17:36:39.689865 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681581 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 17:36:39.689865 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681583 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 17:36:39.689865 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681586 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 17:36:39.689865 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681590 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 17:36:39.689865 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681593 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 17:36:39.689865 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681596 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 17:36:39.689865 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681598 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 17:36:39.689865 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681601 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 17:36:39.689865 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681603 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 17:36:39.689865 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681606 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 17:36:39.689865 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681608 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 17:36:39.689865 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681611 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 17:36:39.689865 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681613 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 17:36:39.689865 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681615 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 17:36:39.690483 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681618 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 17:36:39.690483 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681621 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 17:36:39.690483 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681623 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 17:36:39.690483 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681625 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 17:36:39.690483 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681628 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 17:36:39.690483 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681630 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 17:36:39.690483 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681632 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 17:36:39.690483 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681635 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 17:36:39.690483 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681637 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 17:36:39.690483 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681640 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 17:36:39.690483 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681642 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 17:36:39.690483 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681645 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 17:36:39.690483 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681647 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 17:36:39.690483 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681650 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 17:36:39.690483 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681652 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 17:36:39.690483 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681656 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 17:36:39.690483 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681659 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 17:36:39.690483 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681662 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 17:36:39.690483 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681664 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 17:36:39.690483 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681667 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 17:36:39.691163 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681670 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 17:36:39.691163 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681672 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 17:36:39.691163 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681675 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 17:36:39.691163 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681677 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 17:36:39.691163 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681680 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 17:36:39.691163 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681682 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 17:36:39.691163 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681685 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 17:36:39.691163 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681687 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 17:36:39.691163 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681691 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 17:36:39.691163 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681695 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 17:36:39.691163 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681698 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 17:36:39.691163 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681701 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 17:36:39.691163 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681703 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 17:36:39.691163 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681712 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 17:36:39.691163 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681714 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 17:36:39.691163 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681717 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 17:36:39.691163 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681720 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 17:36:39.691163 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681722 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 07 17:36:39.691163 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681725 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 17:36:39.691623 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681727 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 17:36:39.691623 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681729 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 17:36:39.691623 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681732 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 17:36:39.691623 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681734 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 17:36:39.691623 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681737 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 17:36:39.691623 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681739 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 17:36:39.691623 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681741 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 17:36:39.691623 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681744 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 17:36:39.691623 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681749 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 17:36:39.691623 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681753 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 17:36:39.691623 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681755 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 17:36:39.691623 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681757 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 17:36:39.691623 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681760 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 17:36:39.691623 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681763 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 17:36:39.691623 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681765 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 17:36:39.691623 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681767 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 17:36:39.691623 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681770 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 17:36:39.691623 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681772 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 17:36:39.691623 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681776 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 17:36:39.691623 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681779 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 17:36:39.692086 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681781 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 17:36:39.692086 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681784 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 17:36:39.692086 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681787 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 17:36:39.692086 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681790 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 17:36:39.692086 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681793 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 17:36:39.692086 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681796 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 17:36:39.692086 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681799 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 17:36:39.692086 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681807 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 17:36:39.692086 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681810 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 17:36:39.692086 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681812 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 17:36:39.692086 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681815 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 17:36:39.692086 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681817 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 17:36:39.692086 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681819 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 17:36:39.692086 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681822 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 17:36:39.692086 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681824 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 17:36:39.692086 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681827 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 17:36:39.692086 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681829 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 17:36:39.692086 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681832 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 17:36:39.692086 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681834 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 17:36:39.692086 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681837 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 17:36:39.692567 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681841 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 17:36:39.692567 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.681844 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 17:36:39.692567 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.681850 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 17:36:39.692567 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.688497 2552 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 17:36:39.692567 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.688512 2552 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 17:36:39.692567 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.689271 2552 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 17:36:39.692567 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.689281 2552 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 17:36:39.692567 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689349 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 17:36:39.692567 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689355 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 17:36:39.692567 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689359 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 17:36:39.692567 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689363 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 17:36:39.692567 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689366 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 17:36:39.692567 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689369 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 17:36:39.692567 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689372 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 17:36:39.692567 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689375 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 17:36:39.692920 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689377 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 17:36:39.692920 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689380 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 17:36:39.692920 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689383 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 17:36:39.692920 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689385 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 17:36:39.692920 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689388 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 17:36:39.692920 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689391 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 17:36:39.692920 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689393 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 17:36:39.692920 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689396 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 17:36:39.692920 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689398 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 17:36:39.692920 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689401 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 17:36:39.692920 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689403 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 17:36:39.692920 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689406 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 17:36:39.692920 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689408 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 17:36:39.692920 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689410 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 17:36:39.692920 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689412 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 17:36:39.692920 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689415 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 17:36:39.692920 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689418 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 17:36:39.692920 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689420 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 17:36:39.692920 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689423 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 17:36:39.692920 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689425 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 17:36:39.693434 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689428 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 17:36:39.693434 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689432 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 17:36:39.693434 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689434 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 17:36:39.693434 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689437 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 17:36:39.693434 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689439 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 17:36:39.693434 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689442 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 17:36:39.693434 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689445 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 17:36:39.693434 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689447 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 17:36:39.693434 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689449 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 17:36:39.693434 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689452 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 17:36:39.693434 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689454 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 17:36:39.693434 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689456 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 17:36:39.693434 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689459 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 17:36:39.693434 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689461 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 17:36:39.693434 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689464 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 17:36:39.693434 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689466 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 17:36:39.693434 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689468 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 17:36:39.693434 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689472 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 17:36:39.693434 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689474 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 17:36:39.693434 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689477 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 17:36:39.693897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689480 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 17:36:39.693897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689483 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 17:36:39.693897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689486 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 07 17:36:39.693897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689490 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 17:36:39.693897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689492 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 17:36:39.693897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689495 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 17:36:39.693897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689497 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 17:36:39.693897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689499 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 17:36:39.693897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689502 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 17:36:39.693897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689505 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 17:36:39.693897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689507 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 17:36:39.693897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689510 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 17:36:39.693897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689512 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 17:36:39.693897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689515 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 17:36:39.693897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689518 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 17:36:39.693897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689521 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 17:36:39.693897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689523 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 17:36:39.693897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689526 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 17:36:39.693897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689528 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 17:36:39.693897 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689531 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 17:36:39.694493 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689533 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 17:36:39.694493 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689536 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 17:36:39.694493 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689538 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 17:36:39.694493 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689541 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 17:36:39.694493 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689543 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 17:36:39.694493 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689546 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 17:36:39.694493 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689548 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 17:36:39.694493 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689550 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 17:36:39.694493 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689553 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 17:36:39.694493 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689557 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 17:36:39.694493 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689560 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 17:36:39.694493 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689563 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 17:36:39.694493 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689566 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 17:36:39.694493 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689569 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 17:36:39.694493 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689572 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 17:36:39.694493 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689574 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 17:36:39.694493 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689577 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 17:36:39.694493 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689580 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 17:36:39.694921 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689584 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 17:36:39.694921 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689586 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 17:36:39.694921 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689589 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 17:36:39.694921 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689591 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 17:36:39.694921 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689594 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 17:36:39.694921 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689596 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 17:36:39.694921 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689598 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 17:36:39.694921 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689601 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 17:36:39.694921 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689604 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 17:36:39.694921 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689607 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 17:36:39.694921 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689610 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 17:36:39.694921 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689612 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 17:36:39.694921 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689615 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 17:36:39.694921 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.689620 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 17:36:39.694921 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689729 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 17:36:39.695316 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689734 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 17:36:39.695316 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689737 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 17:36:39.695316 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689740 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 17:36:39.695316 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689742 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 17:36:39.695316 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689745 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 17:36:39.695316 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689748 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 17:36:39.695316 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689751 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 17:36:39.695316 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689753 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 17:36:39.695316 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689756 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 17:36:39.695316 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689759 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 17:36:39.695316 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689762 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 17:36:39.695316 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689764 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 17:36:39.695316 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689767 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 17:36:39.695316 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689770 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 17:36:39.695316 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689772 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 17:36:39.695316 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689775 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 17:36:39.695316 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689777 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 17:36:39.695316 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689780 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 17:36:39.695316 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689782 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 17:36:39.695316 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689784 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 17:36:39.695795 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689787 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 17:36:39.695795 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689789 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 17:36:39.695795 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689792 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 17:36:39.695795 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689794 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 17:36:39.695795 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689797 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 17:36:39.695795 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689799 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 17:36:39.695795 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689802 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 17:36:39.695795 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689805 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 17:36:39.695795 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689807 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 07 17:36:39.695795 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689810 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 17:36:39.695795 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689812 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 17:36:39.695795 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689814 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 17:36:39.695795 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689818 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 17:36:39.695795 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689822 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 17:36:39.695795 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689824 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 17:36:39.695795 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689827 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 17:36:39.695795 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689830 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 17:36:39.695795 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689832 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 17:36:39.695795 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689835 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 17:36:39.695795 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689837 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 17:36:39.696359 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689840 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 17:36:39.696359 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689842 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 17:36:39.696359 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689846 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 17:36:39.696359 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689849 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 17:36:39.696359 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689852 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 17:36:39.696359 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689855 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 17:36:39.696359 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689857 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 17:36:39.696359 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689860 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 17:36:39.696359 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689863 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 17:36:39.696359 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689865 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 17:36:39.696359 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689868 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 17:36:39.696359 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689870 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 17:36:39.696359 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689873 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 17:36:39.696359 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689875 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 17:36:39.696359 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689878 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 17:36:39.696359 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689880 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 17:36:39.696359 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689883 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 17:36:39.696359 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689885 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 17:36:39.696359 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689887 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 17:36:39.696839 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689890 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 17:36:39.696839 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689893 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 17:36:39.696839 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689895 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 17:36:39.696839 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689898 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 17:36:39.696839 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689900 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 17:36:39.696839 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689902 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 17:36:39.696839 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689905 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 17:36:39.696839 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689907 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 17:36:39.696839 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689909 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 17:36:39.696839 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689912 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 17:36:39.696839 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689914 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 17:36:39.696839 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689916 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 17:36:39.696839 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689919 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 17:36:39.696839 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689921 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 17:36:39.696839 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689924 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 17:36:39.696839 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689926 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 17:36:39.696839 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689928 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 17:36:39.696839 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689931 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 17:36:39.696839 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689933 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 17:36:39.697594 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689936 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 17:36:39.697594 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689938 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 17:36:39.697594 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689942 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 17:36:39.697594 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689945 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 17:36:39.697594 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689947 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 17:36:39.697594 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689950 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 17:36:39.697594 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689952 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 17:36:39.697594 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689955 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 17:36:39.697594 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689957 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 17:36:39.697594 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689959 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 17:36:39.697594 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689962 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 17:36:39.697594 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689964 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 17:36:39.697594 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689967 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 17:36:39.697594 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689970 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 17:36:39.697594 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689972 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 17:36:39.697594 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689975 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 17:36:39.697594 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689977 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 17:36:39.697594 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689980 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 17:36:39.697594 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689982 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 17:36:39.698134 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:39.689985 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 17:36:39.698134 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.689989 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 17:36:39.698134 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.690354 2552 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 17:36:39.698134 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.692926 2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 17:36:39.698134 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.694142 2552 server.go:1019] "Starting client certificate rotation" Jul 07 17:36:39.698134 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.694254 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 17:36:39.698134 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.694314 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 17:36:39.698134 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.696399 2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 17:36:39.698134 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.697512 2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 17:36:39.710330 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.710312 2552 log.go:25] "Validated CRI v1 runtime API" Jul 07 17:36:39.712349 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.712335 2552 log.go:25] "Validated CRI v1 image API" Jul 07 17:36:39.713172 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.713159 2552 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 17:36:39.715570 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.715550 2552 fs.go:135] Filesystem UUIDs: map[2129d4e6-91cb-4456-b122-fc3feaba8a29:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 89fa4498-5ec6-4135-96f1-53b1c2c645a0:/dev/nvme0n1p4] Jul 07 17:36:39.715650 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.715568 2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 17:36:39.719795 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.719688 2552 manager.go:216] Machine: {Timestamp:2026-07-07 17:36:39.719200749 +0000 UTC m=+0.301207487 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3204269 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d88376862cf0a94804323444571fa SystemUUID:ec2d8837-6862-cf0a-9480-4323444571fa BootID:001c6231-7ab3-46ed-848f-b0218c3f1ad1 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7e:a0:23:c4:c7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7e:a0:23:c4:c7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:c6:4c:cb:28:5b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 17:36:39.719795 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.719785 2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 17:36:39.719933 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.719856 2552 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 17:36:39.721504 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.721487 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 17:36:39.723270 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.723242 2552 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 17:36:39.723444 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.723272 2552 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-96.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 17:36:39.724659 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.724513 2552 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 17:36:39.724659 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.724540 2552 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 17:36:39.724659 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.724563 2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 17:36:39.724659 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.724597 2552 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 17:36:39.726670 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.726652 2552 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 17:36:39.730289 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.730277 2552 state_mem.go:36] "Initialized new in-memory state store" Jul 07 17:36:39.730460 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.730450 2552 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 17:36:39.730505 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.730482 2552 kubelet.go:486] "Attempting to sync node with API server" Jul 07 17:36:39.730505 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.730492 2552 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 17:36:39.730572 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.730507 2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 17:36:39.730572 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.730516 2552 kubelet.go:398] "Adding apiserver pod source" Jul 07 17:36:39.730572 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.730527 2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 17:36:39.730913 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.730886 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 17:36:39.730966 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.730919 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 17:36:39.733482 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.733464 2552 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 17:36:39.735612 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.735598 2552 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 17:36:39.735673 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.735629 2552 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 17:36:39.736809 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.736798 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 17:36:39.736851 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.736814 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 17:36:39.736851 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.736820 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 17:36:39.736851 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.736826 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 17:36:39.736851 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.736835 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 17:36:39.736851 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.736841 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 17:36:39.736851 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.736849 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 17:36:39.736851 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.736854 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 17:36:39.737046 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.736861 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 17:36:39.737046 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.736867 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 17:36:39.737046 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.736876 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 17:36:39.737046 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.736881 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 17:36:39.738330 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.738320 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 17:36:39.738330 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.738330 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 17:36:39.741495 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.741483 2552 server.go:1268] "Started kubelet" Jul 07 17:36:39.741638 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.741584 2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 17:36:39.741727 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.741678 2552 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 17:36:39.741786 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.741751 2552 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 17:36:39.741910 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:39.741885 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 17:36:39.741992 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.741963 2552 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-96.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 17:36:39.742100 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:39.742076 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-96.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 17:36:39.743049 ip-10-0-131-96 systemd[1]: Started Kubernetes Kubelet. Jul 07 17:36:39.743679 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.743516 2552 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 17:36:39.745060 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.745042 2552 server.go:310] "Adding debug handlers to kubelet server" Jul 07 17:36:39.746289 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.746271 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6n6ff" Jul 07 17:36:39.746588 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:39.746569 2552 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 17:36:39.747997 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:39.747036 2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-96.ec2.internal.18c0128179c08276 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-96.ec2.internal,UID:ip-10-0-131-96.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-96.ec2.internal,},FirstTimestamp:2026-07-07 17:36:39.741457014 +0000 UTC m=+0.323463754,LastTimestamp:2026-07-07 17:36:39.741457014 +0000 UTC m=+0.323463754,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-96.ec2.internal,}" Jul 07 17:36:39.751023 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.751002 2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 17:36:39.751124 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.751010 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 17:36:39.751224 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:39.751206 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-96.ec2.internal\" not found" Jul 07 17:36:39.751766 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.751743 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6n6ff" Jul 07 17:36:39.751869 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.751752 2552 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 17:36:39.751944 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.751899 2552 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 17:36:39.751944 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.751915 2552 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 17:36:39.752037 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.752017 2552 factory.go:55] Registering systemd factory Jul 07 17:36:39.752037 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.752031 2552 factory.go:223] Registration of the systemd container factory successfully Jul 07 17:36:39.752125 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.752062 2552 reconstruct.go:97] "Volume reconstruction finished" Jul 07 17:36:39.752125 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.752069 2552 reconciler.go:29] "Reconciler: start to sync state" Jul 07 17:36:39.752471 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.752454 2552 factory.go:153] Registering CRI-O factory Jul 07 17:36:39.752471 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.752474 2552 factory.go:223] Registration of the crio container factory successfully Jul 07 17:36:39.752607 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.752561 2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 17:36:39.752607 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.752599 2552 factory.go:103] Registering Raw factory Jul 07 17:36:39.752728 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.752616 2552 manager.go:1196] Started watching for new ooms in manager Jul 07 17:36:39.753551 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.753431 2552 manager.go:349] Starting recovery of all containers Jul 07 17:36:39.754678 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:39.754652 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 17:36:39.754787 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:39.754764 2552 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-96.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 17:36:39.768699 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.768681 2552 manager.go:354] Recovery completed Jul 07 17:36:39.773249 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.773144 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 17:36:39.775002 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.774987 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-96.ec2.internal" event="NodeHasSufficientMemory" Jul 07 17:36:39.775095 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.775019 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-96.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 17:36:39.775095 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.775033 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-96.ec2.internal" event="NodeHasSufficientPID" Jul 07 17:36:39.775570 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.775554 2552 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 17:36:39.775570 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.775568 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 17:36:39.775690 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.775569 2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 17:36:39.775690 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.775602 2552 state_mem.go:36] "Initialized new in-memory state store" Jul 07 17:36:39.776255 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.776241 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-96.ec2.internal" event="NodeHasSufficientMemory" Jul 07 17:36:39.776297 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.776266 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-96.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 17:36:39.776297 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.776276 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-96.ec2.internal" event="NodeHasSufficientPID" Jul 07 17:36:39.776621 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.776610 2552 policy_none.go:49] "None policy: Start" Jul 07 17:36:39.776660 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.776626 2552 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 17:36:39.776660 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.776636 2552 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 17:36:39.777705 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.777695 2552 policy_none.go:47] "Start" Jul 07 17:36:39.819995 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.819963 2552 manager.go:337] "Starting Device Plugin manager" Jul 07 17:36:39.820099 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:39.820021 2552 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 17:36:39.820099 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.820035 2552 server.go:87] "Starting device plugin registration server" Jul 07 17:36:39.820298 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.820284 2552 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 17:36:39.820378 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.820327 2552 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 17:36:39.820429 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.820401 2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 17:36:39.820509 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.820491 2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 17:36:39.820509 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.820509 2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 17:36:39.821058 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:39.821023 2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 17:36:39.821197 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:39.821076 2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-96.ec2.internal\" not found" Jul 07 17:36:39.923521 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.923465 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 17:36:39.924629 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.924386 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-96.ec2.internal" event="NodeHasSufficientMemory" Jul 07 17:36:39.924629 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.924421 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-96.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 17:36:39.924629 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.924433 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-96.ec2.internal" event="NodeHasSufficientPID" Jul 07 17:36:39.924629 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.924461 2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-96.ec2.internal" Jul 07 17:36:39.930737 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.930721 2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-96.ec2.internal" Jul 07 17:36:39.930809 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:39.930742 2552 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-96.ec2.internal\": node \"ip-10-0-131-96.ec2.internal\" not found" Jul 07 17:36:39.943147 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:39.943120 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-96.ec2.internal\" not found" Jul 07 17:36:39.964159 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.964133 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 17:36:39.965461 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.965441 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 17:36:39.965545 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.965475 2552 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 17:36:39.965545 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.965507 2552 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 17:36:39.965621 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:39.965547 2552 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 17:36:39.967427 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:39.967408 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 17:36:40.046807 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:40.046775 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-96.ec2.internal\" not found" Jul 07 17:36:40.066686 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.066661 2552 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-96.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-96.ec2.internal"] Jul 07 17:36:40.066754 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.066736 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 17:36:40.068549 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.068526 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-96.ec2.internal" event="NodeHasSufficientMemory" Jul 07 17:36:40.068625 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.068559 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-96.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 17:36:40.068625 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.068572 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-96.ec2.internal" event="NodeHasSufficientPID" Jul 07 17:36:40.069995 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.069983 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 17:36:40.070149 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.070136 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-96.ec2.internal" Jul 07 17:36:40.070186 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.070169 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 17:36:40.070738 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.070722 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-96.ec2.internal" event="NodeHasSufficientMemory" Jul 07 17:36:40.070808 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.070777 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-96.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 17:36:40.070808 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.070787 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-96.ec2.internal" event="NodeHasSufficientMemory" Jul 07 17:36:40.070808 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.070807 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-96.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 17:36:40.070946 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.070817 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-96.ec2.internal" event="NodeHasSufficientPID" Jul 07 17:36:40.070946 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.070791 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-96.ec2.internal" event="NodeHasSufficientPID" Jul 07 17:36:40.072602 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.072585 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-96.ec2.internal" Jul 07 17:36:40.072694 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.072618 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 17:36:40.073364 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.073349 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-96.ec2.internal" event="NodeHasSufficientMemory" Jul 07 17:36:40.073462 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.073373 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-96.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 17:36:40.073462 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.073383 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-96.ec2.internal" event="NodeHasSufficientPID" Jul 07 17:36:40.097040 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:40.097021 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-96.ec2.internal\" not found" node="ip-10-0-131-96.ec2.internal" Jul 07 17:36:40.101565 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:40.101546 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-96.ec2.internal\" not found" node="ip-10-0-131-96.ec2.internal" Jul 07 17:36:40.147897 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:40.147879 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-96.ec2.internal\" not found" Jul 07 17:36:40.153744 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.153721 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d6829a6c860a19c0346cab9c77c0d29-config\") pod \"kube-apiserver-proxy-ip-10-0-131-96.ec2.internal\" (UID: \"9d6829a6c860a19c0346cab9c77c0d29\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-96.ec2.internal" Jul 07 17:36:40.153838 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.153750 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/892566dbf19d8c368ae6d5de831bb733-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-96.ec2.internal\" (UID: \"892566dbf19d8c368ae6d5de831bb733\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-96.ec2.internal" Jul 07 17:36:40.153838 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.153779 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/892566dbf19d8c368ae6d5de831bb733-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-96.ec2.internal\" (UID: \"892566dbf19d8c368ae6d5de831bb733\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-96.ec2.internal" Jul 07 17:36:40.249271 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:40.249224 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-96.ec2.internal\" not found" Jul 07 17:36:40.253915 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.253886 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/892566dbf19d8c368ae6d5de831bb733-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-96.ec2.internal\" (UID: \"892566dbf19d8c368ae6d5de831bb733\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-96.ec2.internal" Jul 07 17:36:40.253996 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.253918 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d6829a6c860a19c0346cab9c77c0d29-config\") pod \"kube-apiserver-proxy-ip-10-0-131-96.ec2.internal\" (UID: \"9d6829a6c860a19c0346cab9c77c0d29\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-96.ec2.internal" Jul 07 17:36:40.253996 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.253936 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/892566dbf19d8c368ae6d5de831bb733-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-96.ec2.internal\" (UID: \"892566dbf19d8c368ae6d5de831bb733\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-96.ec2.internal" Jul 07 17:36:40.253996 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.253962 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/892566dbf19d8c368ae6d5de831bb733-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-96.ec2.internal\" (UID: \"892566dbf19d8c368ae6d5de831bb733\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-96.ec2.internal" Jul 07 17:36:40.253996 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.253978 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/892566dbf19d8c368ae6d5de831bb733-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-96.ec2.internal\" (UID: \"892566dbf19d8c368ae6d5de831bb733\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-96.ec2.internal" Jul 07 17:36:40.254140 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.254011 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d6829a6c860a19c0346cab9c77c0d29-config\") pod \"kube-apiserver-proxy-ip-10-0-131-96.ec2.internal\" (UID: \"9d6829a6c860a19c0346cab9c77c0d29\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-96.ec2.internal" Jul 07 17:36:40.356961 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:40.356930 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-96.ec2.internal\" not found" Jul 07 17:36:40.401187 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.401161 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-96.ec2.internal" Jul 07 17:36:40.405841 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.405383 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-96.ec2.internal" Jul 07 17:36:40.457527 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:40.457503 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-96.ec2.internal\" not found" Jul 07 17:36:40.558410 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:40.558340 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-96.ec2.internal\" not found" Jul 07 17:36:40.658428 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:40.658391 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-96.ec2.internal\" not found" Jul 07 17:36:40.695372 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.695340 2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 17:36:40.695839 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.695502 2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 17:36:40.757215 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.757159 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 17:31:39 +0000 UTC" deadline="2028-04-08 00:15:36.740141286 +0000 UTC" Jul 07 17:36:40.757215 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:40.757211 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15366h38m55.982937934s" Jul 07 17:36:40.758515 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:40.758495 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-96.ec2.internal\" not found" Jul 07 17:36:40.858737 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:40.858639 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-96.ec2.internal\" not found" Jul 07 17:36:40.959597 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:40.959564 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-96.ec2.internal\" not found" Jul 07 17:36:41.010596 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.010568 2552 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 17:36:41.025125 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:41.025088 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d6829a6c860a19c0346cab9c77c0d29.slice/crio-233e1151eebba62c36bd6420b3a819437cb6cc15e89dba2328adf0f14a9803e9 WatchSource:0}: Error finding container 233e1151eebba62c36bd6420b3a819437cb6cc15e89dba2328adf0f14a9803e9: Status 404 returned error can't find the container with id 233e1151eebba62c36bd6420b3a819437cb6cc15e89dba2328adf0f14a9803e9 Jul 07 17:36:41.025348 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:41.025326 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod892566dbf19d8c368ae6d5de831bb733.slice/crio-8d1e48dc4bf2336af270d8caf2061e4e7658493f5bc17040ab4e852a626da62a WatchSource:0}: Error finding container 8d1e48dc4bf2336af270d8caf2061e4e7658493f5bc17040ab4e852a626da62a: Status 404 returned error can't find the container with id 8d1e48dc4bf2336af270d8caf2061e4e7658493f5bc17040ab4e852a626da62a Jul 07 17:36:41.029465 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.029443 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 17:36:41.051294 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.051267 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-96.ec2.internal" Jul 07 17:36:41.062312 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.062292 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 17:36:41.064026 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.064013 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-96.ec2.internal" Jul 07 17:36:41.074773 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.074757 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 17:36:41.189425 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.189358 2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 17:36:41.306609 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.306577 2552 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 17:36:41.646831 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.646733 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 17:36:41.731621 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.731580 2552 apiserver.go:52] "Watching apiserver" Jul 07 17:36:41.738679 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.738649 2552 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 17:36:41.739090 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.739059 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-mxgbv","kube-system/kube-apiserver-proxy-ip-10-0-131-96.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z85ch","openshift-dns/node-resolver-ng458","openshift-image-registry/node-ca-5bd9q","openshift-network-diagnostics/network-check-target-mcxjj","openshift-network-operator/iptables-alerter-m4n2w","openshift-ovn-kubernetes/ovnkube-node-x765g","kube-system/konnectivity-agent-bwgg5","openshift-cluster-node-tuning-operator/tuned-7m2wj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-96.ec2.internal","openshift-multus/multus-additional-cni-plugins-7zgc6","openshift-multus/multus-qhctz","openshift-multus/network-metrics-daemon-nrwlq"] Jul 07 17:36:41.740661 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.740641 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m4n2w" Jul 07 17:36:41.741784 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.741765 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.743008 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.742804 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 17:36:41.743008 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.742908 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 17:36:41.743008 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.742937 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zlz9h\"" Jul 07 17:36:41.743236 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.743038 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z85ch" Jul 07 17:36:41.743236 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.743215 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 17:36:41.744139 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.744111 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hrv6x\"" Jul 07 17:36:41.744238 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.744175 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 17:36:41.744295 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.744253 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 17:36:41.744787 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.744481 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 17:36:41.744787 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.744574 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 17:36:41.744787 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.744652 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ng458" Jul 07 17:36:41.745634 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.745435 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 17:36:41.745634 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.745582 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-l5tv8\"" Jul 07 17:36:41.745785 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.745646 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 17:36:41.745874 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.745855 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 17:36:41.746905 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.746888 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5bd9q" Jul 07 17:36:41.746998 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.746977 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 17:36:41.747506 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.747488 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 17:36:41.747645 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.747625 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-x78zm\"" Jul 07 17:36:41.748112 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.748085 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:36:41.748384 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:41.748183 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcxjj" podUID="4b7e95da-8e96-4bbc-9579-8850344048c8" Jul 07 17:36:41.748778 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.748755 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 17:36:41.749119 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.749005 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jntd4\"" Jul 07 17:36:41.749278 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.749261 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 17:36:41.749356 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.749276 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bwgg5" Jul 07 17:36:41.749598 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.749582 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 17:36:41.751185 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.751083 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:36:41.751185 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:41.751150 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxgbv" podUID="ee071d67-b30e-43c6-bc8b-6ef2cd711a52" Jul 07 17:36:41.751538 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.751516 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 17:36:41.751788 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.751771 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pnxk9\"" Jul 07 17:36:41.751849 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.751823 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 17:36:41.752108 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.752094 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 17:36:41.752637 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.752613 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:36:41.752729 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:41.752674 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrwlq" podUID="169258da-bb2c-4e58-8e93-447b39ef7da2" Jul 07 17:36:41.753943 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.753923 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.756515 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.756493 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2kxnw\"" Jul 07 17:36:41.757649 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.756846 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 17:36:41.757649 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.757373 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 17:36:41.758991 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.758971 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.760646 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.760432 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7zgc6" Jul 07 17:36:41.761882 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.761858 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 17:36:41.762022 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.762002 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 17:36:41.762134 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.762120 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 17:36:41.762243 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.762226 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 17:36:41.762309 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.762256 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gkttq\"" Jul 07 17:36:41.762485 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.762468 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 17:36:41.762558 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.762513 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 17:36:41.762758 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.762742 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 17:36:41.762908 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.762892 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 17:36:41.762994 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.762935 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k6j82\"" Jul 07 17:36:41.765262 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.765241 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c8b95a44-c78b-4967-a62d-3614d181f9d2-host-slash\") pod \"iptables-alerter-m4n2w\" (UID: \"c8b95a44-c78b-4967-a62d-3614d181f9d2\") " pod="openshift-network-operator/iptables-alerter-m4n2w" Jul 07 17:36:41.765383 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.765319 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 17:36:41.765383 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.765360 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2bnk\" (UniqueName: \"kubernetes.io/projected/4b7e95da-8e96-4bbc-9579-8850344048c8-kube-api-access-d2bnk\") pod \"network-check-target-mcxjj\" (UID: \"4b7e95da-8e96-4bbc-9579-8850344048c8\") " pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:36:41.765502 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.765393 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xskl\" (UniqueName: \"kubernetes.io/projected/c8b95a44-c78b-4967-a62d-3614d181f9d2-kube-api-access-2xskl\") pod \"iptables-alerter-m4n2w\" (UID: \"c8b95a44-c78b-4967-a62d-3614d181f9d2\") " pod="openshift-network-operator/iptables-alerter-m4n2w" Jul 07 17:36:41.765502 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.765461 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-multus-cni-dir\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.765603 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.765528 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-host-run-multus-certs\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.765603 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.765552 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8m5f\" (UniqueName: \"kubernetes.io/projected/0ff7ea17-d539-44d4-8c47-b9f1f6a145b6-kube-api-access-m8m5f\") pod \"node-ca-5bd9q\" (UID: \"0ff7ea17-d539-44d4-8c47-b9f1f6a145b6\") " pod="openshift-image-registry/node-ca-5bd9q" Jul 07 17:36:41.765704 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.765621 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4451a20c-e7df-4dd2-8fbb-61908e7d0789-socket-dir\") pod \"aws-ebs-csi-driver-node-z85ch\" (UID: \"4451a20c-e7df-4dd2-8fbb-61908e7d0789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z85ch" Jul 07 17:36:41.765704 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.765641 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a75a377-7143-4174-94c5-4c50edb05db7-tmp-dir\") pod \"node-resolver-ng458\" (UID: \"2a75a377-7143-4174-94c5-4c50edb05db7\") " pod="openshift-dns/node-resolver-ng458" Jul 07 17:36:41.765796 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.765712 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-cnibin\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.765796 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.765737 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-multus-conf-dir\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.765796 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.765759 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/34658460-c105-4bd3-ac91-331037e66aba-multus-daemon-config\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.765935 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.765828 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-original-pull-secret\") pod \"global-pull-secret-syncer-mxgbv\" (UID: \"ee071d67-b30e-43c6-bc8b-6ef2cd711a52\") " pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:36:41.765935 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.765853 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5l5m\" (UniqueName: \"kubernetes.io/projected/2a75a377-7143-4174-94c5-4c50edb05db7-kube-api-access-c5l5m\") pod \"node-resolver-ng458\" (UID: \"2a75a377-7143-4174-94c5-4c50edb05db7\") " pod="openshift-dns/node-resolver-ng458" Jul 07 17:36:41.765935 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.765884 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ff7ea17-d539-44d4-8c47-b9f1f6a145b6-host\") pod \"node-ca-5bd9q\" (UID: \"0ff7ea17-d539-44d4-8c47-b9f1f6a145b6\") " pod="openshift-image-registry/node-ca-5bd9q" Jul 07 17:36:41.765935 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.765916 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0ff7ea17-d539-44d4-8c47-b9f1f6a145b6-serviceca\") pod \"node-ca-5bd9q\" (UID: \"0ff7ea17-d539-44d4-8c47-b9f1f6a145b6\") " pod="openshift-image-registry/node-ca-5bd9q" Jul 07 17:36:41.766122 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.765938 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4451a20c-e7df-4dd2-8fbb-61908e7d0789-etc-selinux\") pod \"aws-ebs-csi-driver-node-z85ch\" (UID: \"4451a20c-e7df-4dd2-8fbb-61908e7d0789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z85ch" Jul 07 17:36:41.766122 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.765975 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2a75a377-7143-4174-94c5-4c50edb05db7-hosts-file\") pod \"node-resolver-ng458\" (UID: \"2a75a377-7143-4174-94c5-4c50edb05db7\") " pod="openshift-dns/node-resolver-ng458" Jul 07 17:36:41.766122 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.766000 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/93fb588c-7c14-4b9d-b465-fe362d2c3512-agent-certs\") pod \"konnectivity-agent-bwgg5\" (UID: \"93fb588c-7c14-4b9d-b465-fe362d2c3512\") " pod="kube-system/konnectivity-agent-bwgg5" Jul 07 17:36:41.766122 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.766023 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c8b95a44-c78b-4967-a62d-3614d181f9d2-iptables-alerter-script\") pod \"iptables-alerter-m4n2w\" (UID: \"c8b95a44-c78b-4967-a62d-3614d181f9d2\") " pod="openshift-network-operator/iptables-alerter-m4n2w" Jul 07 17:36:41.766122 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.766051 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4451a20c-e7df-4dd2-8fbb-61908e7d0789-sys-fs\") pod \"aws-ebs-csi-driver-node-z85ch\" (UID: \"4451a20c-e7df-4dd2-8fbb-61908e7d0789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z85ch" Jul 07 17:36:41.766122 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.766068 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/169258da-bb2c-4e58-8e93-447b39ef7da2-metrics-certs\") pod \"network-metrics-daemon-nrwlq\" (UID: \"169258da-bb2c-4e58-8e93-447b39ef7da2\") " pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:36:41.766122 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.766085 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34658460-c105-4bd3-ac91-331037e66aba-cni-binary-copy\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.766122 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.766108 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/93fb588c-7c14-4b9d-b465-fe362d2c3512-konnectivity-ca\") pod \"konnectivity-agent-bwgg5\" (UID: \"93fb588c-7c14-4b9d-b465-fe362d2c3512\") " pod="kube-system/konnectivity-agent-bwgg5" Jul 07 17:36:41.766513 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.766129 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4451a20c-e7df-4dd2-8fbb-61908e7d0789-device-dir\") pod \"aws-ebs-csi-driver-node-z85ch\" (UID: \"4451a20c-e7df-4dd2-8fbb-61908e7d0789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z85ch" Jul 07 17:36:41.766513 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.766171 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpc9l\" (UniqueName: \"kubernetes.io/projected/169258da-bb2c-4e58-8e93-447b39ef7da2-kube-api-access-tpc9l\") pod \"network-metrics-daemon-nrwlq\" (UID: \"169258da-bb2c-4e58-8e93-447b39ef7da2\") " pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:36:41.766513 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.766213 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-system-cni-dir\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.766513 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.766240 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-host-var-lib-cni-multus\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.766513 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.766263 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-host-var-lib-kubelet\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.766513 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.766286 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-hostroot\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.766513 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.766325 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-dbus\") pod \"global-pull-secret-syncer-mxgbv\" (UID: \"ee071d67-b30e-43c6-bc8b-6ef2cd711a52\") " pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:36:41.766513 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.766371 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4451a20c-e7df-4dd2-8fbb-61908e7d0789-registration-dir\") pod \"aws-ebs-csi-driver-node-z85ch\" (UID: \"4451a20c-e7df-4dd2-8fbb-61908e7d0789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z85ch" Jul 07 17:36:41.766513 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.766396 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7vw7\" (UniqueName: \"kubernetes.io/projected/4451a20c-e7df-4dd2-8fbb-61908e7d0789-kube-api-access-b7vw7\") pod \"aws-ebs-csi-driver-node-z85ch\" (UID: \"4451a20c-e7df-4dd2-8fbb-61908e7d0789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z85ch" Jul 07 17:36:41.766513 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.766418 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-os-release\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.766513 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.766469 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-host-var-lib-cni-bin\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.766513 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.766499 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-kubelet-config\") pod \"global-pull-secret-syncer-mxgbv\" (UID: \"ee071d67-b30e-43c6-bc8b-6ef2cd711a52\") " pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:36:41.767086 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.766543 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4451a20c-e7df-4dd2-8fbb-61908e7d0789-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z85ch\" (UID: \"4451a20c-e7df-4dd2-8fbb-61908e7d0789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z85ch" Jul 07 17:36:41.767086 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.766575 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-multus-socket-dir-parent\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.767086 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.766601 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-host-run-k8s-cni-cncf-io\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.767086 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.766653 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-host-run-netns\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.767086 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.766676 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-etc-kubernetes\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.767086 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.766730 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgd7r\" (UniqueName: \"kubernetes.io/projected/34658460-c105-4bd3-ac91-331037e66aba-kube-api-access-xgd7r\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.792471 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.792442 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-n9gdp" Jul 07 17:36:41.800964 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.800843 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-n9gdp" Jul 07 17:36:41.853391 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.853368 2552 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 17:36:41.867053 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867025 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-kubelet-config\") pod \"global-pull-secret-syncer-mxgbv\" (UID: \"ee071d67-b30e-43c6-bc8b-6ef2cd711a52\") " pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:36:41.867177 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867062 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-host-run-netns\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.867177 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867088 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c8b95a44-c78b-4967-a62d-3614d181f9d2-host-slash\") pod \"iptables-alerter-m4n2w\" (UID: \"c8b95a44-c78b-4967-a62d-3614d181f9d2\") " pod="openshift-network-operator/iptables-alerter-m4n2w" Jul 07 17:36:41.867177 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867112 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2bnk\" (UniqueName: \"kubernetes.io/projected/4b7e95da-8e96-4bbc-9579-8850344048c8-kube-api-access-d2bnk\") pod \"network-check-target-mcxjj\" (UID: \"4b7e95da-8e96-4bbc-9579-8850344048c8\") " pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:36:41.867177 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867141 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-host-kubelet\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.867177 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867153 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-kubelet-config\") pod \"global-pull-secret-syncer-mxgbv\" (UID: \"ee071d67-b30e-43c6-bc8b-6ef2cd711a52\") " pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:36:41.867177 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867163 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-host-run-netns\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.867500 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867165 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c8b95a44-c78b-4967-a62d-3614d181f9d2-host-slash\") pod \"iptables-alerter-m4n2w\" (UID: \"c8b95a44-c78b-4967-a62d-3614d181f9d2\") " pod="openshift-network-operator/iptables-alerter-m4n2w" Jul 07 17:36:41.867500 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867173 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/058bbf81-9eba-48d5-8d6f-119c027acd4c-ovnkube-script-lib\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.867500 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867237 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de-os-release\") pod \"multus-additional-cni-plugins-7zgc6\" (UID: \"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de\") " pod="openshift-multus/multus-additional-cni-plugins-7zgc6" Jul 07 17:36:41.867500 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867277 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7zgc6\" (UID: \"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de\") " pod="openshift-multus/multus-additional-cni-plugins-7zgc6" Jul 07 17:36:41.867500 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867321 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4451a20c-e7df-4dd2-8fbb-61908e7d0789-socket-dir\") pod \"aws-ebs-csi-driver-node-z85ch\" (UID: \"4451a20c-e7df-4dd2-8fbb-61908e7d0789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z85ch" Jul 07 17:36:41.867500 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867358 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a75a377-7143-4174-94c5-4c50edb05db7-tmp-dir\") pod \"node-resolver-ng458\" (UID: \"2a75a377-7143-4174-94c5-4c50edb05db7\") " pod="openshift-dns/node-resolver-ng458" Jul 07 17:36:41.867500 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867383 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-multus-conf-dir\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.867500 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867419 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/34658460-c105-4bd3-ac91-331037e66aba-multus-daemon-config\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.867500 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867434 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-host\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.867500 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867438 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4451a20c-e7df-4dd2-8fbb-61908e7d0789-socket-dir\") pod \"aws-ebs-csi-driver-node-z85ch\" (UID: \"4451a20c-e7df-4dd2-8fbb-61908e7d0789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z85ch" Jul 07 17:36:41.867500 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867467 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5l5m\" (UniqueName: \"kubernetes.io/projected/2a75a377-7143-4174-94c5-4c50edb05db7-kube-api-access-c5l5m\") pod \"node-resolver-ng458\" (UID: \"2a75a377-7143-4174-94c5-4c50edb05db7\") " pod="openshift-dns/node-resolver-ng458" Jul 07 17:36:41.867500 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867479 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-multus-conf-dir\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.867500 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867490 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-host-cni-netd\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.868180 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867526 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0ff7ea17-d539-44d4-8c47-b9f1f6a145b6-serviceca\") pod \"node-ca-5bd9q\" (UID: \"0ff7ea17-d539-44d4-8c47-b9f1f6a145b6\") " pod="openshift-image-registry/node-ca-5bd9q" Jul 07 17:36:41.868180 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867553 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4451a20c-e7df-4dd2-8fbb-61908e7d0789-etc-selinux\") pod \"aws-ebs-csi-driver-node-z85ch\" (UID: \"4451a20c-e7df-4dd2-8fbb-61908e7d0789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z85ch" Jul 07 17:36:41.868180 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867579 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-etc-sysctl-conf\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.868180 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867607 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqtvf\" (UniqueName: \"kubernetes.io/projected/d2545279-ae71-4f4a-b734-a4af205eb331-kube-api-access-tqtvf\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.868180 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867633 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-run-openvswitch\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.868180 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867662 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c8b95a44-c78b-4967-a62d-3614d181f9d2-iptables-alerter-script\") pod \"iptables-alerter-m4n2w\" (UID: \"c8b95a44-c78b-4967-a62d-3614d181f9d2\") " pod="openshift-network-operator/iptables-alerter-m4n2w" Jul 07 17:36:41.868180 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867687 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4451a20c-e7df-4dd2-8fbb-61908e7d0789-sys-fs\") pod \"aws-ebs-csi-driver-node-z85ch\" (UID: \"4451a20c-e7df-4dd2-8fbb-61908e7d0789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z85ch" Jul 07 17:36:41.868180 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867695 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a75a377-7143-4174-94c5-4c50edb05db7-tmp-dir\") pod \"node-resolver-ng458\" (UID: \"2a75a377-7143-4174-94c5-4c50edb05db7\") " pod="openshift-dns/node-resolver-ng458" Jul 07 17:36:41.868180 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867710 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-etc-sysctl-d\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.868180 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867741 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-log-socket\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.868180 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867766 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/93fb588c-7c14-4b9d-b465-fe362d2c3512-konnectivity-ca\") pod \"konnectivity-agent-bwgg5\" (UID: \"93fb588c-7c14-4b9d-b465-fe362d2c3512\") " pod="kube-system/konnectivity-agent-bwgg5" Jul 07 17:36:41.868180 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867789 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4451a20c-e7df-4dd2-8fbb-61908e7d0789-device-dir\") pod \"aws-ebs-csi-driver-node-z85ch\" (UID: \"4451a20c-e7df-4dd2-8fbb-61908e7d0789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z85ch" Jul 07 17:36:41.868180 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867815 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpc9l\" (UniqueName: \"kubernetes.io/projected/169258da-bb2c-4e58-8e93-447b39ef7da2-kube-api-access-tpc9l\") pod \"network-metrics-daemon-nrwlq\" (UID: \"169258da-bb2c-4e58-8e93-447b39ef7da2\") " pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:36:41.868180 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867838 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-system-cni-dir\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.868180 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867840 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4451a20c-e7df-4dd2-8fbb-61908e7d0789-etc-selinux\") pod \"aws-ebs-csi-driver-node-z85ch\" (UID: \"4451a20c-e7df-4dd2-8fbb-61908e7d0789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z85ch" Jul 07 17:36:41.868180 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867862 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-hostroot\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.868180 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867891 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-var-lib-kubelet\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.868992 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867917 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvrdt\" (UniqueName: \"kubernetes.io/projected/e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de-kube-api-access-jvrdt\") pod \"multus-additional-cni-plugins-7zgc6\" (UID: \"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de\") " pod="openshift-multus/multus-additional-cni-plugins-7zgc6" Jul 07 17:36:41.868992 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867941 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-dbus\") pod \"global-pull-secret-syncer-mxgbv\" (UID: \"ee071d67-b30e-43c6-bc8b-6ef2cd711a52\") " pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:36:41.868992 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867965 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4451a20c-e7df-4dd2-8fbb-61908e7d0789-registration-dir\") pod \"aws-ebs-csi-driver-node-z85ch\" (UID: \"4451a20c-e7df-4dd2-8fbb-61908e7d0789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z85ch" Jul 07 17:36:41.868992 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.867995 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7vw7\" (UniqueName: \"kubernetes.io/projected/4451a20c-e7df-4dd2-8fbb-61908e7d0789-kube-api-access-b7vw7\") pod \"aws-ebs-csi-driver-node-z85ch\" (UID: \"4451a20c-e7df-4dd2-8fbb-61908e7d0789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z85ch" Jul 07 17:36:41.868992 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868019 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-os-release\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.868992 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868042 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-host-var-lib-cni-bin\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.868992 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868044 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/34658460-c105-4bd3-ac91-331037e66aba-multus-daemon-config\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.868992 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868063 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-etc-modprobe-d\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.868992 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868087 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-etc-systemd\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.868992 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868103 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0ff7ea17-d539-44d4-8c47-b9f1f6a145b6-serviceca\") pod \"node-ca-5bd9q\" (UID: \"0ff7ea17-d539-44d4-8c47-b9f1f6a145b6\") " pod="openshift-image-registry/node-ca-5bd9q" Jul 07 17:36:41.868992 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868110 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-run\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.868992 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868136 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4451a20c-e7df-4dd2-8fbb-61908e7d0789-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z85ch\" (UID: \"4451a20c-e7df-4dd2-8fbb-61908e7d0789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z85ch" Jul 07 17:36:41.868992 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868142 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4451a20c-e7df-4dd2-8fbb-61908e7d0789-sys-fs\") pod \"aws-ebs-csi-driver-node-z85ch\" (UID: \"4451a20c-e7df-4dd2-8fbb-61908e7d0789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z85ch" Jul 07 17:36:41.868992 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868204 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-host-var-lib-cni-bin\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.868992 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868222 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-os-release\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.868992 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868242 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4451a20c-e7df-4dd2-8fbb-61908e7d0789-registration-dir\") pod \"aws-ebs-csi-driver-node-z85ch\" (UID: \"4451a20c-e7df-4dd2-8fbb-61908e7d0789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z85ch" Jul 07 17:36:41.868992 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868259 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-multus-socket-dir-parent\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.869746 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868279 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-host-run-k8s-cni-cncf-io\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.869746 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868296 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-etc-kubernetes\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.869746 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868311 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgd7r\" (UniqueName: \"kubernetes.io/projected/34658460-c105-4bd3-ac91-331037e66aba-kube-api-access-xgd7r\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.869746 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868355 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d2545279-ae71-4f4a-b734-a4af205eb331-etc-tuned\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.869746 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868359 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-dbus\") pod \"global-pull-secret-syncer-mxgbv\" (UID: \"ee071d67-b30e-43c6-bc8b-6ef2cd711a52\") " pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:36:41.869746 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868389 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2545279-ae71-4f4a-b734-a4af205eb331-tmp\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.869746 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868392 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c8b95a44-c78b-4967-a62d-3614d181f9d2-iptables-alerter-script\") pod \"iptables-alerter-m4n2w\" (UID: \"c8b95a44-c78b-4967-a62d-3614d181f9d2\") " pod="openshift-network-operator/iptables-alerter-m4n2w" Jul 07 17:36:41.869746 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868407 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4451a20c-e7df-4dd2-8fbb-61908e7d0789-device-dir\") pod \"aws-ebs-csi-driver-node-z85ch\" (UID: \"4451a20c-e7df-4dd2-8fbb-61908e7d0789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z85ch" Jul 07 17:36:41.869746 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868418 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-host-run-ovn-kubernetes\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.869746 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868433 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-system-cni-dir\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.869746 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868447 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-etc-kubernetes\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.869746 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868460 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-hostroot\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.869746 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868493 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xskl\" (UniqueName: \"kubernetes.io/projected/c8b95a44-c78b-4967-a62d-3614d181f9d2-kube-api-access-2xskl\") pod \"iptables-alerter-m4n2w\" (UID: \"c8b95a44-c78b-4967-a62d-3614d181f9d2\") " pod="openshift-network-operator/iptables-alerter-m4n2w" Jul 07 17:36:41.869746 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868497 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4451a20c-e7df-4dd2-8fbb-61908e7d0789-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z85ch\" (UID: \"4451a20c-e7df-4dd2-8fbb-61908e7d0789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z85ch" Jul 07 17:36:41.869746 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868629 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-multus-cni-dir\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.869746 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868646 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-multus-socket-dir-parent\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.869746 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868663 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-host-run-multus-certs\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.869746 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868704 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-host-run-k8s-cni-cncf-io\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.870484 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868706 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-host-run-multus-certs\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.870484 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868708 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-run-systemd\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.870484 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868759 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de-system-cni-dir\") pod \"multus-additional-cni-plugins-7zgc6\" (UID: \"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de\") " pod="openshift-multus/multus-additional-cni-plugins-7zgc6" Jul 07 17:36:41.870484 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868767 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-multus-cni-dir\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.870484 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868800 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7zgc6\" (UID: \"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de\") " pod="openshift-multus/multus-additional-cni-plugins-7zgc6" Jul 07 17:36:41.870484 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868830 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8m5f\" (UniqueName: \"kubernetes.io/projected/0ff7ea17-d539-44d4-8c47-b9f1f6a145b6-kube-api-access-m8m5f\") pod \"node-ca-5bd9q\" (UID: \"0ff7ea17-d539-44d4-8c47-b9f1f6a145b6\") " pod="openshift-image-registry/node-ca-5bd9q" Jul 07 17:36:41.870484 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868848 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/93fb588c-7c14-4b9d-b465-fe362d2c3512-konnectivity-ca\") pod \"konnectivity-agent-bwgg5\" (UID: \"93fb588c-7c14-4b9d-b465-fe362d2c3512\") " pod="kube-system/konnectivity-agent-bwgg5" Jul 07 17:36:41.870484 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.868870 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-cnibin\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.870484 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.869032 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-etc-sysconfig\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.870484 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.869044 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-cnibin\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.870484 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.869053 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-host-cni-bin\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.870484 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.869089 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de-cnibin\") pod \"multus-additional-cni-plugins-7zgc6\" (UID: \"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de\") " pod="openshift-multus/multus-additional-cni-plugins-7zgc6" Jul 07 17:36:41.870484 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.869131 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de-cni-binary-copy\") pod \"multus-additional-cni-plugins-7zgc6\" (UID: \"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de\") " pod="openshift-multus/multus-additional-cni-plugins-7zgc6" Jul 07 17:36:41.870484 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.869190 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-original-pull-secret\") pod \"global-pull-secret-syncer-mxgbv\" (UID: \"ee071d67-b30e-43c6-bc8b-6ef2cd711a52\") " pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:36:41.870484 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.869235 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-sys\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.870484 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:41.869280 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 17:36:41.870484 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.869323 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-lib-modules\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.871098 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:41.869355 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-original-pull-secret podName:ee071d67-b30e-43c6-bc8b-6ef2cd711a52 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:42.369335039 +0000 UTC m=+2.951341778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-original-pull-secret") pod "global-pull-secret-syncer-mxgbv" (UID: "ee071d67-b30e-43c6-bc8b-6ef2cd711a52") : object "kube-system"/"original-pull-secret" not registered Jul 07 17:36:41.871098 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.869412 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-host-slash\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.871098 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.869436 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-host-run-netns\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.871098 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.869460 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ff7ea17-d539-44d4-8c47-b9f1f6a145b6-host\") pod \"node-ca-5bd9q\" (UID: \"0ff7ea17-d539-44d4-8c47-b9f1f6a145b6\") " pod="openshift-image-registry/node-ca-5bd9q" Jul 07 17:36:41.871098 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.869478 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2a75a377-7143-4174-94c5-4c50edb05db7-hosts-file\") pod \"node-resolver-ng458\" (UID: \"2a75a377-7143-4174-94c5-4c50edb05db7\") " pod="openshift-dns/node-resolver-ng458" Jul 07 17:36:41.871098 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.869520 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-var-lib-openvswitch\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.871098 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.869527 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ff7ea17-d539-44d4-8c47-b9f1f6a145b6-host\") pod \"node-ca-5bd9q\" (UID: \"0ff7ea17-d539-44d4-8c47-b9f1f6a145b6\") " pod="openshift-image-registry/node-ca-5bd9q" Jul 07 17:36:41.871098 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.869575 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/058bbf81-9eba-48d5-8d6f-119c027acd4c-env-overrides\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.871098 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.869629 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2a75a377-7143-4174-94c5-4c50edb05db7-hosts-file\") pod \"node-resolver-ng458\" (UID: \"2a75a377-7143-4174-94c5-4c50edb05db7\") " pod="openshift-dns/node-resolver-ng458" Jul 07 17:36:41.871098 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.869671 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/93fb588c-7c14-4b9d-b465-fe362d2c3512-agent-certs\") pod \"konnectivity-agent-bwgg5\" (UID: \"93fb588c-7c14-4b9d-b465-fe362d2c3512\") " pod="kube-system/konnectivity-agent-bwgg5" Jul 07 17:36:41.871098 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.869698 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/169258da-bb2c-4e58-8e93-447b39ef7da2-metrics-certs\") pod \"network-metrics-daemon-nrwlq\" (UID: \"169258da-bb2c-4e58-8e93-447b39ef7da2\") " pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:36:41.871098 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.869724 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34658460-c105-4bd3-ac91-331037e66aba-cni-binary-copy\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.871098 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:41.869811 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:36:41.871098 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.869827 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/058bbf81-9eba-48d5-8d6f-119c027acd4c-ovnkube-config\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.871098 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:41.869859 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/169258da-bb2c-4e58-8e93-447b39ef7da2-metrics-certs podName:169258da-bb2c-4e58-8e93-447b39ef7da2 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:42.369844089 +0000 UTC m=+2.951850817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/169258da-bb2c-4e58-8e93-447b39ef7da2-metrics-certs") pod "network-metrics-daemon-nrwlq" (UID: "169258da-bb2c-4e58-8e93-447b39ef7da2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:36:41.871098 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.869880 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/058bbf81-9eba-48d5-8d6f-119c027acd4c-ovn-node-metrics-cert\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.871847 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.869911 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-host-var-lib-cni-multus\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.871847 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.869937 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-host-var-lib-kubelet\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.871847 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.869977 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-etc-kubernetes\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.871847 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.869985 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-host-var-lib-cni-multus\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.871847 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.870003 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-etc-openvswitch\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.871847 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.870000 2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 17:36:41.871847 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.870022 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34658460-c105-4bd3-ac91-331037e66aba-host-var-lib-kubelet\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.871847 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.870045 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.871847 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.870077 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-systemd-units\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.871847 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.870099 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-run-ovn\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.871847 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.870126 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-node-log\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.871847 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.870150 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv7lk\" (UniqueName: \"kubernetes.io/projected/058bbf81-9eba-48d5-8d6f-119c027acd4c-kube-api-access-tv7lk\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.871847 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.870175 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7zgc6\" (UID: \"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de\") " pod="openshift-multus/multus-additional-cni-plugins-7zgc6" Jul 07 17:36:41.871847 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.870276 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34658460-c105-4bd3-ac91-331037e66aba-cni-binary-copy\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.873539 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:41.873463 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 17:36:41.873539 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:41.873485 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 17:36:41.873539 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:41.873497 2552 projected.go:196] Error preparing data for projected volume kube-api-access-d2bnk for pod openshift-network-diagnostics/network-check-target-mcxjj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:36:41.873539 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:41.873538 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b7e95da-8e96-4bbc-9579-8850344048c8-kube-api-access-d2bnk podName:4b7e95da-8e96-4bbc-9579-8850344048c8 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:42.373525575 +0000 UTC m=+2.955532321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-d2bnk" (UniqueName: "kubernetes.io/projected/4b7e95da-8e96-4bbc-9579-8850344048c8-kube-api-access-d2bnk") pod "network-check-target-mcxjj" (UID: "4b7e95da-8e96-4bbc-9579-8850344048c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:36:41.873916 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.873895 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/93fb588c-7c14-4b9d-b465-fe362d2c3512-agent-certs\") pod \"konnectivity-agent-bwgg5\" (UID: \"93fb588c-7c14-4b9d-b465-fe362d2c3512\") " pod="kube-system/konnectivity-agent-bwgg5" Jul 07 17:36:41.876274 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.876243 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5l5m\" (UniqueName: \"kubernetes.io/projected/2a75a377-7143-4174-94c5-4c50edb05db7-kube-api-access-c5l5m\") pod \"node-resolver-ng458\" (UID: \"2a75a377-7143-4174-94c5-4c50edb05db7\") " pod="openshift-dns/node-resolver-ng458" Jul 07 17:36:41.876498 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.876477 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7vw7\" (UniqueName: \"kubernetes.io/projected/4451a20c-e7df-4dd2-8fbb-61908e7d0789-kube-api-access-b7vw7\") pod \"aws-ebs-csi-driver-node-z85ch\" (UID: \"4451a20c-e7df-4dd2-8fbb-61908e7d0789\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z85ch" Jul 07 17:36:41.876980 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.876958 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgd7r\" (UniqueName: \"kubernetes.io/projected/34658460-c105-4bd3-ac91-331037e66aba-kube-api-access-xgd7r\") pod \"multus-qhctz\" (UID: \"34658460-c105-4bd3-ac91-331037e66aba\") " pod="openshift-multus/multus-qhctz" Jul 07 17:36:41.877666 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.877644 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpc9l\" (UniqueName: \"kubernetes.io/projected/169258da-bb2c-4e58-8e93-447b39ef7da2-kube-api-access-tpc9l\") pod \"network-metrics-daemon-nrwlq\" (UID: \"169258da-bb2c-4e58-8e93-447b39ef7da2\") " pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:36:41.877743 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.877727 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xskl\" (UniqueName: \"kubernetes.io/projected/c8b95a44-c78b-4967-a62d-3614d181f9d2-kube-api-access-2xskl\") pod \"iptables-alerter-m4n2w\" (UID: \"c8b95a44-c78b-4967-a62d-3614d181f9d2\") " pod="openshift-network-operator/iptables-alerter-m4n2w" Jul 07 17:36:41.878481 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.878461 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8m5f\" (UniqueName: \"kubernetes.io/projected/0ff7ea17-d539-44d4-8c47-b9f1f6a145b6-kube-api-access-m8m5f\") pod \"node-ca-5bd9q\" (UID: \"0ff7ea17-d539-44d4-8c47-b9f1f6a145b6\") " pod="openshift-image-registry/node-ca-5bd9q" Jul 07 17:36:41.970445 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.970331 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-96.ec2.internal" event={"ID":"9d6829a6c860a19c0346cab9c77c0d29","Type":"ContainerStarted","Data":"233e1151eebba62c36bd6420b3a819437cb6cc15e89dba2328adf0f14a9803e9"} Jul 07 17:36:41.970445 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.970421 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-host\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.970445 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.970444 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-host-cni-netd\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.970698 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.970460 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-etc-sysctl-conf\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.970698 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.970480 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqtvf\" (UniqueName: \"kubernetes.io/projected/d2545279-ae71-4f4a-b734-a4af205eb331-kube-api-access-tqtvf\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.970698 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.970504 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-run-openvswitch\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.970698 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.970521 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-host-cni-netd\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.970698 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.970593 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-host\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.970698 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.970630 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-etc-sysctl-d\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.970698 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.970656 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-log-socket\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.970698 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.970660 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-run-openvswitch\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.970698 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.970686 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-var-lib-kubelet\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.971092 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.970712 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvrdt\" (UniqueName: \"kubernetes.io/projected/e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de-kube-api-access-jvrdt\") pod \"multus-additional-cni-plugins-7zgc6\" (UID: \"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de\") " pod="openshift-multus/multus-additional-cni-plugins-7zgc6" Jul 07 17:36:41.971092 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.970751 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-log-socket\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.971092 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.970802 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-etc-sysctl-conf\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.971092 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.970837 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-etc-modprobe-d\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.971092 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.970854 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-var-lib-kubelet\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.971092 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.970868 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-etc-sysctl-d\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.971092 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.970885 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-etc-systemd\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.971092 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.970910 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-run\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.971092 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.970938 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d2545279-ae71-4f4a-b734-a4af205eb331-etc-tuned\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.971092 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.970944 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-etc-modprobe-d\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.971092 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.970940 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-etc-systemd\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.971092 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.970962 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2545279-ae71-4f4a-b734-a4af205eb331-tmp\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.971092 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.970980 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-run\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.971092 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.970986 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-host-run-ovn-kubernetes\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.971092 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971017 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-run-systemd\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.971092 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971041 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de-system-cni-dir\") pod \"multus-additional-cni-plugins-7zgc6\" (UID: \"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de\") " pod="openshift-multus/multus-additional-cni-plugins-7zgc6" Jul 07 17:36:41.971092 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971065 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7zgc6\" (UID: \"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de\") " pod="openshift-multus/multus-additional-cni-plugins-7zgc6" Jul 07 17:36:41.971902 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971081 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-host-run-ovn-kubernetes\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.971902 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971092 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-etc-sysconfig\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.971902 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971114 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-host-cni-bin\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.971902 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971116 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-run-systemd\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.971902 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971125 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de-system-cni-dir\") pod \"multus-additional-cni-plugins-7zgc6\" (UID: \"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de\") " pod="openshift-multus/multus-additional-cni-plugins-7zgc6" Jul 07 17:36:41.971902 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971136 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de-cnibin\") pod \"multus-additional-cni-plugins-7zgc6\" (UID: \"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de\") " pod="openshift-multus/multus-additional-cni-plugins-7zgc6" Jul 07 17:36:41.971902 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971175 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-etc-sysconfig\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.971902 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971182 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de-cnibin\") pod \"multus-additional-cni-plugins-7zgc6\" (UID: \"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de\") " pod="openshift-multus/multus-additional-cni-plugins-7zgc6" Jul 07 17:36:41.971902 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971240 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-host-cni-bin\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.971902 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971174 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de-cni-binary-copy\") pod \"multus-additional-cni-plugins-7zgc6\" (UID: \"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de\") " pod="openshift-multus/multus-additional-cni-plugins-7zgc6" Jul 07 17:36:41.971902 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971348 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-sys\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.971902 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971376 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-lib-modules\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.971902 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971403 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-host-slash\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.971902 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971444 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-host-slash\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.971902 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971492 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-sys\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.971902 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971518 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-host-run-netns\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.971902 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971538 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-lib-modules\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.972728 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971546 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-var-lib-openvswitch\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.972728 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971580 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-host-run-netns\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.972728 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971594 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/058bbf81-9eba-48d5-8d6f-119c027acd4c-env-overrides\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.972728 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971592 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-96.ec2.internal" event={"ID":"892566dbf19d8c368ae6d5de831bb733","Type":"ContainerStarted","Data":"8d1e48dc4bf2336af270d8caf2061e4e7658493f5bc17040ab4e852a626da62a"} Jul 07 17:36:41.972728 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971615 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-var-lib-openvswitch\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.972728 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971642 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/058bbf81-9eba-48d5-8d6f-119c027acd4c-ovnkube-config\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.972728 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971659 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7zgc6\" (UID: \"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de\") " pod="openshift-multus/multus-additional-cni-plugins-7zgc6" Jul 07 17:36:41.972728 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971676 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/058bbf81-9eba-48d5-8d6f-119c027acd4c-ovn-node-metrics-cert\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.972728 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971703 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-etc-kubernetes\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.972728 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971726 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-etc-openvswitch\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.972728 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971751 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.972728 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971777 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-systemd-units\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.972728 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971809 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-run-ovn\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.972728 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971833 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-node-log\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.972728 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971853 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv7lk\" (UniqueName: \"kubernetes.io/projected/058bbf81-9eba-48d5-8d6f-119c027acd4c-kube-api-access-tv7lk\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.972728 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971874 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7zgc6\" (UID: \"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de\") " pod="openshift-multus/multus-additional-cni-plugins-7zgc6" Jul 07 17:36:41.972728 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971882 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.973487 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971915 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-host-kubelet\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.973487 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971950 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2545279-ae71-4f4a-b734-a4af205eb331-etc-kubernetes\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.973487 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.971951 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/058bbf81-9eba-48d5-8d6f-119c027acd4c-ovnkube-script-lib\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.973487 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.972108 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/058bbf81-9eba-48d5-8d6f-119c027acd4c-env-overrides\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.973487 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.972136 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-systemd-units\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.973487 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.972163 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-etc-openvswitch\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.973487 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.972196 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de-os-release\") pod \"multus-additional-cni-plugins-7zgc6\" (UID: \"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de\") " pod="openshift-multus/multus-additional-cni-plugins-7zgc6" Jul 07 17:36:41.973487 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.972208 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/058bbf81-9eba-48d5-8d6f-119c027acd4c-ovnkube-config\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.973487 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.972224 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7zgc6\" (UID: \"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de\") " pod="openshift-multus/multus-additional-cni-plugins-7zgc6" Jul 07 17:36:41.973487 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.972266 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-run-ovn\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.973487 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.972306 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-host-kubelet\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.973487 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.972398 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7zgc6\" (UID: \"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de\") " pod="openshift-multus/multus-additional-cni-plugins-7zgc6" Jul 07 17:36:41.973487 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.972412 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/058bbf81-9eba-48d5-8d6f-119c027acd4c-node-log\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.973487 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.972577 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de-cni-binary-copy\") pod \"multus-additional-cni-plugins-7zgc6\" (UID: \"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de\") " pod="openshift-multus/multus-additional-cni-plugins-7zgc6" Jul 07 17:36:41.973487 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.972722 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de-os-release\") pod \"multus-additional-cni-plugins-7zgc6\" (UID: \"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de\") " pod="openshift-multus/multus-additional-cni-plugins-7zgc6" Jul 07 17:36:41.973487 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.972845 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7zgc6\" (UID: \"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de\") " pod="openshift-multus/multus-additional-cni-plugins-7zgc6" Jul 07 17:36:41.973487 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.972953 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/058bbf81-9eba-48d5-8d6f-119c027acd4c-ovnkube-script-lib\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.974370 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.973291 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d2545279-ae71-4f4a-b734-a4af205eb331-etc-tuned\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.974370 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.973469 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2545279-ae71-4f4a-b734-a4af205eb331-tmp\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.974686 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.974667 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/058bbf81-9eba-48d5-8d6f-119c027acd4c-ovn-node-metrics-cert\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:41.978724 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.978699 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqtvf\" (UniqueName: \"kubernetes.io/projected/d2545279-ae71-4f4a-b734-a4af205eb331-kube-api-access-tqtvf\") pod \"tuned-7m2wj\" (UID: \"d2545279-ae71-4f4a-b734-a4af205eb331\") " pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:41.979317 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.979285 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvrdt\" (UniqueName: \"kubernetes.io/projected/e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de-kube-api-access-jvrdt\") pod \"multus-additional-cni-plugins-7zgc6\" (UID: \"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de\") " pod="openshift-multus/multus-additional-cni-plugins-7zgc6" Jul 07 17:36:41.980512 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:41.980490 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv7lk\" (UniqueName: \"kubernetes.io/projected/058bbf81-9eba-48d5-8d6f-119c027acd4c-kube-api-access-tv7lk\") pod \"ovnkube-node-x765g\" (UID: \"058bbf81-9eba-48d5-8d6f-119c027acd4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:42.056570 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:42.056533 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m4n2w" Jul 07 17:36:42.063848 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:42.063821 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qhctz" Jul 07 17:36:42.076804 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:42.076780 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z85ch" Jul 07 17:36:42.081871 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:42.081852 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ng458" Jul 07 17:36:42.089776 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:42.089756 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5bd9q" Jul 07 17:36:42.097690 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:42.097672 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bwgg5" Jul 07 17:36:42.105381 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:42.105362 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" Jul 07 17:36:42.113105 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:42.113089 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:36:42.117849 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:42.117823 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7zgc6" Jul 07 17:36:42.375650 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:42.375559 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-original-pull-secret\") pod \"global-pull-secret-syncer-mxgbv\" (UID: \"ee071d67-b30e-43c6-bc8b-6ef2cd711a52\") " pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:36:42.375650 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:42.375611 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/169258da-bb2c-4e58-8e93-447b39ef7da2-metrics-certs\") pod \"network-metrics-daemon-nrwlq\" (UID: \"169258da-bb2c-4e58-8e93-447b39ef7da2\") " pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:36:42.375876 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:42.375718 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:36:42.375876 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:42.375748 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2bnk\" (UniqueName: \"kubernetes.io/projected/4b7e95da-8e96-4bbc-9579-8850344048c8-kube-api-access-d2bnk\") pod \"network-check-target-mcxjj\" (UID: \"4b7e95da-8e96-4bbc-9579-8850344048c8\") " pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:36:42.375876 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:42.375772 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/169258da-bb2c-4e58-8e93-447b39ef7da2-metrics-certs podName:169258da-bb2c-4e58-8e93-447b39ef7da2 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:43.375757111 +0000 UTC m=+3.957763834 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/169258da-bb2c-4e58-8e93-447b39ef7da2-metrics-certs") pod "network-metrics-daemon-nrwlq" (UID: "169258da-bb2c-4e58-8e93-447b39ef7da2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:36:42.375876 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:42.375720 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 17:36:42.375876 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:42.375826 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-original-pull-secret podName:ee071d67-b30e-43c6-bc8b-6ef2cd711a52 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:43.375813544 +0000 UTC m=+3.957820280 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-original-pull-secret") pod "global-pull-secret-syncer-mxgbv" (UID: "ee071d67-b30e-43c6-bc8b-6ef2cd711a52") : object "kube-system"/"original-pull-secret" not registered Jul 07 17:36:42.375876 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:42.375842 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 17:36:42.375876 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:42.375862 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 17:36:42.375876 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:42.375873 2552 projected.go:196] Error preparing data for projected volume kube-api-access-d2bnk for pod openshift-network-diagnostics/network-check-target-mcxjj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:36:42.376289 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:42.375917 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b7e95da-8e96-4bbc-9579-8850344048c8-kube-api-access-d2bnk podName:4b7e95da-8e96-4bbc-9579-8850344048c8 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:43.375905123 +0000 UTC m=+3.957911861 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-d2bnk" (UniqueName: "kubernetes.io/projected/4b7e95da-8e96-4bbc-9579-8850344048c8-kube-api-access-d2bnk") pod "network-check-target-mcxjj" (UID: "4b7e95da-8e96-4bbc-9579-8850344048c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:36:42.803492 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:42.803414 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 17:31:41 +0000 UTC" deadline="2028-01-03 15:22:26.347715907 +0000 UTC" Jul 07 17:36:42.803492 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:42.803441 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13077h45m43.544278416s" Jul 07 17:36:42.871068 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:42.870985 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93fb588c_7c14_4b9d_b465_fe362d2c3512.slice/crio-73f33ddfc9ba9fcc23f7477ddca484b1f86d8e8b1e5f5abdd97f41b8e20cab62 WatchSource:0}: Error finding container 73f33ddfc9ba9fcc23f7477ddca484b1f86d8e8b1e5f5abdd97f41b8e20cab62: Status 404 returned error can't find the container with id 73f33ddfc9ba9fcc23f7477ddca484b1f86d8e8b1e5f5abdd97f41b8e20cab62 Jul 07 17:36:42.872939 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:42.872715 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8b95a44_c78b_4967_a62d_3614d181f9d2.slice/crio-bac89e9675d79d0d555b9bccfa61c20799ebaf959a231f776ee525a1d939481a WatchSource:0}: Error finding container bac89e9675d79d0d555b9bccfa61c20799ebaf959a231f776ee525a1d939481a: Status 404 returned error can't find the container with id bac89e9675d79d0d555b9bccfa61c20799ebaf959a231f776ee525a1d939481a Jul 07 17:36:42.875447 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:42.875414 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2545279_ae71_4f4a_b734_a4af205eb331.slice/crio-c636afc2b0d51feba2d45f5171ca8dc13e855737923f3ba79f8900a3c2979d08 WatchSource:0}: Error finding container c636afc2b0d51feba2d45f5171ca8dc13e855737923f3ba79f8900a3c2979d08: Status 404 returned error can't find the container with id c636afc2b0d51feba2d45f5171ca8dc13e855737923f3ba79f8900a3c2979d08 Jul 07 17:36:42.876042 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:42.876025 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ff7ea17_d539_44d4_8c47_b9f1f6a145b6.slice/crio-d697739efef3cb6a77a1e6f25f1c562a0c4c39ab72b6503a89bd6ed9dc010b96 WatchSource:0}: Error finding container d697739efef3cb6a77a1e6f25f1c562a0c4c39ab72b6503a89bd6ed9dc010b96: Status 404 returned error can't find the container with id d697739efef3cb6a77a1e6f25f1c562a0c4c39ab72b6503a89bd6ed9dc010b96 Jul 07 17:36:42.876880 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:42.876758 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34658460_c105_4bd3_ac91_331037e66aba.slice/crio-266400da62d3cc837853712ca9f29db77d0ab5f9df9eece4ac6fa834ea908bc5 WatchSource:0}: Error finding container 266400da62d3cc837853712ca9f29db77d0ab5f9df9eece4ac6fa834ea908bc5: Status 404 returned error can't find the container with id 266400da62d3cc837853712ca9f29db77d0ab5f9df9eece4ac6fa834ea908bc5 Jul 07 17:36:42.878558 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:42.878541 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod058bbf81_9eba_48d5_8d6f_119c027acd4c.slice/crio-e6b073bc488916b2edd9995358d1a41a8ea20d7dec79743328e8fb547d660c8f WatchSource:0}: Error finding container e6b073bc488916b2edd9995358d1a41a8ea20d7dec79743328e8fb547d660c8f: Status 404 returned error can't find the container with id e6b073bc488916b2edd9995358d1a41a8ea20d7dec79743328e8fb547d660c8f Jul 07 17:36:42.879369 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:42.879187 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3b2fad9_1356_4ebf_89c3_5a4e2a35c1de.slice/crio-dd37369672a8d49da8a4aebbcf6912b6bfe12af00f383f37a220f9b9261f2ae5 WatchSource:0}: Error finding container dd37369672a8d49da8a4aebbcf6912b6bfe12af00f383f37a220f9b9261f2ae5: Status 404 returned error can't find the container with id dd37369672a8d49da8a4aebbcf6912b6bfe12af00f383f37a220f9b9261f2ae5 Jul 07 17:36:42.880089 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:42.880065 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a75a377_7143_4174_94c5_4c50edb05db7.slice/crio-3763aefab281c247a8c7186a6dd07a1b2f63c02bfb2a7ce1fe7d076781d6590f WatchSource:0}: Error finding container 3763aefab281c247a8c7186a6dd07a1b2f63c02bfb2a7ce1fe7d076781d6590f: Status 404 returned error can't find the container with id 3763aefab281c247a8c7186a6dd07a1b2f63c02bfb2a7ce1fe7d076781d6590f Jul 07 17:36:42.881530 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:36:42.881457 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4451a20c_e7df_4dd2_8fbb_61908e7d0789.slice/crio-407ea73f06a6e6ea7858e6540a698f7978d59aa87baa0fc724c1821841b777e9 WatchSource:0}: Error finding container 407ea73f06a6e6ea7858e6540a698f7978d59aa87baa0fc724c1821841b777e9: Status 404 returned error can't find the container with id 407ea73f06a6e6ea7858e6540a698f7978d59aa87baa0fc724c1821841b777e9 Jul 07 17:36:42.966620 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:42.966481 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:36:42.966728 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:42.966533 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:36:42.966779 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:42.966736 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrwlq" podUID="169258da-bb2c-4e58-8e93-447b39ef7da2" Jul 07 17:36:42.966837 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:42.966782 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxgbv" podUID="ee071d67-b30e-43c6-bc8b-6ef2cd711a52" Jul 07 17:36:42.975380 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:42.975357 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-96.ec2.internal" event={"ID":"9d6829a6c860a19c0346cab9c77c0d29","Type":"ContainerStarted","Data":"185e27036b539441b8fcd6d969739d1401821b0353b98baa608edbc25c76837a"} Jul 07 17:36:42.976466 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:42.976431 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z85ch" event={"ID":"4451a20c-e7df-4dd2-8fbb-61908e7d0789","Type":"ContainerStarted","Data":"407ea73f06a6e6ea7858e6540a698f7978d59aa87baa0fc724c1821841b777e9"} Jul 07 17:36:42.977446 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:42.977421 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ng458" event={"ID":"2a75a377-7143-4174-94c5-4c50edb05db7","Type":"ContainerStarted","Data":"3763aefab281c247a8c7186a6dd07a1b2f63c02bfb2a7ce1fe7d076781d6590f"} Jul 07 17:36:42.980908 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:42.980884 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x765g" event={"ID":"058bbf81-9eba-48d5-8d6f-119c027acd4c","Type":"ContainerStarted","Data":"e6b073bc488916b2edd9995358d1a41a8ea20d7dec79743328e8fb547d660c8f"} Jul 07 17:36:42.982052 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:42.982033 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qhctz" event={"ID":"34658460-c105-4bd3-ac91-331037e66aba","Type":"ContainerStarted","Data":"266400da62d3cc837853712ca9f29db77d0ab5f9df9eece4ac6fa834ea908bc5"} Jul 07 17:36:42.983070 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:42.983043 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m4n2w" event={"ID":"c8b95a44-c78b-4967-a62d-3614d181f9d2","Type":"ContainerStarted","Data":"bac89e9675d79d0d555b9bccfa61c20799ebaf959a231f776ee525a1d939481a"} Jul 07 17:36:42.983986 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:42.983968 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7zgc6" event={"ID":"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de","Type":"ContainerStarted","Data":"dd37369672a8d49da8a4aebbcf6912b6bfe12af00f383f37a220f9b9261f2ae5"} Jul 07 17:36:42.987823 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:42.987801 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5bd9q" event={"ID":"0ff7ea17-d539-44d4-8c47-b9f1f6a145b6","Type":"ContainerStarted","Data":"d697739efef3cb6a77a1e6f25f1c562a0c4c39ab72b6503a89bd6ed9dc010b96"} Jul 07 17:36:42.990486 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:42.990464 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" event={"ID":"d2545279-ae71-4f4a-b734-a4af205eb331","Type":"ContainerStarted","Data":"c636afc2b0d51feba2d45f5171ca8dc13e855737923f3ba79f8900a3c2979d08"} Jul 07 17:36:42.992144 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:42.992102 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-96.ec2.internal" podStartSLOduration=1.9920887870000001 podStartE2EDuration="1.992088787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:36:42.991932025 +0000 UTC m=+3.573938789" watchObservedRunningTime="2026-07-07 17:36:42.992088787 +0000 UTC m=+3.574095533" Jul 07 17:36:42.993754 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:42.993736 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bwgg5" event={"ID":"93fb588c-7c14-4b9d-b465-fe362d2c3512","Type":"ContainerStarted","Data":"73f33ddfc9ba9fcc23f7477ddca484b1f86d8e8b1e5f5abdd97f41b8e20cab62"} Jul 07 17:36:43.383544 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:43.383462 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-original-pull-secret\") pod \"global-pull-secret-syncer-mxgbv\" (UID: \"ee071d67-b30e-43c6-bc8b-6ef2cd711a52\") " pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:36:43.383544 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:43.383520 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/169258da-bb2c-4e58-8e93-447b39ef7da2-metrics-certs\") pod \"network-metrics-daemon-nrwlq\" (UID: \"169258da-bb2c-4e58-8e93-447b39ef7da2\") " pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:36:43.383747 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:43.383556 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2bnk\" (UniqueName: \"kubernetes.io/projected/4b7e95da-8e96-4bbc-9579-8850344048c8-kube-api-access-d2bnk\") pod \"network-check-target-mcxjj\" (UID: \"4b7e95da-8e96-4bbc-9579-8850344048c8\") " pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:36:43.383747 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:43.383726 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 17:36:43.383747 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:43.383748 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 17:36:43.383907 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:43.383760 2552 projected.go:196] Error preparing data for projected volume kube-api-access-d2bnk for pod openshift-network-diagnostics/network-check-target-mcxjj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:36:43.383907 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:43.383821 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b7e95da-8e96-4bbc-9579-8850344048c8-kube-api-access-d2bnk podName:4b7e95da-8e96-4bbc-9579-8850344048c8 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:45.383804341 +0000 UTC m=+5.965811080 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-d2bnk" (UniqueName: "kubernetes.io/projected/4b7e95da-8e96-4bbc-9579-8850344048c8-kube-api-access-d2bnk") pod "network-check-target-mcxjj" (UID: "4b7e95da-8e96-4bbc-9579-8850344048c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:36:43.384258 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:43.384242 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:36:43.384330 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:43.384278 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 17:36:43.384330 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:43.384317 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/169258da-bb2c-4e58-8e93-447b39ef7da2-metrics-certs podName:169258da-bb2c-4e58-8e93-447b39ef7da2 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:45.384282897 +0000 UTC m=+5.966289832 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/169258da-bb2c-4e58-8e93-447b39ef7da2-metrics-certs") pod "network-metrics-daemon-nrwlq" (UID: "169258da-bb2c-4e58-8e93-447b39ef7da2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:36:43.384435 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:43.384355 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-original-pull-secret podName:ee071d67-b30e-43c6-bc8b-6ef2cd711a52 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:45.38433684 +0000 UTC m=+5.966343578 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-original-pull-secret") pod "global-pull-secret-syncer-mxgbv" (UID: "ee071d67-b30e-43c6-bc8b-6ef2cd711a52") : object "kube-system"/"original-pull-secret" not registered Jul 07 17:36:43.804643 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:43.804531 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 17:31:41 +0000 UTC" deadline="2028-01-21 16:31:11.67966988 +0000 UTC" Jul 07 17:36:43.804643 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:43.804592 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13510h54m27.875081985s" Jul 07 17:36:43.969009 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:43.968978 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:36:43.969158 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:43.969089 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcxjj" podUID="4b7e95da-8e96-4bbc-9579-8850344048c8" Jul 07 17:36:44.007317 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:44.005523 2552 generic.go:356] "Generic (PLEG): container finished" podID="892566dbf19d8c368ae6d5de831bb733" containerID="5bf286065d0a4b9221f2f9622114c4331315e827a9bd2a25fba75cac3e7e7777" exitCode=0 Jul 07 17:36:44.007317 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:44.006462 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-96.ec2.internal" event={"ID":"892566dbf19d8c368ae6d5de831bb733","Type":"ContainerDied","Data":"5bf286065d0a4b9221f2f9622114c4331315e827a9bd2a25fba75cac3e7e7777"} Jul 07 17:36:44.967125 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:44.966476 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:36:44.967125 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:44.966610 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxgbv" podUID="ee071d67-b30e-43c6-bc8b-6ef2cd711a52" Jul 07 17:36:44.967125 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:44.966962 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:36:44.967125 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:44.967063 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrwlq" podUID="169258da-bb2c-4e58-8e93-447b39ef7da2" Jul 07 17:36:45.024602 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:45.024567 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-96.ec2.internal" event={"ID":"892566dbf19d8c368ae6d5de831bb733","Type":"ContainerStarted","Data":"678ff30d512202a37301e6c7afb9daab01d326f63e0d9933606e0cbd45e4727e"} Jul 07 17:36:45.039125 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:45.039063 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-96.ec2.internal" podStartSLOduration=4.039042932 podStartE2EDuration="4.039042932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:36:45.038808896 +0000 UTC m=+5.620815640" watchObservedRunningTime="2026-07-07 17:36:45.039042932 +0000 UTC m=+5.621049678" Jul 07 17:36:45.401409 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:45.401322 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/169258da-bb2c-4e58-8e93-447b39ef7da2-metrics-certs\") pod \"network-metrics-daemon-nrwlq\" (UID: \"169258da-bb2c-4e58-8e93-447b39ef7da2\") " pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:36:45.401409 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:45.401388 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2bnk\" (UniqueName: \"kubernetes.io/projected/4b7e95da-8e96-4bbc-9579-8850344048c8-kube-api-access-d2bnk\") pod \"network-check-target-mcxjj\" (UID: \"4b7e95da-8e96-4bbc-9579-8850344048c8\") " pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:36:45.401634 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:45.401454 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-original-pull-secret\") pod \"global-pull-secret-syncer-mxgbv\" (UID: \"ee071d67-b30e-43c6-bc8b-6ef2cd711a52\") " pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:36:45.401634 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:45.401511 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:36:45.401634 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:45.401561 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 17:36:45.401634 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:45.401583 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/169258da-bb2c-4e58-8e93-447b39ef7da2-metrics-certs podName:169258da-bb2c-4e58-8e93-447b39ef7da2 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:49.401562856 +0000 UTC m=+9.983569601 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/169258da-bb2c-4e58-8e93-447b39ef7da2-metrics-certs") pod "network-metrics-daemon-nrwlq" (UID: "169258da-bb2c-4e58-8e93-447b39ef7da2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:36:45.401634 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:45.401612 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-original-pull-secret podName:ee071d67-b30e-43c6-bc8b-6ef2cd711a52 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:49.401595994 +0000 UTC m=+9.983602738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-original-pull-secret") pod "global-pull-secret-syncer-mxgbv" (UID: "ee071d67-b30e-43c6-bc8b-6ef2cd711a52") : object "kube-system"/"original-pull-secret" not registered Jul 07 17:36:45.401894 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:45.401687 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 17:36:45.401894 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:45.401701 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 17:36:45.401894 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:45.401713 2552 projected.go:196] Error preparing data for projected volume kube-api-access-d2bnk for pod openshift-network-diagnostics/network-check-target-mcxjj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:36:45.401894 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:45.401746 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b7e95da-8e96-4bbc-9579-8850344048c8-kube-api-access-d2bnk podName:4b7e95da-8e96-4bbc-9579-8850344048c8 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:49.401735442 +0000 UTC m=+9.983742165 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-d2bnk" (UniqueName: "kubernetes.io/projected/4b7e95da-8e96-4bbc-9579-8850344048c8-kube-api-access-d2bnk") pod "network-check-target-mcxjj" (UID: "4b7e95da-8e96-4bbc-9579-8850344048c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:36:45.966884 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:45.966770 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:36:45.976524 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:45.974872 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcxjj" podUID="4b7e95da-8e96-4bbc-9579-8850344048c8" Jul 07 17:36:46.966101 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:46.966071 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:36:46.966101 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:46.966089 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:36:46.966362 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:46.966215 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrwlq" podUID="169258da-bb2c-4e58-8e93-447b39ef7da2" Jul 07 17:36:46.966427 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:46.966397 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxgbv" podUID="ee071d67-b30e-43c6-bc8b-6ef2cd711a52" Jul 07 17:36:47.966113 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:47.965986 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:36:47.966559 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:47.966112 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcxjj" podUID="4b7e95da-8e96-4bbc-9579-8850344048c8" Jul 07 17:36:48.967067 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:48.966446 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:36:48.967067 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:48.966569 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrwlq" podUID="169258da-bb2c-4e58-8e93-447b39ef7da2" Jul 07 17:36:48.967067 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:48.966938 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:36:48.967067 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:48.967032 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxgbv" podUID="ee071d67-b30e-43c6-bc8b-6ef2cd711a52" Jul 07 17:36:49.432316 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:49.432222 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-original-pull-secret\") pod \"global-pull-secret-syncer-mxgbv\" (UID: \"ee071d67-b30e-43c6-bc8b-6ef2cd711a52\") " pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:36:49.432316 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:49.432270 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/169258da-bb2c-4e58-8e93-447b39ef7da2-metrics-certs\") pod \"network-metrics-daemon-nrwlq\" (UID: \"169258da-bb2c-4e58-8e93-447b39ef7da2\") " pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:36:49.432514 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:49.432394 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:36:49.432514 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:49.432398 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 17:36:49.432514 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:49.432453 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/169258da-bb2c-4e58-8e93-447b39ef7da2-metrics-certs podName:169258da-bb2c-4e58-8e93-447b39ef7da2 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:57.432435769 +0000 UTC m=+18.014442493 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/169258da-bb2c-4e58-8e93-447b39ef7da2-metrics-certs") pod "network-metrics-daemon-nrwlq" (UID: "169258da-bb2c-4e58-8e93-447b39ef7da2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:36:49.432514 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:49.432468 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-original-pull-secret podName:ee071d67-b30e-43c6-bc8b-6ef2cd711a52 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:57.432460192 +0000 UTC m=+18.014466915 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-original-pull-secret") pod "global-pull-secret-syncer-mxgbv" (UID: "ee071d67-b30e-43c6-bc8b-6ef2cd711a52") : object "kube-system"/"original-pull-secret" not registered Jul 07 17:36:49.432514 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:49.432486 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2bnk\" (UniqueName: \"kubernetes.io/projected/4b7e95da-8e96-4bbc-9579-8850344048c8-kube-api-access-d2bnk\") pod \"network-check-target-mcxjj\" (UID: \"4b7e95da-8e96-4bbc-9579-8850344048c8\") " pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:36:49.432758 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:49.432632 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 17:36:49.432758 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:49.432651 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 17:36:49.432758 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:49.432663 2552 projected.go:196] Error preparing data for projected volume kube-api-access-d2bnk for pod openshift-network-diagnostics/network-check-target-mcxjj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:36:49.432758 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:49.432706 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b7e95da-8e96-4bbc-9579-8850344048c8-kube-api-access-d2bnk podName:4b7e95da-8e96-4bbc-9579-8850344048c8 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:57.43269361 +0000 UTC m=+18.014700337 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-d2bnk" (UniqueName: "kubernetes.io/projected/4b7e95da-8e96-4bbc-9579-8850344048c8-kube-api-access-d2bnk") pod "network-check-target-mcxjj" (UID: "4b7e95da-8e96-4bbc-9579-8850344048c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:36:49.966661 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:49.966631 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:36:49.966822 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:49.966726 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcxjj" podUID="4b7e95da-8e96-4bbc-9579-8850344048c8" Jul 07 17:36:50.966328 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:50.966277 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:36:50.966791 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:50.966337 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:36:50.966791 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:50.966441 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrwlq" podUID="169258da-bb2c-4e58-8e93-447b39ef7da2" Jul 07 17:36:50.966791 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:50.966524 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxgbv" podUID="ee071d67-b30e-43c6-bc8b-6ef2cd711a52" Jul 07 17:36:51.966275 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:51.966243 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:36:51.966462 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:51.966377 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcxjj" podUID="4b7e95da-8e96-4bbc-9579-8850344048c8" Jul 07 17:36:52.967005 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:52.966405 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:36:52.967005 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:52.966535 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrwlq" podUID="169258da-bb2c-4e58-8e93-447b39ef7da2" Jul 07 17:36:52.967005 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:52.966880 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:36:52.967005 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:52.966968 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxgbv" podUID="ee071d67-b30e-43c6-bc8b-6ef2cd711a52" Jul 07 17:36:53.048719 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:53.048442 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z85ch" event={"ID":"4451a20c-e7df-4dd2-8fbb-61908e7d0789","Type":"ContainerStarted","Data":"d5e4d6fa9adc20283a0fdd4ccd9a2dc3db653a91f744f1006650c39765387ce5"} Jul 07 17:36:53.051231 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:53.051204 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ng458" event={"ID":"2a75a377-7143-4174-94c5-4c50edb05db7","Type":"ContainerStarted","Data":"d25c86bff24e50d1d4e0c7687d4216185087c1f482e9daeb5b607997b9155606"} Jul 07 17:36:53.054683 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:53.054627 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7zgc6" event={"ID":"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de","Type":"ContainerStarted","Data":"e719901b295cbacb89e145709ae8d9285ade900102e6f28c8a0776732cbff159"} Jul 07 17:36:53.058532 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:53.057239 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5bd9q" event={"ID":"0ff7ea17-d539-44d4-8c47-b9f1f6a145b6","Type":"ContainerStarted","Data":"e185f1d05260ebfac15b4e54b765116287a77c5224465c0c4218a20afe879468"} Jul 07 17:36:53.065502 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:53.065463 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bwgg5" event={"ID":"93fb588c-7c14-4b9d-b465-fe362d2c3512","Type":"ContainerStarted","Data":"51db2aac6ed6de6c72e07a80c2b02ea9980bab0300f61a3318bf0a2b28de0127"} Jul 07 17:36:53.091928 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:53.091826 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5bd9q" podStartSLOduration=3.3749717439999998 podStartE2EDuration="13.091807027s" totalImagesPullingTime="9.716835283s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:36:53.091141457 +0000 UTC m=+13.673148201" watchObservedRunningTime="2026-07-07 17:36:53.091807027 +0000 UTC m=+13.673813773" Jul 07 17:36:53.966721 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:53.966689 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:36:53.966896 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:53.966806 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcxjj" podUID="4b7e95da-8e96-4bbc-9579-8850344048c8" Jul 07 17:36:54.068612 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:54.068567 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" event={"ID":"d2545279-ae71-4f4a-b734-a4af205eb331","Type":"ContainerStarted","Data":"82d9d1a4e47081430187995f58d081005dec00300aea613e5ba458f912749ee3"} Jul 07 17:36:54.070182 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:54.070148 2552 generic.go:356] "Generic (PLEG): container finished" podID="e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de" containerID="e719901b295cbacb89e145709ae8d9285ade900102e6f28c8a0776732cbff159" exitCode=0 Jul 07 17:36:54.070320 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:54.070255 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7zgc6" event={"ID":"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de","Type":"ContainerDied","Data":"e719901b295cbacb89e145709ae8d9285ade900102e6f28c8a0776732cbff159"} Jul 07 17:36:54.083695 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:54.083650 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bwgg5" podStartSLOduration=4.383073951 podStartE2EDuration="14.083632305s" totalImagesPullingTime="9.700558354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:36:53.107678482 +0000 UTC m=+13.689685228" watchObservedRunningTime="2026-07-07 17:36:54.083632305 +0000 UTC m=+14.665639051" Jul 07 17:36:54.083794 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:54.083752 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7m2wj" podStartSLOduration=4.092252418 podStartE2EDuration="14.083745961s" totalImagesPullingTime="9.991493543s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:36:54.083106944 +0000 UTC m=+14.665113715" watchObservedRunningTime="2026-07-07 17:36:54.083745961 +0000 UTC m=+14.665752706" Jul 07 17:36:54.095464 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:54.095428 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ng458" podStartSLOduration=4.140978321 podStartE2EDuration="14.095416702s" totalImagesPullingTime="9.954438381s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:36:54.095215807 +0000 UTC m=+14.677222555" watchObservedRunningTime="2026-07-07 17:36:54.095416702 +0000 UTC m=+14.677423446" Jul 07 17:36:54.966543 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:54.966510 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:36:54.966734 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:54.966635 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxgbv" podUID="ee071d67-b30e-43c6-bc8b-6ef2cd711a52" Jul 07 17:36:54.966734 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:54.966692 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:36:54.966842 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:54.966793 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrwlq" podUID="169258da-bb2c-4e58-8e93-447b39ef7da2" Jul 07 17:36:55.073644 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:55.073594 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m4n2w" event={"ID":"c8b95a44-c78b-4967-a62d-3614d181f9d2","Type":"ContainerStarted","Data":"7d3401fbe83e1c313ae65f8c8906356e126e57e3fcc9b3bfc37d6615e31c8162"} Jul 07 17:36:55.087640 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:55.087591 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-m4n2w" podStartSLOduration=5.368527664 podStartE2EDuration="15.087574471s" totalImagesPullingTime="9.719046807s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:36:55.087391311 +0000 UTC m=+15.669398058" watchObservedRunningTime="2026-07-07 17:36:55.087574471 +0000 UTC m=+15.669581218" Jul 07 17:36:55.393594 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:55.393553 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bwgg5" Jul 07 17:36:55.394200 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:55.394182 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bwgg5" Jul 07 17:36:55.966352 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:55.966316 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:36:55.966515 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:55.966450 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcxjj" podUID="4b7e95da-8e96-4bbc-9579-8850344048c8" Jul 07 17:36:56.075711 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:56.075679 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bwgg5" Jul 07 17:36:56.076333 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:56.076314 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bwgg5" Jul 07 17:36:56.966351 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:56.966314 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:36:56.966647 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:56.966314 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:36:56.966647 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:56.966444 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxgbv" podUID="ee071d67-b30e-43c6-bc8b-6ef2cd711a52" Jul 07 17:36:56.966647 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:56.966549 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrwlq" podUID="169258da-bb2c-4e58-8e93-447b39ef7da2" Jul 07 17:36:57.495650 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:57.495611 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2bnk\" (UniqueName: \"kubernetes.io/projected/4b7e95da-8e96-4bbc-9579-8850344048c8-kube-api-access-d2bnk\") pod \"network-check-target-mcxjj\" (UID: \"4b7e95da-8e96-4bbc-9579-8850344048c8\") " pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:36:57.496222 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:57.495694 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-original-pull-secret\") pod \"global-pull-secret-syncer-mxgbv\" (UID: \"ee071d67-b30e-43c6-bc8b-6ef2cd711a52\") " pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:36:57.496222 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:57.495727 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/169258da-bb2c-4e58-8e93-447b39ef7da2-metrics-certs\") pod \"network-metrics-daemon-nrwlq\" (UID: \"169258da-bb2c-4e58-8e93-447b39ef7da2\") " pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:36:57.496222 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:57.495788 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 17:36:57.496222 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:57.495808 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 17:36:57.496222 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:57.495808 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:36:57.496222 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:57.495823 2552 projected.go:196] Error preparing data for projected volume kube-api-access-d2bnk for pod openshift-network-diagnostics/network-check-target-mcxjj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:36:57.496222 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:57.495826 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 17:36:57.496222 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:57.495871 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b7e95da-8e96-4bbc-9579-8850344048c8-kube-api-access-d2bnk podName:4b7e95da-8e96-4bbc-9579-8850344048c8 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:13.495856853 +0000 UTC m=+34.077863605 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-d2bnk" (UniqueName: "kubernetes.io/projected/4b7e95da-8e96-4bbc-9579-8850344048c8-kube-api-access-d2bnk") pod "network-check-target-mcxjj" (UID: "4b7e95da-8e96-4bbc-9579-8850344048c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:36:57.496222 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:57.495885 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-original-pull-secret podName:ee071d67-b30e-43c6-bc8b-6ef2cd711a52 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:13.495878927 +0000 UTC m=+34.077885651 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-original-pull-secret") pod "global-pull-secret-syncer-mxgbv" (UID: "ee071d67-b30e-43c6-bc8b-6ef2cd711a52") : object "kube-system"/"original-pull-secret" not registered Jul 07 17:36:57.496222 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:57.495907 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/169258da-bb2c-4e58-8e93-447b39ef7da2-metrics-certs podName:169258da-bb2c-4e58-8e93-447b39ef7da2 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:13.495898397 +0000 UTC m=+34.077905120 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/169258da-bb2c-4e58-8e93-447b39ef7da2-metrics-certs") pod "network-metrics-daemon-nrwlq" (UID: "169258da-bb2c-4e58-8e93-447b39ef7da2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:36:57.965767 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:57.965731 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:36:57.965955 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:57.965930 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcxjj" podUID="4b7e95da-8e96-4bbc-9579-8850344048c8" Jul 07 17:36:58.965931 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:58.965731 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:36:58.966356 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:58.965816 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:36:58.966356 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:58.966027 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxgbv" podUID="ee071d67-b30e-43c6-bc8b-6ef2cd711a52" Jul 07 17:36:58.966356 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:58.966116 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrwlq" podUID="169258da-bb2c-4e58-8e93-447b39ef7da2" Jul 07 17:36:59.966611 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:36:59.966575 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:36:59.967054 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:36:59.966689 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcxjj" podUID="4b7e95da-8e96-4bbc-9579-8850344048c8" Jul 07 17:37:00.965839 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:00.965804 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:37:00.966017 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:00.965844 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:37:00.966017 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:00.965942 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrwlq" podUID="169258da-bb2c-4e58-8e93-447b39ef7da2" Jul 07 17:37:00.966126 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:00.966056 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxgbv" podUID="ee071d67-b30e-43c6-bc8b-6ef2cd711a52" Jul 07 17:37:01.966546 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:01.966381 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:37:01.966868 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:01.966633 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcxjj" podUID="4b7e95da-8e96-4bbc-9579-8850344048c8" Jul 07 17:37:02.089872 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:02.089844 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/ovn-acl-logging/0.log" Jul 07 17:37:02.090261 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:02.090232 2552 generic.go:356] "Generic (PLEG): container finished" podID="058bbf81-9eba-48d5-8d6f-119c027acd4c" containerID="212f62604f960843eaacd5b7a4cb0c3cfb35c351e409788b896e0bf8c92a417e" exitCode=1 Jul 07 17:37:02.090380 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:02.090341 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x765g" event={"ID":"058bbf81-9eba-48d5-8d6f-119c027acd4c","Type":"ContainerStarted","Data":"c379974a79c8d3888b9fce802260400e0446e9ea53b85f7783e7484d750231cd"} Jul 07 17:37:02.090450 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:02.090432 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x765g" event={"ID":"058bbf81-9eba-48d5-8d6f-119c027acd4c","Type":"ContainerStarted","Data":"c6e4b9b16ed3530707732ba08d7d59a06852977ad6671a5412e625624217cc07"} Jul 07 17:37:02.090516 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:02.090501 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x765g" event={"ID":"058bbf81-9eba-48d5-8d6f-119c027acd4c","Type":"ContainerStarted","Data":"0a683214222e83bb2ac09bf70c68b07867d7f4d92c43681b67760a0f3739c963"} Jul 07 17:37:02.090565 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:02.090555 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x765g" event={"ID":"058bbf81-9eba-48d5-8d6f-119c027acd4c","Type":"ContainerDied","Data":"212f62604f960843eaacd5b7a4cb0c3cfb35c351e409788b896e0bf8c92a417e"} Jul 07 17:37:02.090620 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:02.090605 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x765g" event={"ID":"058bbf81-9eba-48d5-8d6f-119c027acd4c","Type":"ContainerStarted","Data":"b64db44b716d3c7d5931105cc2f8437295aecd0faea51996d681200708740504"} Jul 07 17:37:02.091997 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:02.091957 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qhctz" event={"ID":"34658460-c105-4bd3-ac91-331037e66aba","Type":"ContainerStarted","Data":"32d24687c9f6ddabff8f523c8faa7f6d61d2abe93db4869475826daafc0192c6"} Jul 07 17:37:02.113551 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:02.113497 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qhctz" podStartSLOduration=3.539169139 podStartE2EDuration="22.11346934s" totalImagesPullingTime="18.574300201s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:02.112806813 +0000 UTC m=+22.694813582" watchObservedRunningTime="2026-07-07 17:37:02.11346934 +0000 UTC m=+22.695476084" Jul 07 17:37:02.585682 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:02.585661 2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 17:37:02.837110 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:02.836976 2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T17:37:02.58567559Z","UUID":"b1f2b834-61f3-4296-a853-ecc3e3d8faac","Handler":null,"Name":"","Endpoint":""} Jul 07 17:37:02.838417 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:02.838399 2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 17:37:02.838535 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:02.838437 2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 17:37:02.966485 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:02.966450 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:37:02.966701 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:02.966572 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxgbv" podUID="ee071d67-b30e-43c6-bc8b-6ef2cd711a52" Jul 07 17:37:02.966701 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:02.966616 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:37:02.967286 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:02.966714 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrwlq" podUID="169258da-bb2c-4e58-8e93-447b39ef7da2" Jul 07 17:37:03.096113 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:03.096031 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z85ch" event={"ID":"4451a20c-e7df-4dd2-8fbb-61908e7d0789","Type":"ContainerStarted","Data":"d074d2f096a4386e7b3fe8c955bb11500ed7900e3972945f16f5a21678802033"} Jul 07 17:37:03.099290 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:03.099266 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/ovn-acl-logging/0.log" Jul 07 17:37:03.099749 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:03.099719 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x765g" event={"ID":"058bbf81-9eba-48d5-8d6f-119c027acd4c","Type":"ContainerStarted","Data":"0fd3e561a1ac834865dd49deee0300d4dc0c8988c68f331745c6bf95037fbe7e"} Jul 07 17:37:03.966201 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:03.966166 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:37:03.966439 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:03.966290 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcxjj" podUID="4b7e95da-8e96-4bbc-9579-8850344048c8" Jul 07 17:37:04.966654 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:04.966623 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:37:04.966654 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:04.966644 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:37:04.967061 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:04.966733 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxgbv" podUID="ee071d67-b30e-43c6-bc8b-6ef2cd711a52" Jul 07 17:37:04.967061 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:04.966858 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrwlq" podUID="169258da-bb2c-4e58-8e93-447b39ef7da2" Jul 07 17:37:05.106413 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:05.106378 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z85ch" event={"ID":"4451a20c-e7df-4dd2-8fbb-61908e7d0789","Type":"ContainerStarted","Data":"b1ec5d7775746da034ffdea6bd0a8c74aea5d566e129a9f5ca793d78d391c04b"} Jul 07 17:37:05.109388 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:05.109366 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/ovn-acl-logging/0.log" Jul 07 17:37:05.109705 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:05.109688 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x765g" event={"ID":"058bbf81-9eba-48d5-8d6f-119c027acd4c","Type":"ContainerStarted","Data":"ba343dcb1c321ce0a028ed019fb65371bfd63bf2bc25bead61aad61d03895790"} Jul 07 17:37:05.123291 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:05.123244 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z85ch" podStartSLOduration=4.580393858 podStartE2EDuration="25.123233381s" totalImagesPullingTime="20.542839523s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:05.123070605 +0000 UTC m=+25.705077350" watchObservedRunningTime="2026-07-07 17:37:05.123233381 +0000 UTC m=+25.705240126" Jul 07 17:37:05.965748 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:05.965718 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:37:05.965898 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:05.965813 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcxjj" podUID="4b7e95da-8e96-4bbc-9579-8850344048c8" Jul 07 17:37:06.965935 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:06.965907 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:37:06.966458 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:06.966018 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrwlq" podUID="169258da-bb2c-4e58-8e93-447b39ef7da2" Jul 07 17:37:06.966458 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:06.966073 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:37:06.966458 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:06.966188 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxgbv" podUID="ee071d67-b30e-43c6-bc8b-6ef2cd711a52" Jul 07 17:37:07.965797 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:07.965766 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:37:07.965964 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:07.965898 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcxjj" podUID="4b7e95da-8e96-4bbc-9579-8850344048c8" Jul 07 17:37:08.118979 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:08.118960 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/ovn-acl-logging/0.log" Jul 07 17:37:08.119409 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:08.119382 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x765g" event={"ID":"058bbf81-9eba-48d5-8d6f-119c027acd4c","Type":"ContainerStarted","Data":"0ea26b16a62eb4ecaa4171d2d7dfe8a10b38c27ba78c31e1508b04fe7e260d4f"} Jul 07 17:37:08.119671 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:08.119652 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:37:08.119854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:08.119835 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:37:08.119931 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:08.119918 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:37:08.119931 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:08.119843 2552 scope.go:117] "RemoveContainer" containerID="212f62604f960843eaacd5b7a4cb0c3cfb35c351e409788b896e0bf8c92a417e" Jul 07 17:37:08.134172 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:08.134040 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:37:08.134261 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:08.134251 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:37:08.966616 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:08.966584 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:37:08.967006 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:08.966589 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:37:08.967006 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:08.966681 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxgbv" podUID="ee071d67-b30e-43c6-bc8b-6ef2cd711a52" Jul 07 17:37:08.967006 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:08.966760 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrwlq" podUID="169258da-bb2c-4e58-8e93-447b39ef7da2" Jul 07 17:37:09.125310 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:09.125272 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/ovn-acl-logging/0.log" Jul 07 17:37:09.125669 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:09.125641 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x765g" event={"ID":"058bbf81-9eba-48d5-8d6f-119c027acd4c","Type":"ContainerStarted","Data":"e98b65e03f6dd2b82c4fc4ba2f5fb4ccc1b692a77c115a6e5817c200f03142a0"} Jul 07 17:37:09.127337 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:09.127314 2552 generic.go:356] "Generic (PLEG): container finished" podID="e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de" containerID="37d1aa25a39143e4d2a256502d8c94e087d5982059768f4a57ef00ae6c13ca93" exitCode=0 Jul 07 17:37:09.127437 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:09.127361 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7zgc6" event={"ID":"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de","Type":"ContainerDied","Data":"37d1aa25a39143e4d2a256502d8c94e087d5982059768f4a57ef00ae6c13ca93"} Jul 07 17:37:09.150795 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:09.150756 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-x765g" podStartSLOduration=10.593798041 podStartE2EDuration="29.150744268s" totalImagesPullingTime="18.556946227s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:09.150402195 +0000 UTC m=+29.732408931" watchObservedRunningTime="2026-07-07 17:37:09.150744268 +0000 UTC m=+29.732751037" Jul 07 17:37:09.968149 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:09.968121 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:37:09.968496 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:09.968230 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcxjj" podUID="4b7e95da-8e96-4bbc-9579-8850344048c8" Jul 07 17:37:09.978332 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:09.978293 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mxgbv"] Jul 07 17:37:09.978447 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:09.978426 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:37:09.978554 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:09.978521 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxgbv" podUID="ee071d67-b30e-43c6-bc8b-6ef2cd711a52" Jul 07 17:37:09.981919 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:09.981892 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mcxjj"] Jul 07 17:37:09.982271 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:09.982255 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nrwlq"] Jul 07 17:37:09.982467 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:09.982380 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:37:09.982548 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:09.982483 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrwlq" podUID="169258da-bb2c-4e58-8e93-447b39ef7da2" Jul 07 17:37:10.133276 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:10.133246 2552 generic.go:356] "Generic (PLEG): container finished" podID="e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de" containerID="d004b04bed30cea3838626162ea55d13152f1de6666a36474eb43f1b56652121" exitCode=0 Jul 07 17:37:10.133422 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:10.133332 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7zgc6" event={"ID":"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de","Type":"ContainerDied","Data":"d004b04bed30cea3838626162ea55d13152f1de6666a36474eb43f1b56652121"} Jul 07 17:37:10.133422 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:10.133349 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:37:10.133497 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:10.133463 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcxjj" podUID="4b7e95da-8e96-4bbc-9579-8850344048c8" Jul 07 17:37:11.137907 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:11.137877 2552 generic.go:356] "Generic (PLEG): container finished" podID="e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de" containerID="4c3222e61c63f6fc5265b3514690307fea9bf84f0f6cb25961fd4d0494303545" exitCode=0 Jul 07 17:37:11.138281 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:11.137918 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7zgc6" event={"ID":"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de","Type":"ContainerDied","Data":"4c3222e61c63f6fc5265b3514690307fea9bf84f0f6cb25961fd4d0494303545"} Jul 07 17:37:11.966174 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:11.966141 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:37:11.966363 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:11.966146 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:37:11.966363 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:11.966265 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:37:11.966363 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:11.966269 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxgbv" podUID="ee071d67-b30e-43c6-bc8b-6ef2cd711a52" Jul 07 17:37:11.966545 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:11.966378 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrwlq" podUID="169258da-bb2c-4e58-8e93-447b39ef7da2" Jul 07 17:37:11.966545 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:11.966460 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcxjj" podUID="4b7e95da-8e96-4bbc-9579-8850344048c8" Jul 07 17:37:13.522541 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:13.522509 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-original-pull-secret\") pod \"global-pull-secret-syncer-mxgbv\" (UID: \"ee071d67-b30e-43c6-bc8b-6ef2cd711a52\") " pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:37:13.523042 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:13.522555 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/169258da-bb2c-4e58-8e93-447b39ef7da2-metrics-certs\") pod \"network-metrics-daemon-nrwlq\" (UID: \"169258da-bb2c-4e58-8e93-447b39ef7da2\") " pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:37:13.523042 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:13.522589 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2bnk\" (UniqueName: \"kubernetes.io/projected/4b7e95da-8e96-4bbc-9579-8850344048c8-kube-api-access-d2bnk\") pod \"network-check-target-mcxjj\" (UID: \"4b7e95da-8e96-4bbc-9579-8850344048c8\") " pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:37:13.523042 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:13.522662 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 17:37:13.523042 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:13.522700 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 17:37:13.523042 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:13.522718 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 17:37:13.523042 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:13.522716 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:37:13.523042 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:13.522730 2552 projected.go:196] Error preparing data for projected volume kube-api-access-d2bnk for pod openshift-network-diagnostics/network-check-target-mcxjj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:37:13.523042 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:13.522732 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-original-pull-secret podName:ee071d67-b30e-43c6-bc8b-6ef2cd711a52 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:45.522712199 +0000 UTC m=+66.104718926 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-original-pull-secret") pod "global-pull-secret-syncer-mxgbv" (UID: "ee071d67-b30e-43c6-bc8b-6ef2cd711a52") : object "kube-system"/"original-pull-secret" not registered Jul 07 17:37:13.523042 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:13.522784 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/169258da-bb2c-4e58-8e93-447b39ef7da2-metrics-certs podName:169258da-bb2c-4e58-8e93-447b39ef7da2 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:45.522768087 +0000 UTC m=+66.104774813 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/169258da-bb2c-4e58-8e93-447b39ef7da2-metrics-certs") pod "network-metrics-daemon-nrwlq" (UID: "169258da-bb2c-4e58-8e93-447b39ef7da2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:37:13.523042 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:13.522805 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4b7e95da-8e96-4bbc-9579-8850344048c8-kube-api-access-d2bnk podName:4b7e95da-8e96-4bbc-9579-8850344048c8 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:45.52279233 +0000 UTC m=+66.104799054 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-d2bnk" (UniqueName: "kubernetes.io/projected/4b7e95da-8e96-4bbc-9579-8850344048c8-kube-api-access-d2bnk") pod "network-check-target-mcxjj" (UID: "4b7e95da-8e96-4bbc-9579-8850344048c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:37:13.966347 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:13.966284 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:37:13.966347 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:13.966322 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:37:13.966595 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:13.966427 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxgbv" podUID="ee071d67-b30e-43c6-bc8b-6ef2cd711a52" Jul 07 17:37:13.966595 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:13.966494 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrwlq" podUID="169258da-bb2c-4e58-8e93-447b39ef7da2" Jul 07 17:37:13.966595 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:13.966528 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:37:13.966595 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:13.966594 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcxjj" podUID="4b7e95da-8e96-4bbc-9579-8850344048c8" Jul 07 17:37:15.168491 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.168467 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-96.ec2.internal" event="NodeReady" Jul 07 17:37:15.168916 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.168572 2552 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 17:37:15.201943 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.201920 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54b8fcb74-vmn2p"] Jul 07 17:37:15.215649 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.215627 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vrvvv"] Jul 07 17:37:15.215782 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.215626 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:15.218099 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.218060 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 17:37:15.218099 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.218087 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 17:37:15.218587 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.218215 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hdmrj\"" Jul 07 17:37:15.218587 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.218413 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 17:37:15.223636 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.223378 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 17:37:15.229805 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.229788 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54b8fcb74-vmn2p"] Jul 07 17:37:15.229890 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.229815 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-txqgg"] Jul 07 17:37:15.229926 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.229901 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vrvvv" Jul 07 17:37:15.232231 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.232211 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 17:37:15.232329 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.232245 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 17:37:15.232329 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.232211 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-trtbr\"" Jul 07 17:37:15.232329 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.232279 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 17:37:15.247859 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.247839 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vrvvv"] Jul 07 17:37:15.247949 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.247868 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-txqgg"] Jul 07 17:37:15.248013 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.247985 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-txqgg" Jul 07 17:37:15.251019 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.250219 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 17:37:15.251354 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.251337 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 17:37:15.251574 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.251560 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2vm2m\"" Jul 07 17:37:15.335741 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.335723 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbf7w\" (UniqueName: \"kubernetes.io/projected/b4a92b0f-9630-4124-be07-9e5abbffe853-kube-api-access-nbf7w\") pod \"dns-default-txqgg\" (UID: \"b4a92b0f-9630-4124-be07-9e5abbffe853\") " pod="openshift-dns/dns-default-txqgg" Jul 07 17:37:15.335828 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.335749 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53ba0933-91e4-4870-858f-a15537f35025-registry-certificates\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:15.335828 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.335776 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b4a92b0f-9630-4124-be07-9e5abbffe853-config-volume\") pod \"dns-default-txqgg\" (UID: \"b4a92b0f-9630-4124-be07-9e5abbffe853\") " pod="openshift-dns/dns-default-txqgg" Jul 07 17:37:15.335828 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.335818 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53ba0933-91e4-4870-858f-a15537f35025-ca-trust-extracted\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:15.335934 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.335848 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53ba0933-91e4-4870-858f-a15537f35025-installation-pull-secrets\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:15.335934 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.335888 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-registry-tls\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:15.335934 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.335906 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4a92b0f-9630-4124-be07-9e5abbffe853-metrics-tls\") pod \"dns-default-txqgg\" (UID: \"b4a92b0f-9630-4124-be07-9e5abbffe853\") " pod="openshift-dns/dns-default-txqgg" Jul 07 17:37:15.335934 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.335920 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4a92b0f-9630-4124-be07-9e5abbffe853-tmp-dir\") pod \"dns-default-txqgg\" (UID: \"b4a92b0f-9630-4124-be07-9e5abbffe853\") " pod="openshift-dns/dns-default-txqgg" Jul 07 17:37:15.335934 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.335933 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-bound-sa-token\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:15.336070 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.335974 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7skq\" (UniqueName: \"kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-kube-api-access-f7skq\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:15.336070 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.335995 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85eb217f-d46a-4dec-ac32-73b5d41f96d2-cert\") pod \"ingress-canary-vrvvv\" (UID: \"85eb217f-d46a-4dec-ac32-73b5d41f96d2\") " pod="openshift-ingress-canary/ingress-canary-vrvvv" Jul 07 17:37:15.336070 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.336012 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bfg4\" (UniqueName: \"kubernetes.io/projected/85eb217f-d46a-4dec-ac32-73b5d41f96d2-kube-api-access-9bfg4\") pod \"ingress-canary-vrvvv\" (UID: \"85eb217f-d46a-4dec-ac32-73b5d41f96d2\") " pod="openshift-ingress-canary/ingress-canary-vrvvv" Jul 07 17:37:15.336070 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.336035 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53ba0933-91e4-4870-858f-a15537f35025-image-registry-private-configuration\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:15.336070 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.336049 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53ba0933-91e4-4870-858f-a15537f35025-trusted-ca\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:15.437173 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.437125 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbf7w\" (UniqueName: \"kubernetes.io/projected/b4a92b0f-9630-4124-be07-9e5abbffe853-kube-api-access-nbf7w\") pod \"dns-default-txqgg\" (UID: \"b4a92b0f-9630-4124-be07-9e5abbffe853\") " pod="openshift-dns/dns-default-txqgg" Jul 07 17:37:15.437173 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.437154 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53ba0933-91e4-4870-858f-a15537f35025-registry-certificates\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:15.437272 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.437181 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b4a92b0f-9630-4124-be07-9e5abbffe853-config-volume\") pod \"dns-default-txqgg\" (UID: \"b4a92b0f-9630-4124-be07-9e5abbffe853\") " pod="openshift-dns/dns-default-txqgg" Jul 07 17:37:15.437272 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.437200 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53ba0933-91e4-4870-858f-a15537f35025-ca-trust-extracted\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:15.437272 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.437223 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53ba0933-91e4-4870-858f-a15537f35025-installation-pull-secrets\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:15.437272 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.437261 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-registry-tls\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:15.437449 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.437285 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4a92b0f-9630-4124-be07-9e5abbffe853-metrics-tls\") pod \"dns-default-txqgg\" (UID: \"b4a92b0f-9630-4124-be07-9e5abbffe853\") " pod="openshift-dns/dns-default-txqgg" Jul 07 17:37:15.437449 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.437326 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4a92b0f-9630-4124-be07-9e5abbffe853-tmp-dir\") pod \"dns-default-txqgg\" (UID: \"b4a92b0f-9630-4124-be07-9e5abbffe853\") " pod="openshift-dns/dns-default-txqgg" Jul 07 17:37:15.437449 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.437345 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-bound-sa-token\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:15.437449 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.437378 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7skq\" (UniqueName: \"kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-kube-api-access-f7skq\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:15.437449 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.437403 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85eb217f-d46a-4dec-ac32-73b5d41f96d2-cert\") pod \"ingress-canary-vrvvv\" (UID: \"85eb217f-d46a-4dec-ac32-73b5d41f96d2\") " pod="openshift-ingress-canary/ingress-canary-vrvvv" Jul 07 17:37:15.437449 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.437431 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bfg4\" (UniqueName: \"kubernetes.io/projected/85eb217f-d46a-4dec-ac32-73b5d41f96d2-kube-api-access-9bfg4\") pod \"ingress-canary-vrvvv\" (UID: \"85eb217f-d46a-4dec-ac32-73b5d41f96d2\") " pod="openshift-ingress-canary/ingress-canary-vrvvv" Jul 07 17:37:15.437449 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:15.437442 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 17:37:15.437759 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:15.437462 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54b8fcb74-vmn2p: secret "image-registry-tls" not found Jul 07 17:37:15.437759 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.437468 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53ba0933-91e4-4870-858f-a15537f35025-image-registry-private-configuration\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:15.437759 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.437492 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53ba0933-91e4-4870-858f-a15537f35025-trusted-ca\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:15.437759 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:15.437528 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-registry-tls podName:53ba0933-91e4-4870-858f-a15537f35025 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:15.937508473 +0000 UTC m=+36.519515215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-registry-tls") pod "image-registry-54b8fcb74-vmn2p" (UID: "53ba0933-91e4-4870-858f-a15537f35025") : secret "image-registry-tls" not found Jul 07 17:37:15.437759 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.437637 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53ba0933-91e4-4870-858f-a15537f35025-ca-trust-extracted\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:15.437759 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:15.437692 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 17:37:15.437759 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:15.437757 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4a92b0f-9630-4124-be07-9e5abbffe853-metrics-tls podName:b4a92b0f-9630-4124-be07-9e5abbffe853 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:15.937738583 +0000 UTC m=+36.519745309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4a92b0f-9630-4124-be07-9e5abbffe853-metrics-tls") pod "dns-default-txqgg" (UID: "b4a92b0f-9630-4124-be07-9e5abbffe853") : secret "dns-default-metrics-tls" not found Jul 07 17:37:15.437759 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.437751 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b4a92b0f-9630-4124-be07-9e5abbffe853-config-volume\") pod \"dns-default-txqgg\" (UID: \"b4a92b0f-9630-4124-be07-9e5abbffe853\") " pod="openshift-dns/dns-default-txqgg" Jul 07 17:37:15.438114 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.437841 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53ba0933-91e4-4870-858f-a15537f35025-registry-certificates\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:15.438114 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.437999 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4a92b0f-9630-4124-be07-9e5abbffe853-tmp-dir\") pod \"dns-default-txqgg\" (UID: \"b4a92b0f-9630-4124-be07-9e5abbffe853\") " pod="openshift-dns/dns-default-txqgg" Jul 07 17:37:15.438321 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.438284 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53ba0933-91e4-4870-858f-a15537f35025-trusted-ca\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:15.441215 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.441193 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53ba0933-91e4-4870-858f-a15537f35025-image-registry-private-configuration\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:15.441332 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.441219 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85eb217f-d46a-4dec-ac32-73b5d41f96d2-cert\") pod \"ingress-canary-vrvvv\" (UID: \"85eb217f-d46a-4dec-ac32-73b5d41f96d2\") " pod="openshift-ingress-canary/ingress-canary-vrvvv" Jul 07 17:37:15.441389 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.441335 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53ba0933-91e4-4870-858f-a15537f35025-installation-pull-secrets\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:15.444702 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.444681 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbf7w\" (UniqueName: \"kubernetes.io/projected/b4a92b0f-9630-4124-be07-9e5abbffe853-kube-api-access-nbf7w\") pod \"dns-default-txqgg\" (UID: \"b4a92b0f-9630-4124-be07-9e5abbffe853\") " pod="openshift-dns/dns-default-txqgg" Jul 07 17:37:15.445198 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.445180 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7skq\" (UniqueName: \"kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-kube-api-access-f7skq\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:15.445754 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.445737 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bfg4\" (UniqueName: \"kubernetes.io/projected/85eb217f-d46a-4dec-ac32-73b5d41f96d2-kube-api-access-9bfg4\") pod \"ingress-canary-vrvvv\" (UID: \"85eb217f-d46a-4dec-ac32-73b5d41f96d2\") " pod="openshift-ingress-canary/ingress-canary-vrvvv" Jul 07 17:37:15.446127 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.446107 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-bound-sa-token\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:15.538336 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.538316 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vrvvv" Jul 07 17:37:15.725229 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.725047 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vrvvv"] Jul 07 17:37:15.728656 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:37:15.728626 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85eb217f_d46a_4dec_ac32_73b5d41f96d2.slice/crio-71707cf751be3a5873a9c56f161da7a9cb7c861f9d8e371b15fc15f2dc629ada WatchSource:0}: Error finding container 71707cf751be3a5873a9c56f161da7a9cb7c861f9d8e371b15fc15f2dc629ada: Status 404 returned error can't find the container with id 71707cf751be3a5873a9c56f161da7a9cb7c861f9d8e371b15fc15f2dc629ada Jul 07 17:37:15.941763 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.941698 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-registry-tls\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:15.941763 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.941731 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4a92b0f-9630-4124-be07-9e5abbffe853-metrics-tls\") pod \"dns-default-txqgg\" (UID: \"b4a92b0f-9630-4124-be07-9e5abbffe853\") " pod="openshift-dns/dns-default-txqgg" Jul 07 17:37:15.941946 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:15.941856 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 17:37:15.941946 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:15.941866 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 17:37:15.941946 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:15.941885 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54b8fcb74-vmn2p: secret "image-registry-tls" not found Jul 07 17:37:15.941946 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:15.941906 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4a92b0f-9630-4124-be07-9e5abbffe853-metrics-tls podName:b4a92b0f-9630-4124-be07-9e5abbffe853 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:16.941893303 +0000 UTC m=+37.523900026 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4a92b0f-9630-4124-be07-9e5abbffe853-metrics-tls") pod "dns-default-txqgg" (UID: "b4a92b0f-9630-4124-be07-9e5abbffe853") : secret "dns-default-metrics-tls" not found Jul 07 17:37:15.941946 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:15.941942 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-registry-tls podName:53ba0933-91e4-4870-858f-a15537f35025 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:16.941922338 +0000 UTC m=+37.523929081 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-registry-tls") pod "image-registry-54b8fcb74-vmn2p" (UID: "53ba0933-91e4-4870-858f-a15537f35025") : secret "image-registry-tls" not found Jul 07 17:37:15.966636 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.966613 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:37:15.966733 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.966617 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:37:15.966796 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.966734 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:37:15.969025 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.968979 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pkhdg\"" Jul 07 17:37:15.969025 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.968994 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 17:37:15.969202 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.969028 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 17:37:15.969202 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.968994 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f7nks\"" Jul 07 17:37:15.969202 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.968979 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 17:37:15.969202 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:15.968993 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 17:37:16.151069 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:16.151040 2552 generic.go:356] "Generic (PLEG): container finished" podID="e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de" containerID="25d60c6fc76896798829d198bab035e412b77657db13a97bce5e4595b90fd4cb" exitCode=0 Jul 07 17:37:16.151209 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:16.151109 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7zgc6" event={"ID":"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de","Type":"ContainerDied","Data":"25d60c6fc76896798829d198bab035e412b77657db13a97bce5e4595b90fd4cb"} Jul 07 17:37:16.152202 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:16.152185 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vrvvv" event={"ID":"85eb217f-d46a-4dec-ac32-73b5d41f96d2","Type":"ContainerStarted","Data":"71707cf751be3a5873a9c56f161da7a9cb7c861f9d8e371b15fc15f2dc629ada"} Jul 07 17:37:16.949101 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:16.949070 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-registry-tls\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:16.949101 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:16.949105 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4a92b0f-9630-4124-be07-9e5abbffe853-metrics-tls\") pod \"dns-default-txqgg\" (UID: \"b4a92b0f-9630-4124-be07-9e5abbffe853\") " pod="openshift-dns/dns-default-txqgg" Jul 07 17:37:16.949574 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:16.949221 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 17:37:16.949574 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:16.949240 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 17:37:16.949574 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:16.949289 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4a92b0f-9630-4124-be07-9e5abbffe853-metrics-tls podName:b4a92b0f-9630-4124-be07-9e5abbffe853 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:18.949276893 +0000 UTC m=+39.531283616 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4a92b0f-9630-4124-be07-9e5abbffe853-metrics-tls") pod "dns-default-txqgg" (UID: "b4a92b0f-9630-4124-be07-9e5abbffe853") : secret "dns-default-metrics-tls" not found Jul 07 17:37:16.949574 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:16.949241 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54b8fcb74-vmn2p: secret "image-registry-tls" not found Jul 07 17:37:16.949574 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:16.949360 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-registry-tls podName:53ba0933-91e4-4870-858f-a15537f35025 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:18.949348245 +0000 UTC m=+39.531354969 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-registry-tls") pod "image-registry-54b8fcb74-vmn2p" (UID: "53ba0933-91e4-4870-858f-a15537f35025") : secret "image-registry-tls" not found Jul 07 17:37:17.157122 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:17.157093 2552 generic.go:356] "Generic (PLEG): container finished" podID="e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de" containerID="0fbb82c6e5733570e1bc7f105bf181dea3df20657860e8cf8a86b3796b7df44e" exitCode=0 Jul 07 17:37:17.157291 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:17.157150 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7zgc6" event={"ID":"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de","Type":"ContainerDied","Data":"0fbb82c6e5733570e1bc7f105bf181dea3df20657860e8cf8a86b3796b7df44e"} Jul 07 17:37:18.161837 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:18.161807 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7zgc6" event={"ID":"e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de","Type":"ContainerStarted","Data":"6784ae20945f1db6509ffefc36ff519d5f8672835cd0de8d761db53618e1ee93"} Jul 07 17:37:18.185600 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:18.185545 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7zgc6" podStartSLOduration=8.418926231 podStartE2EDuration="38.185528188s" totalImagesPullingTime="29.766601957s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:18.184527785 +0000 UTC m=+38.766534530" watchObservedRunningTime="2026-07-07 17:37:18.185528188 +0000 UTC m=+38.767534930" Jul 07 17:37:18.964568 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:18.964537 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-registry-tls\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:18.964711 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:18.964575 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4a92b0f-9630-4124-be07-9e5abbffe853-metrics-tls\") pod \"dns-default-txqgg\" (UID: \"b4a92b0f-9630-4124-be07-9e5abbffe853\") " pod="openshift-dns/dns-default-txqgg" Jul 07 17:37:18.964711 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:18.964682 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 17:37:18.964711 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:18.964691 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 17:37:18.964711 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:18.964698 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54b8fcb74-vmn2p: secret "image-registry-tls" not found Jul 07 17:37:18.964905 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:18.964749 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-registry-tls podName:53ba0933-91e4-4870-858f-a15537f35025 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:22.964734917 +0000 UTC m=+43.546741644 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-registry-tls") pod "image-registry-54b8fcb74-vmn2p" (UID: "53ba0933-91e4-4870-858f-a15537f35025") : secret "image-registry-tls" not found Jul 07 17:37:18.964905 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:18.964763 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4a92b0f-9630-4124-be07-9e5abbffe853-metrics-tls podName:b4a92b0f-9630-4124-be07-9e5abbffe853 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:22.96475736 +0000 UTC m=+43.546764083 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4a92b0f-9630-4124-be07-9e5abbffe853-metrics-tls") pod "dns-default-txqgg" (UID: "b4a92b0f-9630-4124-be07-9e5abbffe853") : secret "dns-default-metrics-tls" not found Jul 07 17:37:20.170497 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:20.170259 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vrvvv" event={"ID":"85eb217f-d46a-4dec-ac32-73b5d41f96d2","Type":"ContainerStarted","Data":"e831d15c0d73442013458c56e6d2bee5cb5e58a70f3a464f46291511d9cb1ca3"} Jul 07 17:37:20.187663 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:20.187604 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vrvvv" podStartSLOduration=1.52036298 podStartE2EDuration="5.187591433s" totalImagesPullingTime="3.667228453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:20.187086658 +0000 UTC m=+40.769093403" watchObservedRunningTime="2026-07-07 17:37:20.187591433 +0000 UTC m=+40.769598179" Jul 07 17:37:22.991694 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:22.991661 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-registry-tls\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:22.991694 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:22.991696 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4a92b0f-9630-4124-be07-9e5abbffe853-metrics-tls\") pod \"dns-default-txqgg\" (UID: \"b4a92b0f-9630-4124-be07-9e5abbffe853\") " pod="openshift-dns/dns-default-txqgg" Jul 07 17:37:22.992162 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:22.991793 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 17:37:22.992162 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:22.991797 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 17:37:22.992162 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:22.991813 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54b8fcb74-vmn2p: secret "image-registry-tls" not found Jul 07 17:37:22.992162 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:22.991843 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4a92b0f-9630-4124-be07-9e5abbffe853-metrics-tls podName:b4a92b0f-9630-4124-be07-9e5abbffe853 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:30.99182991 +0000 UTC m=+51.573836633 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4a92b0f-9630-4124-be07-9e5abbffe853-metrics-tls") pod "dns-default-txqgg" (UID: "b4a92b0f-9630-4124-be07-9e5abbffe853") : secret "dns-default-metrics-tls" not found Jul 07 17:37:22.992162 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:22.991855 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-registry-tls podName:53ba0933-91e4-4870-858f-a15537f35025 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:30.991849259 +0000 UTC m=+51.573855982 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-registry-tls") pod "image-registry-54b8fcb74-vmn2p" (UID: "53ba0933-91e4-4870-858f-a15537f35025") : secret "image-registry-tls" not found Jul 07 17:37:29.576946 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.576912 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k9ml9"] Jul 07 17:37:29.588636 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.588609 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-fn9zf"] Jul 07 17:37:29.588765 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.588698 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k9ml9" Jul 07 17:37:29.591864 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.591843 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-rxrsp\"" Jul 07 17:37:29.591864 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.591854 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 07 17:37:29.592067 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.591850 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 07 17:37:29.597151 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.597106 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k9ml9"] Jul 07 17:37:29.597151 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.597148 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-fn9zf"] Jul 07 17:37:29.597372 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.597336 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-fn9zf" Jul 07 17:37:29.599240 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.599215 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 17:37:29.599522 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.599506 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 07 17:37:29.599604 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.599561 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-bbjfw\"" Jul 07 17:37:29.600221 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.600207 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 07 17:37:29.605144 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.605125 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 17:37:29.605696 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.605678 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 07 17:37:29.679233 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.679210 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kgw97"] Jul 07 17:37:29.686599 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.686579 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kgw97" Jul 07 17:37:29.688791 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.688772 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 07 17:37:29.688932 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.688913 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-sn2tm\"" Jul 07 17:37:29.688932 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.688834 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 17:37:29.688932 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.688887 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 07 17:37:29.689141 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.689071 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 17:37:29.691556 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.691538 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kgw97"] Jul 07 17:37:29.738428 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.738409 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a58d9422-ad7b-4281-b918-bbe01ccff305-tmp\") pod \"insights-operator-5c847dcfc4-fn9zf\" (UID: \"a58d9422-ad7b-4281-b918-bbe01ccff305\") " pod="openshift-insights/insights-operator-5c847dcfc4-fn9zf" Jul 07 17:37:29.738539 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.738448 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a58d9422-ad7b-4281-b918-bbe01ccff305-snapshots\") pod \"insights-operator-5c847dcfc4-fn9zf\" (UID: \"a58d9422-ad7b-4281-b918-bbe01ccff305\") " pod="openshift-insights/insights-operator-5c847dcfc4-fn9zf" Jul 07 17:37:29.738602 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.738541 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a58d9422-ad7b-4281-b918-bbe01ccff305-serving-cert\") pod \"insights-operator-5c847dcfc4-fn9zf\" (UID: \"a58d9422-ad7b-4281-b918-bbe01ccff305\") " pod="openshift-insights/insights-operator-5c847dcfc4-fn9zf" Jul 07 17:37:29.738602 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.738573 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sscf4\" (UniqueName: \"kubernetes.io/projected/69257408-0117-4007-bb96-b96de8037f99-kube-api-access-sscf4\") pod \"volume-data-source-validator-5d456fdbcd-k9ml9\" (UID: \"69257408-0117-4007-bb96-b96de8037f99\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k9ml9" Jul 07 17:37:29.738711 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.738612 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcffb\" (UniqueName: \"kubernetes.io/projected/a58d9422-ad7b-4281-b918-bbe01ccff305-kube-api-access-vcffb\") pod \"insights-operator-5c847dcfc4-fn9zf\" (UID: \"a58d9422-ad7b-4281-b918-bbe01ccff305\") " pod="openshift-insights/insights-operator-5c847dcfc4-fn9zf" Jul 07 17:37:29.738711 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.738674 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a58d9422-ad7b-4281-b918-bbe01ccff305-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-fn9zf\" (UID: \"a58d9422-ad7b-4281-b918-bbe01ccff305\") " pod="openshift-insights/insights-operator-5c847dcfc4-fn9zf" Jul 07 17:37:29.738711 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.738701 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a58d9422-ad7b-4281-b918-bbe01ccff305-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-fn9zf\" (UID: \"a58d9422-ad7b-4281-b918-bbe01ccff305\") " pod="openshift-insights/insights-operator-5c847dcfc4-fn9zf" Jul 07 17:37:29.839590 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.839526 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcffb\" (UniqueName: \"kubernetes.io/projected/a58d9422-ad7b-4281-b918-bbe01ccff305-kube-api-access-vcffb\") pod \"insights-operator-5c847dcfc4-fn9zf\" (UID: \"a58d9422-ad7b-4281-b918-bbe01ccff305\") " pod="openshift-insights/insights-operator-5c847dcfc4-fn9zf" Jul 07 17:37:29.839590 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.839560 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5a1510f8-addf-440c-b143-a96e531fac41-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-kgw97\" (UID: \"5a1510f8-addf-440c-b143-a96e531fac41\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kgw97" Jul 07 17:37:29.839739 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.839610 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a58d9422-ad7b-4281-b918-bbe01ccff305-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-fn9zf\" (UID: \"a58d9422-ad7b-4281-b918-bbe01ccff305\") " pod="openshift-insights/insights-operator-5c847dcfc4-fn9zf" Jul 07 17:37:29.839739 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.839635 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a58d9422-ad7b-4281-b918-bbe01ccff305-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-fn9zf\" (UID: \"a58d9422-ad7b-4281-b918-bbe01ccff305\") " pod="openshift-insights/insights-operator-5c847dcfc4-fn9zf" Jul 07 17:37:29.839739 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.839662 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a58d9422-ad7b-4281-b918-bbe01ccff305-tmp\") pod \"insights-operator-5c847dcfc4-fn9zf\" (UID: \"a58d9422-ad7b-4281-b918-bbe01ccff305\") " pod="openshift-insights/insights-operator-5c847dcfc4-fn9zf" Jul 07 17:37:29.839739 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.839696 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a1510f8-addf-440c-b143-a96e531fac41-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-kgw97\" (UID: \"5a1510f8-addf-440c-b143-a96e531fac41\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kgw97" Jul 07 17:37:29.839912 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.839784 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a58d9422-ad7b-4281-b918-bbe01ccff305-snapshots\") pod \"insights-operator-5c847dcfc4-fn9zf\" (UID: \"a58d9422-ad7b-4281-b918-bbe01ccff305\") " pod="openshift-insights/insights-operator-5c847dcfc4-fn9zf" Jul 07 17:37:29.839912 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.839850 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5wh8\" (UniqueName: \"kubernetes.io/projected/5a1510f8-addf-440c-b143-a96e531fac41-kube-api-access-b5wh8\") pod \"cluster-monitoring-operator-64786d9cbb-kgw97\" (UID: \"5a1510f8-addf-440c-b143-a96e531fac41\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kgw97" Jul 07 17:37:29.839912 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.839893 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a58d9422-ad7b-4281-b918-bbe01ccff305-serving-cert\") pod \"insights-operator-5c847dcfc4-fn9zf\" (UID: \"a58d9422-ad7b-4281-b918-bbe01ccff305\") " pod="openshift-insights/insights-operator-5c847dcfc4-fn9zf" Jul 07 17:37:29.839912 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.839911 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sscf4\" (UniqueName: \"kubernetes.io/projected/69257408-0117-4007-bb96-b96de8037f99-kube-api-access-sscf4\") pod \"volume-data-source-validator-5d456fdbcd-k9ml9\" (UID: \"69257408-0117-4007-bb96-b96de8037f99\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k9ml9" Jul 07 17:37:29.840083 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.840062 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a58d9422-ad7b-4281-b918-bbe01ccff305-tmp\") pod \"insights-operator-5c847dcfc4-fn9zf\" (UID: \"a58d9422-ad7b-4281-b918-bbe01ccff305\") " pod="openshift-insights/insights-operator-5c847dcfc4-fn9zf" Jul 07 17:37:29.840237 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.840215 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a58d9422-ad7b-4281-b918-bbe01ccff305-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-fn9zf\" (UID: \"a58d9422-ad7b-4281-b918-bbe01ccff305\") " pod="openshift-insights/insights-operator-5c847dcfc4-fn9zf" Jul 07 17:37:29.840404 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.840388 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a58d9422-ad7b-4281-b918-bbe01ccff305-snapshots\") pod \"insights-operator-5c847dcfc4-fn9zf\" (UID: \"a58d9422-ad7b-4281-b918-bbe01ccff305\") " pod="openshift-insights/insights-operator-5c847dcfc4-fn9zf" Jul 07 17:37:29.840467 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.840405 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a58d9422-ad7b-4281-b918-bbe01ccff305-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-fn9zf\" (UID: \"a58d9422-ad7b-4281-b918-bbe01ccff305\") " pod="openshift-insights/insights-operator-5c847dcfc4-fn9zf" Jul 07 17:37:29.843765 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.843742 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a58d9422-ad7b-4281-b918-bbe01ccff305-serving-cert\") pod \"insights-operator-5c847dcfc4-fn9zf\" (UID: \"a58d9422-ad7b-4281-b918-bbe01ccff305\") " pod="openshift-insights/insights-operator-5c847dcfc4-fn9zf" Jul 07 17:37:29.850220 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.850199 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcffb\" (UniqueName: \"kubernetes.io/projected/a58d9422-ad7b-4281-b918-bbe01ccff305-kube-api-access-vcffb\") pod \"insights-operator-5c847dcfc4-fn9zf\" (UID: \"a58d9422-ad7b-4281-b918-bbe01ccff305\") " pod="openshift-insights/insights-operator-5c847dcfc4-fn9zf" Jul 07 17:37:29.850709 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.850693 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sscf4\" (UniqueName: \"kubernetes.io/projected/69257408-0117-4007-bb96-b96de8037f99-kube-api-access-sscf4\") pod \"volume-data-source-validator-5d456fdbcd-k9ml9\" (UID: \"69257408-0117-4007-bb96-b96de8037f99\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k9ml9" Jul 07 17:37:29.898687 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.898662 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k9ml9" Jul 07 17:37:29.907715 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.907696 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-fn9zf" Jul 07 17:37:29.941126 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.941105 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a1510f8-addf-440c-b143-a96e531fac41-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-kgw97\" (UID: \"5a1510f8-addf-440c-b143-a96e531fac41\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kgw97" Jul 07 17:37:29.941238 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.941169 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5wh8\" (UniqueName: \"kubernetes.io/projected/5a1510f8-addf-440c-b143-a96e531fac41-kube-api-access-b5wh8\") pod \"cluster-monitoring-operator-64786d9cbb-kgw97\" (UID: \"5a1510f8-addf-440c-b143-a96e531fac41\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kgw97" Jul 07 17:37:29.941238 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.941203 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5a1510f8-addf-440c-b143-a96e531fac41-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-kgw97\" (UID: \"5a1510f8-addf-440c-b143-a96e531fac41\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kgw97" Jul 07 17:37:29.941363 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:29.941256 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 17:37:29.941363 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:29.941343 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a1510f8-addf-440c-b143-a96e531fac41-cluster-monitoring-operator-tls podName:5a1510f8-addf-440c-b143-a96e531fac41 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:30.441324327 +0000 UTC m=+51.023331073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5a1510f8-addf-440c-b143-a96e531fac41-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-kgw97" (UID: "5a1510f8-addf-440c-b143-a96e531fac41") : secret "cluster-monitoring-operator-tls" not found Jul 07 17:37:29.941909 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.941887 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5a1510f8-addf-440c-b143-a96e531fac41-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-kgw97\" (UID: \"5a1510f8-addf-440c-b143-a96e531fac41\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kgw97" Jul 07 17:37:29.956090 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:29.956057 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5wh8\" (UniqueName: \"kubernetes.io/projected/5a1510f8-addf-440c-b143-a96e531fac41-kube-api-access-b5wh8\") pod \"cluster-monitoring-operator-64786d9cbb-kgw97\" (UID: \"5a1510f8-addf-440c-b143-a96e531fac41\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kgw97" Jul 07 17:37:30.042485 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:30.042455 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k9ml9"] Jul 07 17:37:30.046489 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:37:30.046464 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69257408_0117_4007_bb96_b96de8037f99.slice/crio-2f22bb450cc93bc01093604d56dec682e9d210b43ab7850f971a7affe36941cd WatchSource:0}: Error finding container 2f22bb450cc93bc01093604d56dec682e9d210b43ab7850f971a7affe36941cd: Status 404 returned error can't find the container with id 2f22bb450cc93bc01093604d56dec682e9d210b43ab7850f971a7affe36941cd Jul 07 17:37:30.060321 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:30.060286 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-fn9zf"] Jul 07 17:37:30.063162 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:37:30.063143 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda58d9422_ad7b_4281_b918_bbe01ccff305.slice/crio-1b99b47870a3ca1346a1894fb30fe0e2494241c8bc37c4264fb22c5583a54de1 WatchSource:0}: Error finding container 1b99b47870a3ca1346a1894fb30fe0e2494241c8bc37c4264fb22c5583a54de1: Status 404 returned error can't find the container with id 1b99b47870a3ca1346a1894fb30fe0e2494241c8bc37c4264fb22c5583a54de1 Jul 07 17:37:30.191853 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:30.191827 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-fn9zf" event={"ID":"a58d9422-ad7b-4281-b918-bbe01ccff305","Type":"ContainerStarted","Data":"1b99b47870a3ca1346a1894fb30fe0e2494241c8bc37c4264fb22c5583a54de1"} Jul 07 17:37:30.192823 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:30.192805 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k9ml9" event={"ID":"69257408-0117-4007-bb96-b96de8037f99","Type":"ContainerStarted","Data":"2f22bb450cc93bc01093604d56dec682e9d210b43ab7850f971a7affe36941cd"} Jul 07 17:37:30.445343 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:30.445263 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a1510f8-addf-440c-b143-a96e531fac41-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-kgw97\" (UID: \"5a1510f8-addf-440c-b143-a96e531fac41\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kgw97" Jul 07 17:37:30.445461 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:30.445413 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 17:37:30.445497 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:30.445475 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a1510f8-addf-440c-b143-a96e531fac41-cluster-monitoring-operator-tls podName:5a1510f8-addf-440c-b143-a96e531fac41 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:31.445459299 +0000 UTC m=+52.027466022 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5a1510f8-addf-440c-b143-a96e531fac41-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-kgw97" (UID: "5a1510f8-addf-440c-b143-a96e531fac41") : secret "cluster-monitoring-operator-tls" not found Jul 07 17:37:31.050357 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:31.050325 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-registry-tls\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:31.050357 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:31.050359 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4a92b0f-9630-4124-be07-9e5abbffe853-metrics-tls\") pod \"dns-default-txqgg\" (UID: \"b4a92b0f-9630-4124-be07-9e5abbffe853\") " pod="openshift-dns/dns-default-txqgg" Jul 07 17:37:31.050757 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:31.050468 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 17:37:31.050757 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:31.050472 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 17:37:31.050757 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:31.050488 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54b8fcb74-vmn2p: secret "image-registry-tls" not found Jul 07 17:37:31.050757 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:31.050514 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4a92b0f-9630-4124-be07-9e5abbffe853-metrics-tls podName:b4a92b0f-9630-4124-be07-9e5abbffe853 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:47.050502022 +0000 UTC m=+67.632508746 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4a92b0f-9630-4124-be07-9e5abbffe853-metrics-tls") pod "dns-default-txqgg" (UID: "b4a92b0f-9630-4124-be07-9e5abbffe853") : secret "dns-default-metrics-tls" not found Jul 07 17:37:31.050757 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:31.050526 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-registry-tls podName:53ba0933-91e4-4870-858f-a15537f35025 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:47.05052019 +0000 UTC m=+67.632526913 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-registry-tls") pod "image-registry-54b8fcb74-vmn2p" (UID: "53ba0933-91e4-4870-858f-a15537f35025") : secret "image-registry-tls" not found Jul 07 17:37:31.453584 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:31.453551 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a1510f8-addf-440c-b143-a96e531fac41-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-kgw97\" (UID: \"5a1510f8-addf-440c-b143-a96e531fac41\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kgw97" Jul 07 17:37:31.453754 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:31.453696 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 17:37:31.453818 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:31.453767 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a1510f8-addf-440c-b143-a96e531fac41-cluster-monitoring-operator-tls podName:5a1510f8-addf-440c-b143-a96e531fac41 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:33.453748114 +0000 UTC m=+54.035754852 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5a1510f8-addf-440c-b143-a96e531fac41-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-kgw97" (UID: "5a1510f8-addf-440c-b143-a96e531fac41") : secret "cluster-monitoring-operator-tls" not found Jul 07 17:37:32.199175 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:32.199100 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k9ml9" event={"ID":"69257408-0117-4007-bb96-b96de8037f99","Type":"ContainerStarted","Data":"3b366e9f45654b7364afcc0a55a47168ac2594a1096312a2b172024c0d68e915"} Jul 07 17:37:32.212742 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:32.212698 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k9ml9" podStartSLOduration=1.337114037 podStartE2EDuration="3.212683371s" totalImagesPullingTime="1.875569334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:37:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:32.2123947 +0000 UTC m=+52.794401445" watchObservedRunningTime="2026-07-07 17:37:32.212683371 +0000 UTC m=+52.794690115" Jul 07 17:37:33.202936 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:33.202899 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-fn9zf" event={"ID":"a58d9422-ad7b-4281-b918-bbe01ccff305","Type":"ContainerStarted","Data":"5150148c43dc965c4a25adb91904576868e1577a84895a8cf1f4ac0f5cc73b20"} Jul 07 17:37:33.222267 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:33.222213 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-fn9zf" podStartSLOduration=1.442033108 podStartE2EDuration="4.222195049s" totalImagesPullingTime="2.780161941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:37:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:33.221185461 +0000 UTC m=+53.803192206" watchObservedRunningTime="2026-07-07 17:37:33.222195049 +0000 UTC m=+53.804201793" Jul 07 17:37:33.470449 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:33.470360 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a1510f8-addf-440c-b143-a96e531fac41-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-kgw97\" (UID: \"5a1510f8-addf-440c-b143-a96e531fac41\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kgw97" Jul 07 17:37:33.470580 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:33.470505 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 17:37:33.470580 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:33.470562 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a1510f8-addf-440c-b143-a96e531fac41-cluster-monitoring-operator-tls podName:5a1510f8-addf-440c-b143-a96e531fac41 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:37.470549099 +0000 UTC m=+58.052555825 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5a1510f8-addf-440c-b143-a96e531fac41-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-kgw97" (UID: "5a1510f8-addf-440c-b143-a96e531fac41") : secret "cluster-monitoring-operator-tls" not found Jul 07 17:37:34.124624 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:34.124589 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xkszl"] Jul 07 17:37:34.126628 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:34.126614 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xkszl" Jul 07 17:37:34.128736 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:34.128717 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 17:37:34.128883 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:34.128866 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 17:37:34.128975 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:34.128944 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7mx9j\"" Jul 07 17:37:34.140928 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:34.140908 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xkszl"] Jul 07 17:37:34.176934 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:34.176907 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad924563-218f-4c56-b3b8-06f813e48573-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xkszl\" (UID: \"ad924563-218f-4c56-b3b8-06f813e48573\") " pod="openshift-insights/insights-runtime-extractor-xkszl" Jul 07 17:37:34.177053 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:34.176999 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qw2v\" (UniqueName: \"kubernetes.io/projected/ad924563-218f-4c56-b3b8-06f813e48573-kube-api-access-4qw2v\") pod \"insights-runtime-extractor-xkszl\" (UID: \"ad924563-218f-4c56-b3b8-06f813e48573\") " pod="openshift-insights/insights-runtime-extractor-xkszl" Jul 07 17:37:34.177053 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:34.177036 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ad924563-218f-4c56-b3b8-06f813e48573-crio-socket\") pod \"insights-runtime-extractor-xkszl\" (UID: \"ad924563-218f-4c56-b3b8-06f813e48573\") " pod="openshift-insights/insights-runtime-extractor-xkszl" Jul 07 17:37:34.177121 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:34.177084 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad924563-218f-4c56-b3b8-06f813e48573-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xkszl\" (UID: \"ad924563-218f-4c56-b3b8-06f813e48573\") " pod="openshift-insights/insights-runtime-extractor-xkszl" Jul 07 17:37:34.177121 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:34.177105 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad924563-218f-4c56-b3b8-06f813e48573-data-volume\") pod \"insights-runtime-extractor-xkszl\" (UID: \"ad924563-218f-4c56-b3b8-06f813e48573\") " pod="openshift-insights/insights-runtime-extractor-xkszl" Jul 07 17:37:34.277400 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:34.277371 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad924563-218f-4c56-b3b8-06f813e48573-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xkszl\" (UID: \"ad924563-218f-4c56-b3b8-06f813e48573\") " pod="openshift-insights/insights-runtime-extractor-xkszl" Jul 07 17:37:34.277810 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:34.277463 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qw2v\" (UniqueName: \"kubernetes.io/projected/ad924563-218f-4c56-b3b8-06f813e48573-kube-api-access-4qw2v\") pod \"insights-runtime-extractor-xkszl\" (UID: \"ad924563-218f-4c56-b3b8-06f813e48573\") " pod="openshift-insights/insights-runtime-extractor-xkszl" Jul 07 17:37:34.277810 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:34.277527 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 17:37:34.277810 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:34.277586 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ad924563-218f-4c56-b3b8-06f813e48573-crio-socket\") pod \"insights-runtime-extractor-xkszl\" (UID: \"ad924563-218f-4c56-b3b8-06f813e48573\") " pod="openshift-insights/insights-runtime-extractor-xkszl" Jul 07 17:37:34.277810 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:34.277609 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad924563-218f-4c56-b3b8-06f813e48573-insights-runtime-extractor-tls podName:ad924563-218f-4c56-b3b8-06f813e48573 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:34.777587711 +0000 UTC m=+55.359594454 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ad924563-218f-4c56-b3b8-06f813e48573-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xkszl" (UID: "ad924563-218f-4c56-b3b8-06f813e48573") : secret "insights-runtime-extractor-tls" not found Jul 07 17:37:34.277810 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:34.277655 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ad924563-218f-4c56-b3b8-06f813e48573-crio-socket\") pod \"insights-runtime-extractor-xkszl\" (UID: \"ad924563-218f-4c56-b3b8-06f813e48573\") " pod="openshift-insights/insights-runtime-extractor-xkszl" Jul 07 17:37:34.277810 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:34.277726 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad924563-218f-4c56-b3b8-06f813e48573-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xkszl\" (UID: \"ad924563-218f-4c56-b3b8-06f813e48573\") " pod="openshift-insights/insights-runtime-extractor-xkszl" Jul 07 17:37:34.277810 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:34.277782 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad924563-218f-4c56-b3b8-06f813e48573-data-volume\") pod \"insights-runtime-extractor-xkszl\" (UID: \"ad924563-218f-4c56-b3b8-06f813e48573\") " pod="openshift-insights/insights-runtime-extractor-xkszl" Jul 07 17:37:34.278120 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:34.277822 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 17:37:34.278120 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:34.277878 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad924563-218f-4c56-b3b8-06f813e48573-kube-rbac-proxy-cm podName:ad924563-218f-4c56-b3b8-06f813e48573 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:34.777860532 +0000 UTC m=+55.359867274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ad924563-218f-4c56-b3b8-06f813e48573-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xkszl" (UID: "ad924563-218f-4c56-b3b8-06f813e48573") : configmap "kube-rbac-proxy" not found Jul 07 17:37:34.278120 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:34.278041 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad924563-218f-4c56-b3b8-06f813e48573-data-volume\") pod \"insights-runtime-extractor-xkszl\" (UID: \"ad924563-218f-4c56-b3b8-06f813e48573\") " pod="openshift-insights/insights-runtime-extractor-xkszl" Jul 07 17:37:34.284967 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:34.284945 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qw2v\" (UniqueName: \"kubernetes.io/projected/ad924563-218f-4c56-b3b8-06f813e48573-kube-api-access-4qw2v\") pod \"insights-runtime-extractor-xkszl\" (UID: \"ad924563-218f-4c56-b3b8-06f813e48573\") " pod="openshift-insights/insights-runtime-extractor-xkszl" Jul 07 17:37:34.782283 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:34.782257 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad924563-218f-4c56-b3b8-06f813e48573-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xkszl\" (UID: \"ad924563-218f-4c56-b3b8-06f813e48573\") " pod="openshift-insights/insights-runtime-extractor-xkszl" Jul 07 17:37:34.782450 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:34.782295 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad924563-218f-4c56-b3b8-06f813e48573-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xkszl\" (UID: \"ad924563-218f-4c56-b3b8-06f813e48573\") " pod="openshift-insights/insights-runtime-extractor-xkszl" Jul 07 17:37:34.782450 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:34.782369 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 17:37:34.782450 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:34.782390 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 17:37:34.782450 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:34.782429 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad924563-218f-4c56-b3b8-06f813e48573-kube-rbac-proxy-cm podName:ad924563-218f-4c56-b3b8-06f813e48573 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:35.782415059 +0000 UTC m=+56.364421782 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ad924563-218f-4c56-b3b8-06f813e48573-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xkszl" (UID: "ad924563-218f-4c56-b3b8-06f813e48573") : configmap "kube-rbac-proxy" not found Jul 07 17:37:34.782450 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:34.782442 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad924563-218f-4c56-b3b8-06f813e48573-insights-runtime-extractor-tls podName:ad924563-218f-4c56-b3b8-06f813e48573 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:35.782436641 +0000 UTC m=+56.364443364 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ad924563-218f-4c56-b3b8-06f813e48573-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xkszl" (UID: "ad924563-218f-4c56-b3b8-06f813e48573") : secret "insights-runtime-extractor-tls" not found Jul 07 17:37:35.789191 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:35.789160 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad924563-218f-4c56-b3b8-06f813e48573-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xkszl\" (UID: \"ad924563-218f-4c56-b3b8-06f813e48573\") " pod="openshift-insights/insights-runtime-extractor-xkszl" Jul 07 17:37:35.789549 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:35.789201 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad924563-218f-4c56-b3b8-06f813e48573-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xkszl\" (UID: \"ad924563-218f-4c56-b3b8-06f813e48573\") " pod="openshift-insights/insights-runtime-extractor-xkszl" Jul 07 17:37:35.789549 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:35.789279 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 17:37:35.789549 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:35.789321 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 17:37:35.789549 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:35.789364 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad924563-218f-4c56-b3b8-06f813e48573-kube-rbac-proxy-cm podName:ad924563-218f-4c56-b3b8-06f813e48573 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:37.789345398 +0000 UTC m=+58.371352131 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ad924563-218f-4c56-b3b8-06f813e48573-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xkszl" (UID: "ad924563-218f-4c56-b3b8-06f813e48573") : configmap "kube-rbac-proxy" not found Jul 07 17:37:35.789549 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:35.789380 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad924563-218f-4c56-b3b8-06f813e48573-insights-runtime-extractor-tls podName:ad924563-218f-4c56-b3b8-06f813e48573 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:37.789373322 +0000 UTC m=+58.371380045 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ad924563-218f-4c56-b3b8-06f813e48573-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xkszl" (UID: "ad924563-218f-4c56-b3b8-06f813e48573") : secret "insights-runtime-extractor-tls" not found Jul 07 17:37:36.305664 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:36.305642 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ng458_2a75a377-7143-4174-94c5-4c50edb05db7/dns-node-resolver/0.log" Jul 07 17:37:36.905817 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:36.905794 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5bd9q_0ff7ea17-d539-44d4-8c47-b9f1f6a145b6/node-ca/0.log" Jul 07 17:37:37.499163 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:37.499137 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a1510f8-addf-440c-b143-a96e531fac41-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-kgw97\" (UID: \"5a1510f8-addf-440c-b143-a96e531fac41\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kgw97" Jul 07 17:37:37.499328 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:37.499287 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 17:37:37.499371 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:37.499358 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a1510f8-addf-440c-b143-a96e531fac41-cluster-monitoring-operator-tls podName:5a1510f8-addf-440c-b143-a96e531fac41 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:45.49934261 +0000 UTC m=+66.081349338 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5a1510f8-addf-440c-b143-a96e531fac41-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-kgw97" (UID: "5a1510f8-addf-440c-b143-a96e531fac41") : secret "cluster-monitoring-operator-tls" not found Jul 07 17:37:37.802077 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:37.802005 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad924563-218f-4c56-b3b8-06f813e48573-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xkszl\" (UID: \"ad924563-218f-4c56-b3b8-06f813e48573\") " pod="openshift-insights/insights-runtime-extractor-xkszl" Jul 07 17:37:37.802221 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:37.802096 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad924563-218f-4c56-b3b8-06f813e48573-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xkszl\" (UID: \"ad924563-218f-4c56-b3b8-06f813e48573\") " pod="openshift-insights/insights-runtime-extractor-xkszl" Jul 07 17:37:37.802221 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:37.802151 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 17:37:37.802221 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:37.802208 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad924563-218f-4c56-b3b8-06f813e48573-insights-runtime-extractor-tls podName:ad924563-218f-4c56-b3b8-06f813e48573 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:41.802194381 +0000 UTC m=+62.384201104 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ad924563-218f-4c56-b3b8-06f813e48573-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xkszl" (UID: "ad924563-218f-4c56-b3b8-06f813e48573") : secret "insights-runtime-extractor-tls" not found Jul 07 17:37:37.802221 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:37.802156 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 17:37:37.802434 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:37.802238 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad924563-218f-4c56-b3b8-06f813e48573-kube-rbac-proxy-cm podName:ad924563-218f-4c56-b3b8-06f813e48573 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:41.80223241 +0000 UTC m=+62.384239133 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ad924563-218f-4c56-b3b8-06f813e48573-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xkszl" (UID: "ad924563-218f-4c56-b3b8-06f813e48573") : configmap "kube-rbac-proxy" not found Jul 07 17:37:38.106495 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:38.106430 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vrvvv_85eb217f-d46a-4dec-ac32-73b5d41f96d2/serve-healthcheck-canary/0.log" Jul 07 17:37:40.149039 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:40.149014 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x765g" Jul 07 17:37:41.834674 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:41.834639 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad924563-218f-4c56-b3b8-06f813e48573-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xkszl\" (UID: \"ad924563-218f-4c56-b3b8-06f813e48573\") " pod="openshift-insights/insights-runtime-extractor-xkszl" Jul 07 17:37:41.835062 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:41.834736 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad924563-218f-4c56-b3b8-06f813e48573-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xkszl\" (UID: \"ad924563-218f-4c56-b3b8-06f813e48573\") " pod="openshift-insights/insights-runtime-extractor-xkszl" Jul 07 17:37:41.835062 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:41.834784 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 17:37:41.835062 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:41.834796 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 17:37:41.835062 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:41.834844 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad924563-218f-4c56-b3b8-06f813e48573-insights-runtime-extractor-tls podName:ad924563-218f-4c56-b3b8-06f813e48573 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:49.834830089 +0000 UTC m=+70.416836812 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ad924563-218f-4c56-b3b8-06f813e48573-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xkszl" (UID: "ad924563-218f-4c56-b3b8-06f813e48573") : secret "insights-runtime-extractor-tls" not found Jul 07 17:37:41.835062 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:41.834859 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad924563-218f-4c56-b3b8-06f813e48573-kube-rbac-proxy-cm podName:ad924563-218f-4c56-b3b8-06f813e48573 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:49.834852889 +0000 UTC m=+70.416859612 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ad924563-218f-4c56-b3b8-06f813e48573-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xkszl" (UID: "ad924563-218f-4c56-b3b8-06f813e48573") : configmap "kube-rbac-proxy" not found Jul 07 17:37:45.563963 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:45.563931 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a1510f8-addf-440c-b143-a96e531fac41-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-kgw97\" (UID: \"5a1510f8-addf-440c-b143-a96e531fac41\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kgw97" Jul 07 17:37:45.564409 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:45.563973 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-original-pull-secret\") pod \"global-pull-secret-syncer-mxgbv\" (UID: \"ee071d67-b30e-43c6-bc8b-6ef2cd711a52\") " pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:37:45.564409 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:45.563992 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/169258da-bb2c-4e58-8e93-447b39ef7da2-metrics-certs\") pod \"network-metrics-daemon-nrwlq\" (UID: \"169258da-bb2c-4e58-8e93-447b39ef7da2\") " pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:37:45.564409 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:45.564012 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2bnk\" (UniqueName: \"kubernetes.io/projected/4b7e95da-8e96-4bbc-9579-8850344048c8-kube-api-access-d2bnk\") pod \"network-check-target-mcxjj\" (UID: \"4b7e95da-8e96-4bbc-9579-8850344048c8\") " pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:37:45.564409 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:45.564120 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 17:37:45.564409 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:45.564202 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a1510f8-addf-440c-b143-a96e531fac41-cluster-monitoring-operator-tls podName:5a1510f8-addf-440c-b143-a96e531fac41 nodeName:}" failed. No retries permitted until 2026-07-07 17:38:01.564185286 +0000 UTC m=+82.146192012 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5a1510f8-addf-440c-b143-a96e531fac41-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-kgw97" (UID: "5a1510f8-addf-440c-b143-a96e531fac41") : secret "cluster-monitoring-operator-tls" not found Jul 07 17:37:45.566362 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:45.566335 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 17:37:45.566560 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:45.566548 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 17:37:45.566611 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:45.566593 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 17:37:45.575273 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:45.575254 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 07 17:37:45.575359 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:37:45.575326 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/169258da-bb2c-4e58-8e93-447b39ef7da2-metrics-certs podName:169258da-bb2c-4e58-8e93-447b39ef7da2 nodeName:}" failed. No retries permitted until 2026-07-07 17:38:49.575294216 +0000 UTC m=+130.157300969 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/169258da-bb2c-4e58-8e93-447b39ef7da2-metrics-certs") pod "network-metrics-daemon-nrwlq" (UID: "169258da-bb2c-4e58-8e93-447b39ef7da2") : secret "metrics-daemon-secret" not found Jul 07 17:37:45.577265 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:45.577246 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ee071d67-b30e-43c6-bc8b-6ef2cd711a52-original-pull-secret\") pod \"global-pull-secret-syncer-mxgbv\" (UID: \"ee071d67-b30e-43c6-bc8b-6ef2cd711a52\") " pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:37:45.577265 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:45.577257 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 17:37:45.588124 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:45.588103 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2bnk\" (UniqueName: \"kubernetes.io/projected/4b7e95da-8e96-4bbc-9579-8850344048c8-kube-api-access-d2bnk\") pod \"network-check-target-mcxjj\" (UID: \"4b7e95da-8e96-4bbc-9579-8850344048c8\") " pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:37:45.676819 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:45.676794 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxgbv" Jul 07 17:37:45.687651 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:45.687635 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f7nks\"" Jul 07 17:37:45.696292 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:45.696274 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:37:45.808623 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:45.808597 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mxgbv"] Jul 07 17:37:45.811431 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:37:45.811404 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee071d67_b30e_43c6_bc8b_6ef2cd711a52.slice/crio-4673fd2b8021fbc68476629dd8baf8704051af2d29f9b6d4ae373be6beeabfff WatchSource:0}: Error finding container 4673fd2b8021fbc68476629dd8baf8704051af2d29f9b6d4ae373be6beeabfff: Status 404 returned error can't find the container with id 4673fd2b8021fbc68476629dd8baf8704051af2d29f9b6d4ae373be6beeabfff Jul 07 17:37:45.822799 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:45.822778 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mcxjj"] Jul 07 17:37:45.825409 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:37:45.825387 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b7e95da_8e96_4bbc_9579_8850344048c8.slice/crio-d38a2f4a96c657385c2d9308e4ccab5c5b7fa897314bd77340a2f9794ba1ee05 WatchSource:0}: Error finding container d38a2f4a96c657385c2d9308e4ccab5c5b7fa897314bd77340a2f9794ba1ee05: Status 404 returned error can't find the container with id d38a2f4a96c657385c2d9308e4ccab5c5b7fa897314bd77340a2f9794ba1ee05 Jul 07 17:37:46.233589 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:46.233557 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mxgbv" event={"ID":"ee071d67-b30e-43c6-bc8b-6ef2cd711a52","Type":"ContainerStarted","Data":"4673fd2b8021fbc68476629dd8baf8704051af2d29f9b6d4ae373be6beeabfff"} Jul 07 17:37:46.234736 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:46.234707 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mcxjj" event={"ID":"4b7e95da-8e96-4bbc-9579-8850344048c8","Type":"ContainerStarted","Data":"d38a2f4a96c657385c2d9308e4ccab5c5b7fa897314bd77340a2f9794ba1ee05"} Jul 07 17:37:47.076394 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:47.076338 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-registry-tls\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:47.076394 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:47.076397 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4a92b0f-9630-4124-be07-9e5abbffe853-metrics-tls\") pod \"dns-default-txqgg\" (UID: \"b4a92b0f-9630-4124-be07-9e5abbffe853\") " pod="openshift-dns/dns-default-txqgg" Jul 07 17:37:47.079206 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:47.079154 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4a92b0f-9630-4124-be07-9e5abbffe853-metrics-tls\") pod \"dns-default-txqgg\" (UID: \"b4a92b0f-9630-4124-be07-9e5abbffe853\") " pod="openshift-dns/dns-default-txqgg" Jul 07 17:37:47.079748 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:47.079723 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-registry-tls\") pod \"image-registry-54b8fcb74-vmn2p\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:47.328712 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:47.328478 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hdmrj\"" Jul 07 17:37:47.337455 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:47.337249 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:47.359468 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:47.359414 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2vm2m\"" Jul 07 17:37:47.368233 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:47.368212 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-txqgg" Jul 07 17:37:47.513613 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:47.513586 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54b8fcb74-vmn2p"] Jul 07 17:37:47.519565 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:37:47.519531 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53ba0933_91e4_4870_858f_a15537f35025.slice/crio-64f740421e2d72e1b1fa3b5ef4a6f24f68824c1a22c066b432395f82c8554716 WatchSource:0}: Error finding container 64f740421e2d72e1b1fa3b5ef4a6f24f68824c1a22c066b432395f82c8554716: Status 404 returned error can't find the container with id 64f740421e2d72e1b1fa3b5ef4a6f24f68824c1a22c066b432395f82c8554716 Jul 07 17:37:47.533643 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:47.532582 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-txqgg"] Jul 07 17:37:47.537046 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:37:47.537023 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4a92b0f_9630_4124_be07_9e5abbffe853.slice/crio-175e5107145ba5cf977a721f96ae4ee4af02f541ddedece0b1b0dd1b42ee41ac WatchSource:0}: Error finding container 175e5107145ba5cf977a721f96ae4ee4af02f541ddedece0b1b0dd1b42ee41ac: Status 404 returned error can't find the container with id 175e5107145ba5cf977a721f96ae4ee4af02f541ddedece0b1b0dd1b42ee41ac Jul 07 17:37:48.242699 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:48.242654 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-txqgg" event={"ID":"b4a92b0f-9630-4124-be07-9e5abbffe853","Type":"ContainerStarted","Data":"175e5107145ba5cf977a721f96ae4ee4af02f541ddedece0b1b0dd1b42ee41ac"} Jul 07 17:37:48.244554 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:48.244525 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" event={"ID":"53ba0933-91e4-4870-858f-a15537f35025","Type":"ContainerStarted","Data":"9458291caa19e9cb5d19f5aed1f3b2cef21e157eba6dbb53747fe502c7fc1065"} Jul 07 17:37:48.244669 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:48.244575 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" event={"ID":"53ba0933-91e4-4870-858f-a15537f35025","Type":"ContainerStarted","Data":"64f740421e2d72e1b1fa3b5ef4a6f24f68824c1a22c066b432395f82c8554716"} Jul 07 17:37:48.244768 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:48.244751 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:37:48.264647 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:48.264571 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" podStartSLOduration=70.264553428 podStartE2EDuration="1m10.264553428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:36:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:48.263886199 +0000 UTC m=+68.845892944" watchObservedRunningTime="2026-07-07 17:37:48.264553428 +0000 UTC m=+68.846560166" Jul 07 17:37:49.899763 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:49.899731 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad924563-218f-4c56-b3b8-06f813e48573-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xkszl\" (UID: \"ad924563-218f-4c56-b3b8-06f813e48573\") " pod="openshift-insights/insights-runtime-extractor-xkszl" Jul 07 17:37:49.900165 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:49.899774 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad924563-218f-4c56-b3b8-06f813e48573-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xkszl\" (UID: \"ad924563-218f-4c56-b3b8-06f813e48573\") " pod="openshift-insights/insights-runtime-extractor-xkszl" Jul 07 17:37:49.900354 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:49.900333 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad924563-218f-4c56-b3b8-06f813e48573-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xkszl\" (UID: \"ad924563-218f-4c56-b3b8-06f813e48573\") " pod="openshift-insights/insights-runtime-extractor-xkszl" Jul 07 17:37:49.902281 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:49.902256 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad924563-218f-4c56-b3b8-06f813e48573-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xkszl\" (UID: \"ad924563-218f-4c56-b3b8-06f813e48573\") " pod="openshift-insights/insights-runtime-extractor-xkszl" Jul 07 17:37:50.037603 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:50.037575 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7mx9j\"" Jul 07 17:37:50.046316 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:50.046274 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xkszl" Jul 07 17:37:50.686913 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:50.686879 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xkszl"] Jul 07 17:37:50.689076 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:37:50.689056 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad924563_218f_4c56_b3b8_06f813e48573.slice/crio-545a4ae9be71aae5834d0aaac843362caa93ce88ba555ce6e98648d82525dfdc WatchSource:0}: Error finding container 545a4ae9be71aae5834d0aaac843362caa93ce88ba555ce6e98648d82525dfdc: Status 404 returned error can't find the container with id 545a4ae9be71aae5834d0aaac843362caa93ce88ba555ce6e98648d82525dfdc Jul 07 17:37:51.256379 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:51.256341 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mcxjj" event={"ID":"4b7e95da-8e96-4bbc-9579-8850344048c8","Type":"ContainerStarted","Data":"cffd135a7e619ae7d4c18320eb198a9733e05844cecd07ff8f46c60ecb8b5604"} Jul 07 17:37:51.256826 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:51.256597 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:37:51.258966 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:51.258941 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-txqgg" event={"ID":"b4a92b0f-9630-4124-be07-9e5abbffe853","Type":"ContainerStarted","Data":"2ed84a053231cbf2ecc4cb83ac039a537af709cba1cf12060d4247c1edae3ec6"} Jul 07 17:37:51.259093 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:51.258982 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-txqgg" event={"ID":"b4a92b0f-9630-4124-be07-9e5abbffe853","Type":"ContainerStarted","Data":"90d55d4a363cbce5d6f459bcfadcb363c2255830d332d85b9007abef15155b83"} Jul 07 17:37:51.259465 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:51.259447 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-txqgg" Jul 07 17:37:51.261789 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:51.261764 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mxgbv" event={"ID":"ee071d67-b30e-43c6-bc8b-6ef2cd711a52","Type":"ContainerStarted","Data":"3115629f3d591ad4eed601e853d2082fd032b6b5b11b62970bdefdac6d83d999"} Jul 07 17:37:51.263602 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:51.263580 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xkszl" event={"ID":"ad924563-218f-4c56-b3b8-06f813e48573","Type":"ContainerStarted","Data":"545a4ae9be71aae5834d0aaac843362caa93ce88ba555ce6e98648d82525dfdc"} Jul 07 17:37:51.290355 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:51.288984 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mcxjj" podStartSLOduration=66.564966644 podStartE2EDuration="1m11.288970271s" totalImagesPullingTime="4.724003627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:51.273247065 +0000 UTC m=+71.855253823" watchObservedRunningTime="2026-07-07 17:37:51.288970271 +0000 UTC m=+71.870977016" Jul 07 17:37:51.308620 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:51.308576 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mxgbv" podStartSLOduration=66.551372755 podStartE2EDuration="1m11.308558862s" totalImagesPullingTime="4.757186107s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:51.304443382 +0000 UTC m=+71.886450128" watchObservedRunningTime="2026-07-07 17:37:51.308558862 +0000 UTC m=+71.890565607" Jul 07 17:37:51.309199 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:51.309159 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-txqgg" podStartSLOduration=33.272434586 podStartE2EDuration="36.309146573s" totalImagesPullingTime="3.036711987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:51.290495036 +0000 UTC m=+71.872501784" watchObservedRunningTime="2026-07-07 17:37:51.309146573 +0000 UTC m=+71.891153319" Jul 07 17:37:55.277731 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:55.277663 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xkszl" event={"ID":"ad924563-218f-4c56-b3b8-06f813e48573","Type":"ContainerStarted","Data":"005cfbc8f4c0a85fa099ad33122d51666e2c3abab4dba0df8b0d3c7808a1d915"} Jul 07 17:37:55.277731 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:55.277725 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xkszl" event={"ID":"ad924563-218f-4c56-b3b8-06f813e48573","Type":"ContainerStarted","Data":"b675aab6a0ee6131cce1d96874950a0a1013f7e2cf3c06d48121b730e29dd504"} Jul 07 17:37:57.105020 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.104990 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c4b77c9b4-dqxht"] Jul 07 17:37:57.112573 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.112550 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw"] Jul 07 17:37:57.112696 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.112677 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c4b77c9b4-dqxht" Jul 07 17:37:57.114753 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.114733 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 07 17:37:57.114753 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.114749 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 07 17:37:57.115056 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.115039 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vs488\"" Jul 07 17:37:57.115121 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.115039 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 07 17:37:57.115581 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.115496 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 07 17:37:57.115886 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.115869 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw" Jul 07 17:37:57.117613 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.117575 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c4b77c9b4-dqxht"] Jul 07 17:37:57.117710 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.117625 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 07 17:37:57.117858 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.117840 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 07 17:37:57.118068 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.118049 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 07 17:37:57.118878 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.118335 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 07 17:37:57.119774 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.119733 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw"] Jul 07 17:37:57.152834 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.152814 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1ff73fb2-e91f-46f8-b52a-e4996f40f88d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c4b77c9b4-dqxht\" (UID: \"1ff73fb2-e91f-46f8-b52a-e4996f40f88d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c4b77c9b4-dqxht" Jul 07 17:37:57.152942 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.152845 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6lsm\" (UniqueName: \"kubernetes.io/projected/1ff73fb2-e91f-46f8-b52a-e4996f40f88d-kube-api-access-k6lsm\") pod \"managed-serviceaccount-addon-agent-c4b77c9b4-dqxht\" (UID: \"1ff73fb2-e91f-46f8-b52a-e4996f40f88d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c4b77c9b4-dqxht" Jul 07 17:37:57.253746 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.253713 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f14fea77-787b-4ed8-b401-b6f1448c42d4-hub\") pod \"cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw\" (UID: \"f14fea77-787b-4ed8-b401-b6f1448c42d4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw" Jul 07 17:37:57.253902 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.253762 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f14fea77-787b-4ed8-b401-b6f1448c42d4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw\" (UID: \"f14fea77-787b-4ed8-b401-b6f1448c42d4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw" Jul 07 17:37:57.253902 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.253787 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn9jm\" (UniqueName: \"kubernetes.io/projected/f14fea77-787b-4ed8-b401-b6f1448c42d4-kube-api-access-nn9jm\") pod \"cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw\" (UID: \"f14fea77-787b-4ed8-b401-b6f1448c42d4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw" Jul 07 17:37:57.253902 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.253832 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f14fea77-787b-4ed8-b401-b6f1448c42d4-ca\") pod \"cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw\" (UID: \"f14fea77-787b-4ed8-b401-b6f1448c42d4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw" Jul 07 17:37:57.253902 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.253853 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f14fea77-787b-4ed8-b401-b6f1448c42d4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw\" (UID: \"f14fea77-787b-4ed8-b401-b6f1448c42d4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw" Jul 07 17:37:57.253902 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.253895 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1ff73fb2-e91f-46f8-b52a-e4996f40f88d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c4b77c9b4-dqxht\" (UID: \"1ff73fb2-e91f-46f8-b52a-e4996f40f88d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c4b77c9b4-dqxht" Jul 07 17:37:57.254159 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.253921 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6lsm\" (UniqueName: \"kubernetes.io/projected/1ff73fb2-e91f-46f8-b52a-e4996f40f88d-kube-api-access-k6lsm\") pod \"managed-serviceaccount-addon-agent-c4b77c9b4-dqxht\" (UID: \"1ff73fb2-e91f-46f8-b52a-e4996f40f88d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c4b77c9b4-dqxht" Jul 07 17:37:57.254159 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.254021 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f14fea77-787b-4ed8-b401-b6f1448c42d4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw\" (UID: \"f14fea77-787b-4ed8-b401-b6f1448c42d4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw" Jul 07 17:37:57.256697 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.256668 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1ff73fb2-e91f-46f8-b52a-e4996f40f88d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c4b77c9b4-dqxht\" (UID: \"1ff73fb2-e91f-46f8-b52a-e4996f40f88d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c4b77c9b4-dqxht" Jul 07 17:37:57.275628 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.275605 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6lsm\" (UniqueName: \"kubernetes.io/projected/1ff73fb2-e91f-46f8-b52a-e4996f40f88d-kube-api-access-k6lsm\") pod \"managed-serviceaccount-addon-agent-c4b77c9b4-dqxht\" (UID: \"1ff73fb2-e91f-46f8-b52a-e4996f40f88d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c4b77c9b4-dqxht" Jul 07 17:37:57.355193 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.355130 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f14fea77-787b-4ed8-b401-b6f1448c42d4-ca\") pod \"cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw\" (UID: \"f14fea77-787b-4ed8-b401-b6f1448c42d4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw" Jul 07 17:37:57.355193 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.355168 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f14fea77-787b-4ed8-b401-b6f1448c42d4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw\" (UID: \"f14fea77-787b-4ed8-b401-b6f1448c42d4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw" Jul 07 17:37:57.355400 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.355235 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f14fea77-787b-4ed8-b401-b6f1448c42d4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw\" (UID: \"f14fea77-787b-4ed8-b401-b6f1448c42d4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw" Jul 07 17:37:57.355463 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.355401 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f14fea77-787b-4ed8-b401-b6f1448c42d4-hub\") pod \"cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw\" (UID: \"f14fea77-787b-4ed8-b401-b6f1448c42d4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw" Jul 07 17:37:57.355463 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.355449 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f14fea77-787b-4ed8-b401-b6f1448c42d4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw\" (UID: \"f14fea77-787b-4ed8-b401-b6f1448c42d4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw" Jul 07 17:37:57.355905 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.355566 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn9jm\" (UniqueName: \"kubernetes.io/projected/f14fea77-787b-4ed8-b401-b6f1448c42d4-kube-api-access-nn9jm\") pod \"cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw\" (UID: \"f14fea77-787b-4ed8-b401-b6f1448c42d4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw" Jul 07 17:37:57.356160 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.356104 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f14fea77-787b-4ed8-b401-b6f1448c42d4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw\" (UID: \"f14fea77-787b-4ed8-b401-b6f1448c42d4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw" Jul 07 17:37:57.358222 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.358197 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f14fea77-787b-4ed8-b401-b6f1448c42d4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw\" (UID: \"f14fea77-787b-4ed8-b401-b6f1448c42d4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw" Jul 07 17:37:57.358343 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.358206 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f14fea77-787b-4ed8-b401-b6f1448c42d4-hub\") pod \"cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw\" (UID: \"f14fea77-787b-4ed8-b401-b6f1448c42d4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw" Jul 07 17:37:57.358343 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.358290 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f14fea77-787b-4ed8-b401-b6f1448c42d4-ca\") pod \"cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw\" (UID: \"f14fea77-787b-4ed8-b401-b6f1448c42d4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw" Jul 07 17:37:57.358467 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.358374 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f14fea77-787b-4ed8-b401-b6f1448c42d4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw\" (UID: \"f14fea77-787b-4ed8-b401-b6f1448c42d4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw" Jul 07 17:37:57.372776 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.372756 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn9jm\" (UniqueName: \"kubernetes.io/projected/f14fea77-787b-4ed8-b401-b6f1448c42d4-kube-api-access-nn9jm\") pod \"cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw\" (UID: \"f14fea77-787b-4ed8-b401-b6f1448c42d4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw" Jul 07 17:37:57.429949 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.429912 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c4b77c9b4-dqxht" Jul 07 17:37:57.435492 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.435466 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw" Jul 07 17:37:57.827117 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.827098 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw"] Jul 07 17:37:57.829269 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:37:57.829247 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf14fea77_787b_4ed8_b401_b6f1448c42d4.slice/crio-a472c7e047718a3eb97dcf980dad62423e5d08f9f7d9012efcc674c65191f11f WatchSource:0}: Error finding container a472c7e047718a3eb97dcf980dad62423e5d08f9f7d9012efcc674c65191f11f: Status 404 returned error can't find the container with id a472c7e047718a3eb97dcf980dad62423e5d08f9f7d9012efcc674c65191f11f Jul 07 17:37:57.840264 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:57.840243 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c4b77c9b4-dqxht"] Jul 07 17:37:57.842593 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:37:57.842567 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ff73fb2_e91f_46f8_b52a_e4996f40f88d.slice/crio-0e49a054d29c8e51a26de3cdd700803029f6dd041a613e773817be140d63a519 WatchSource:0}: Error finding container 0e49a054d29c8e51a26de3cdd700803029f6dd041a613e773817be140d63a519: Status 404 returned error can't find the container with id 0e49a054d29c8e51a26de3cdd700803029f6dd041a613e773817be140d63a519 Jul 07 17:37:58.290025 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:58.289988 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xkszl" event={"ID":"ad924563-218f-4c56-b3b8-06f813e48573","Type":"ContainerStarted","Data":"d1f31e9b9f9f172f06db418ba19e1060768a04c2a665b7247380de673b68b9ea"} Jul 07 17:37:58.291146 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:58.291122 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw" event={"ID":"f14fea77-787b-4ed8-b401-b6f1448c42d4","Type":"ContainerStarted","Data":"a472c7e047718a3eb97dcf980dad62423e5d08f9f7d9012efcc674c65191f11f"} Jul 07 17:37:58.292138 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:58.292118 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c4b77c9b4-dqxht" event={"ID":"1ff73fb2-e91f-46f8-b52a-e4996f40f88d","Type":"ContainerStarted","Data":"0e49a054d29c8e51a26de3cdd700803029f6dd041a613e773817be140d63a519"} Jul 07 17:37:58.305990 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:37:58.305944 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xkszl" podStartSLOduration=17.342507428 podStartE2EDuration="24.305927364s" totalImagesPullingTime="6.963419936s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:37:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:58.305640875 +0000 UTC m=+78.887647665" watchObservedRunningTime="2026-07-07 17:37:58.305927364 +0000 UTC m=+78.887934108" Jul 07 17:38:01.590805 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:01.590657 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a1510f8-addf-440c-b143-a96e531fac41-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-kgw97\" (UID: \"5a1510f8-addf-440c-b143-a96e531fac41\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kgw97" Jul 07 17:38:01.593159 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:01.593134 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a1510f8-addf-440c-b143-a96e531fac41-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-kgw97\" (UID: \"5a1510f8-addf-440c-b143-a96e531fac41\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kgw97" Jul 07 17:38:01.797388 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:01.797287 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-sn2tm\"" Jul 07 17:38:01.815338 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:01.809877 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kgw97" Jul 07 17:38:01.952027 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:01.952006 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kgw97"] Jul 07 17:38:01.966699 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:38:01.966671 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a1510f8_addf_440c_b143_a96e531fac41.slice/crio-d3aa7de0c455a0fa09b8ba2c8b8526c4d06d229ec6a9dcc699ddfddc64f6a7fe WatchSource:0}: Error finding container d3aa7de0c455a0fa09b8ba2c8b8526c4d06d229ec6a9dcc699ddfddc64f6a7fe: Status 404 returned error can't find the container with id d3aa7de0c455a0fa09b8ba2c8b8526c4d06d229ec6a9dcc699ddfddc64f6a7fe Jul 07 17:38:02.272212 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:02.272183 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-txqgg" Jul 07 17:38:02.309094 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:02.309065 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw" event={"ID":"f14fea77-787b-4ed8-b401-b6f1448c42d4","Type":"ContainerStarted","Data":"2f05807fe978c25b2ce369032984287348beda3e14a311099a34b1108ffebeed"} Jul 07 17:38:02.309240 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:02.309112 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw" event={"ID":"f14fea77-787b-4ed8-b401-b6f1448c42d4","Type":"ContainerStarted","Data":"ee4ce098da183424c5bb4a7a7e1f2f2ab92502158d85616e900025cafab78755"} Jul 07 17:38:02.309240 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:02.309150 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw" event={"ID":"f14fea77-787b-4ed8-b401-b6f1448c42d4","Type":"ContainerStarted","Data":"52f1a9290de62a1df1c2f0cb03f61f1a818e5b030e00f2cb0b7afa9e8052f2a3"} Jul 07 17:38:02.310658 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:02.310635 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c4b77c9b4-dqxht" event={"ID":"1ff73fb2-e91f-46f8-b52a-e4996f40f88d","Type":"ContainerStarted","Data":"dcf01d8cb3bf6eeb857a8f559b7e8c0370b86d3a946a9fa6ac15604d9cfadf6b"} Jul 07 17:38:02.311787 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:02.311761 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kgw97" event={"ID":"5a1510f8-addf-440c-b143-a96e531fac41","Type":"ContainerStarted","Data":"d3aa7de0c455a0fa09b8ba2c8b8526c4d06d229ec6a9dcc699ddfddc64f6a7fe"} Jul 07 17:38:02.329045 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:02.329007 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5c6dd66c-9ghsw" podStartSLOduration=1.408068022 podStartE2EDuration="5.328994661s" totalImagesPullingTime="3.920926639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:37:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:38:02.328577987 +0000 UTC m=+82.910584750" watchObservedRunningTime="2026-07-07 17:38:02.328994661 +0000 UTC m=+82.911001385" Jul 07 17:38:02.341548 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:02.341511 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c4b77c9b4-dqxht" podStartSLOduration=1.443825782 podStartE2EDuration="5.341501825s" totalImagesPullingTime="3.897676043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:37:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:38:02.341188623 +0000 UTC m=+82.923195373" watchObservedRunningTime="2026-07-07 17:38:02.341501825 +0000 UTC m=+82.923508569" Jul 07 17:38:04.319351 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:04.319326 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kgw97" event={"ID":"5a1510f8-addf-440c-b143-a96e531fac41","Type":"ContainerStarted","Data":"8ea6e9e51218f06e85a214fb1382f1bd07a36ededb70132fb4b3e86b8b12e391"} Jul 07 17:38:04.334602 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:04.334562 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kgw97" podStartSLOduration=33.047306448 podStartE2EDuration="35.33454815s" totalImagesPullingTime="2.287241702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:37:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:38:04.33329377 +0000 UTC m=+84.915300516" watchObservedRunningTime="2026-07-07 17:38:04.33454815 +0000 UTC m=+84.916554894" Jul 07 17:38:07.341683 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:07.341649 2552 patch_prober.go:28] interesting pod/image-registry-54b8fcb74-vmn2p container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 07 17:38:07.342067 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:07.341701 2552 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" podUID="53ba0933-91e4-4870-858f-a15537f35025" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 17:38:09.251925 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:09.251894 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:38:11.125024 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.124991 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wk2lv"] Jul 07 17:38:11.129201 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.129186 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wk2lv" Jul 07 17:38:11.132249 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.132224 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 17:38:11.132410 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.132283 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 17:38:11.132410 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.132323 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 17:38:11.132410 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.132332 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 17:38:11.132410 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.132338 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4gg69\"" Jul 07 17:38:11.258765 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.258735 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/72ba517f-9d8b-473d-a9fc-4407455632e0-node-exporter-tls\") pod \"node-exporter-wk2lv\" (UID: \"72ba517f-9d8b-473d-a9fc-4407455632e0\") " pod="openshift-monitoring/node-exporter-wk2lv" Jul 07 17:38:11.258914 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.258777 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72ba517f-9d8b-473d-a9fc-4407455632e0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wk2lv\" (UID: \"72ba517f-9d8b-473d-a9fc-4407455632e0\") " pod="openshift-monitoring/node-exporter-wk2lv" Jul 07 17:38:11.258914 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.258839 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72ba517f-9d8b-473d-a9fc-4407455632e0-sys\") pod \"node-exporter-wk2lv\" (UID: \"72ba517f-9d8b-473d-a9fc-4407455632e0\") " pod="openshift-monitoring/node-exporter-wk2lv" Jul 07 17:38:11.258914 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.258865 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/72ba517f-9d8b-473d-a9fc-4407455632e0-node-exporter-wtmp\") pod \"node-exporter-wk2lv\" (UID: \"72ba517f-9d8b-473d-a9fc-4407455632e0\") " pod="openshift-monitoring/node-exporter-wk2lv" Jul 07 17:38:11.258914 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.258896 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/72ba517f-9d8b-473d-a9fc-4407455632e0-node-exporter-accelerators-collector-config\") pod \"node-exporter-wk2lv\" (UID: \"72ba517f-9d8b-473d-a9fc-4407455632e0\") " pod="openshift-monitoring/node-exporter-wk2lv" Jul 07 17:38:11.259096 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.258925 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvx2n\" (UniqueName: \"kubernetes.io/projected/72ba517f-9d8b-473d-a9fc-4407455632e0-kube-api-access-dvx2n\") pod \"node-exporter-wk2lv\" (UID: \"72ba517f-9d8b-473d-a9fc-4407455632e0\") " pod="openshift-monitoring/node-exporter-wk2lv" Jul 07 17:38:11.259096 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.258978 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/72ba517f-9d8b-473d-a9fc-4407455632e0-node-exporter-textfile\") pod \"node-exporter-wk2lv\" (UID: \"72ba517f-9d8b-473d-a9fc-4407455632e0\") " pod="openshift-monitoring/node-exporter-wk2lv" Jul 07 17:38:11.259096 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.259001 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72ba517f-9d8b-473d-a9fc-4407455632e0-metrics-client-ca\") pod \"node-exporter-wk2lv\" (UID: \"72ba517f-9d8b-473d-a9fc-4407455632e0\") " pod="openshift-monitoring/node-exporter-wk2lv" Jul 07 17:38:11.259096 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.259058 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/72ba517f-9d8b-473d-a9fc-4407455632e0-root\") pod \"node-exporter-wk2lv\" (UID: \"72ba517f-9d8b-473d-a9fc-4407455632e0\") " pod="openshift-monitoring/node-exporter-wk2lv" Jul 07 17:38:11.360428 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.360395 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72ba517f-9d8b-473d-a9fc-4407455632e0-sys\") pod \"node-exporter-wk2lv\" (UID: \"72ba517f-9d8b-473d-a9fc-4407455632e0\") " pod="openshift-monitoring/node-exporter-wk2lv" Jul 07 17:38:11.360428 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.360441 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/72ba517f-9d8b-473d-a9fc-4407455632e0-node-exporter-wtmp\") pod \"node-exporter-wk2lv\" (UID: \"72ba517f-9d8b-473d-a9fc-4407455632e0\") " pod="openshift-monitoring/node-exporter-wk2lv" Jul 07 17:38:11.360652 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.360514 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72ba517f-9d8b-473d-a9fc-4407455632e0-sys\") pod \"node-exporter-wk2lv\" (UID: \"72ba517f-9d8b-473d-a9fc-4407455632e0\") " pod="openshift-monitoring/node-exporter-wk2lv" Jul 07 17:38:11.360652 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.360560 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/72ba517f-9d8b-473d-a9fc-4407455632e0-node-exporter-accelerators-collector-config\") pod \"node-exporter-wk2lv\" (UID: \"72ba517f-9d8b-473d-a9fc-4407455632e0\") " pod="openshift-monitoring/node-exporter-wk2lv" Jul 07 17:38:11.360652 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.360590 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/72ba517f-9d8b-473d-a9fc-4407455632e0-node-exporter-wtmp\") pod \"node-exporter-wk2lv\" (UID: \"72ba517f-9d8b-473d-a9fc-4407455632e0\") " pod="openshift-monitoring/node-exporter-wk2lv" Jul 07 17:38:11.360652 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.360595 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvx2n\" (UniqueName: \"kubernetes.io/projected/72ba517f-9d8b-473d-a9fc-4407455632e0-kube-api-access-dvx2n\") pod \"node-exporter-wk2lv\" (UID: \"72ba517f-9d8b-473d-a9fc-4407455632e0\") " pod="openshift-monitoring/node-exporter-wk2lv" Jul 07 17:38:11.360652 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.360643 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/72ba517f-9d8b-473d-a9fc-4407455632e0-node-exporter-textfile\") pod \"node-exporter-wk2lv\" (UID: \"72ba517f-9d8b-473d-a9fc-4407455632e0\") " pod="openshift-monitoring/node-exporter-wk2lv" Jul 07 17:38:11.360919 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.360669 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72ba517f-9d8b-473d-a9fc-4407455632e0-metrics-client-ca\") pod \"node-exporter-wk2lv\" (UID: \"72ba517f-9d8b-473d-a9fc-4407455632e0\") " pod="openshift-monitoring/node-exporter-wk2lv" Jul 07 17:38:11.360919 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.360707 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/72ba517f-9d8b-473d-a9fc-4407455632e0-root\") pod \"node-exporter-wk2lv\" (UID: \"72ba517f-9d8b-473d-a9fc-4407455632e0\") " pod="openshift-monitoring/node-exporter-wk2lv" Jul 07 17:38:11.360919 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.360742 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/72ba517f-9d8b-473d-a9fc-4407455632e0-node-exporter-tls\") pod \"node-exporter-wk2lv\" (UID: \"72ba517f-9d8b-473d-a9fc-4407455632e0\") " pod="openshift-monitoring/node-exporter-wk2lv" Jul 07 17:38:11.360919 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.360779 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72ba517f-9d8b-473d-a9fc-4407455632e0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wk2lv\" (UID: \"72ba517f-9d8b-473d-a9fc-4407455632e0\") " pod="openshift-monitoring/node-exporter-wk2lv" Jul 07 17:38:11.360919 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.360883 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/72ba517f-9d8b-473d-a9fc-4407455632e0-root\") pod \"node-exporter-wk2lv\" (UID: \"72ba517f-9d8b-473d-a9fc-4407455632e0\") " pod="openshift-monitoring/node-exporter-wk2lv" Jul 07 17:38:11.361164 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.361064 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/72ba517f-9d8b-473d-a9fc-4407455632e0-node-exporter-textfile\") pod \"node-exporter-wk2lv\" (UID: \"72ba517f-9d8b-473d-a9fc-4407455632e0\") " pod="openshift-monitoring/node-exporter-wk2lv" Jul 07 17:38:11.361272 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.361251 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72ba517f-9d8b-473d-a9fc-4407455632e0-metrics-client-ca\") pod \"node-exporter-wk2lv\" (UID: \"72ba517f-9d8b-473d-a9fc-4407455632e0\") " pod="openshift-monitoring/node-exporter-wk2lv" Jul 07 17:38:11.361374 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.361354 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/72ba517f-9d8b-473d-a9fc-4407455632e0-node-exporter-accelerators-collector-config\") pod \"node-exporter-wk2lv\" (UID: \"72ba517f-9d8b-473d-a9fc-4407455632e0\") " pod="openshift-monitoring/node-exporter-wk2lv" Jul 07 17:38:11.363030 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.363005 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/72ba517f-9d8b-473d-a9fc-4407455632e0-node-exporter-tls\") pod \"node-exporter-wk2lv\" (UID: \"72ba517f-9d8b-473d-a9fc-4407455632e0\") " pod="openshift-monitoring/node-exporter-wk2lv" Jul 07 17:38:11.363150 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.363126 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72ba517f-9d8b-473d-a9fc-4407455632e0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wk2lv\" (UID: \"72ba517f-9d8b-473d-a9fc-4407455632e0\") " pod="openshift-monitoring/node-exporter-wk2lv" Jul 07 17:38:11.367348 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.367327 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvx2n\" (UniqueName: \"kubernetes.io/projected/72ba517f-9d8b-473d-a9fc-4407455632e0-kube-api-access-dvx2n\") pod \"node-exporter-wk2lv\" (UID: \"72ba517f-9d8b-473d-a9fc-4407455632e0\") " pod="openshift-monitoring/node-exporter-wk2lv" Jul 07 17:38:11.438262 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:11.438241 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wk2lv" Jul 07 17:38:11.449331 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:38:11.449310 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72ba517f_9d8b_473d_a9fc_4407455632e0.slice/crio-b0063f99b1be7ccb7e406458e41e1eaef2b700e1fb8b70b501e10f30a6f721a6 WatchSource:0}: Error finding container b0063f99b1be7ccb7e406458e41e1eaef2b700e1fb8b70b501e10f30a6f721a6: Status 404 returned error can't find the container with id b0063f99b1be7ccb7e406458e41e1eaef2b700e1fb8b70b501e10f30a6f721a6 Jul 07 17:38:12.348881 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:12.348849 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wk2lv" event={"ID":"72ba517f-9d8b-473d-a9fc-4407455632e0","Type":"ContainerStarted","Data":"b0063f99b1be7ccb7e406458e41e1eaef2b700e1fb8b70b501e10f30a6f721a6"} Jul 07 17:38:13.353790 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:13.353759 2552 generic.go:356] "Generic (PLEG): container finished" podID="72ba517f-9d8b-473d-a9fc-4407455632e0" containerID="768e8be9364171a8b32e15c1912986bf6aa563e0f72a35b49fe74fa2d81492a0" exitCode=0 Jul 07 17:38:13.354139 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:13.353832 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wk2lv" event={"ID":"72ba517f-9d8b-473d-a9fc-4407455632e0","Type":"ContainerDied","Data":"768e8be9364171a8b32e15c1912986bf6aa563e0f72a35b49fe74fa2d81492a0"} Jul 07 17:38:14.359080 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:14.359048 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wk2lv" event={"ID":"72ba517f-9d8b-473d-a9fc-4407455632e0","Type":"ContainerStarted","Data":"5615b4b59341cbfa5c14503ef5db3cd6b6892acf851ed81419fccbc1aae9e42f"} Jul 07 17:38:14.359466 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:14.359096 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wk2lv" event={"ID":"72ba517f-9d8b-473d-a9fc-4407455632e0","Type":"ContainerStarted","Data":"6b3dc535651b8a743c5d1ef78eabf7e37e600531ec4fe83ec4d8597a93657d98"} Jul 07 17:38:14.379552 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:14.379509 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wk2lv" podStartSLOduration=2.226955281 podStartE2EDuration="3.379495287s" totalImagesPullingTime="1.092814459s" totalInitContainerRuntime="59.725547ms" isStatefulPod=true podCreationTimestamp="2026-07-07 17:38:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:38:14.378289232 +0000 UTC m=+94.960295977" watchObservedRunningTime="2026-07-07 17:38:14.379495287 +0000 UTC m=+94.961502031" Jul 07 17:38:15.920734 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:15.920704 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-xxh9h"] Jul 07 17:38:15.923793 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:15.923774 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xxh9h" Jul 07 17:38:15.925941 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:15.925919 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-5gph6\"" Jul 07 17:38:15.926040 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:15.925954 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 07 17:38:15.932790 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:15.932768 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-xxh9h"] Jul 07 17:38:15.993706 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:15.993682 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w67k\" (UniqueName: \"kubernetes.io/projected/aaac0ae5-7785-4b7f-a698-b0aad2eca91a-kube-api-access-2w67k\") pod \"monitoring-plugin-d5dcff7cf-xxh9h\" (UID: \"aaac0ae5-7785-4b7f-a698-b0aad2eca91a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xxh9h" Jul 07 17:38:15.993815 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:15.993715 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/aaac0ae5-7785-4b7f-a698-b0aad2eca91a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-xxh9h\" (UID: \"aaac0ae5-7785-4b7f-a698-b0aad2eca91a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xxh9h" Jul 07 17:38:16.095005 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:16.094980 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w67k\" (UniqueName: \"kubernetes.io/projected/aaac0ae5-7785-4b7f-a698-b0aad2eca91a-kube-api-access-2w67k\") pod \"monitoring-plugin-d5dcff7cf-xxh9h\" (UID: \"aaac0ae5-7785-4b7f-a698-b0aad2eca91a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xxh9h" Jul 07 17:38:16.095131 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:16.095014 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/aaac0ae5-7785-4b7f-a698-b0aad2eca91a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-xxh9h\" (UID: \"aaac0ae5-7785-4b7f-a698-b0aad2eca91a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xxh9h" Jul 07 17:38:16.095131 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:38:16.095126 2552 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 07 17:38:16.095283 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:38:16.095194 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaac0ae5-7785-4b7f-a698-b0aad2eca91a-monitoring-plugin-cert podName:aaac0ae5-7785-4b7f-a698-b0aad2eca91a nodeName:}" failed. No retries permitted until 2026-07-07 17:38:16.595174894 +0000 UTC m=+97.177181619 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/aaac0ae5-7785-4b7f-a698-b0aad2eca91a-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-xxh9h" (UID: "aaac0ae5-7785-4b7f-a698-b0aad2eca91a") : secret "monitoring-plugin-cert" not found Jul 07 17:38:16.102679 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:16.102655 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w67k\" (UniqueName: \"kubernetes.io/projected/aaac0ae5-7785-4b7f-a698-b0aad2eca91a-kube-api-access-2w67k\") pod \"monitoring-plugin-d5dcff7cf-xxh9h\" (UID: \"aaac0ae5-7785-4b7f-a698-b0aad2eca91a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xxh9h" Jul 07 17:38:16.599856 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:16.599822 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/aaac0ae5-7785-4b7f-a698-b0aad2eca91a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-xxh9h\" (UID: \"aaac0ae5-7785-4b7f-a698-b0aad2eca91a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xxh9h" Jul 07 17:38:16.602278 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:16.602245 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/aaac0ae5-7785-4b7f-a698-b0aad2eca91a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-xxh9h\" (UID: \"aaac0ae5-7785-4b7f-a698-b0aad2eca91a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xxh9h" Jul 07 17:38:16.832726 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:16.832696 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xxh9h" Jul 07 17:38:16.951595 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:16.951568 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-xxh9h"] Jul 07 17:38:16.954389 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:38:16.954354 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaac0ae5_7785_4b7f_a698_b0aad2eca91a.slice/crio-22e0465f48aa5378a345309276c857fa8159d21830dea9a251bfe70850828396 WatchSource:0}: Error finding container 22e0465f48aa5378a345309276c857fa8159d21830dea9a251bfe70850828396: Status 404 returned error can't find the container with id 22e0465f48aa5378a345309276c857fa8159d21830dea9a251bfe70850828396 Jul 07 17:38:17.369560 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:17.369525 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xxh9h" event={"ID":"aaac0ae5-7785-4b7f-a698-b0aad2eca91a","Type":"ContainerStarted","Data":"22e0465f48aa5378a345309276c857fa8159d21830dea9a251bfe70850828396"} Jul 07 17:38:19.381110 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:19.381072 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xxh9h" event={"ID":"aaac0ae5-7785-4b7f-a698-b0aad2eca91a","Type":"ContainerStarted","Data":"d83f8f5e16e86667d324c93076582b158fdf94d052ee960507163cbcb183ea35"} Jul 07 17:38:19.381514 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:19.381232 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xxh9h" Jul 07 17:38:19.385792 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:19.385773 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xxh9h" Jul 07 17:38:19.395179 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:19.395143 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xxh9h" podStartSLOduration=2.8551986879999998 podStartE2EDuration="4.395131559s" totalImagesPullingTime="1.539932871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:38:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:38:19.394826343 +0000 UTC m=+99.976833088" watchObservedRunningTime="2026-07-07 17:38:19.395131559 +0000 UTC m=+99.977138345" Jul 07 17:38:20.523268 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:20.523235 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54b8fcb74-vmn2p"] Jul 07 17:38:22.268945 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:22.268921 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mcxjj" Jul 07 17:38:45.542652 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:45.542616 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" podUID="53ba0933-91e4-4870-858f-a15537f35025" containerName="registry" containerID="cri-o://9458291caa19e9cb5d19f5aed1f3b2cef21e157eba6dbb53747fe502c7fc1065" gracePeriod=30 Jul 07 17:38:45.766571 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:45.766546 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:38:45.814325 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:45.814248 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53ba0933-91e4-4870-858f-a15537f35025-installation-pull-secrets\") pod \"53ba0933-91e4-4870-858f-a15537f35025\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " Jul 07 17:38:45.814325 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:45.814290 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53ba0933-91e4-4870-858f-a15537f35025-image-registry-private-configuration\") pod \"53ba0933-91e4-4870-858f-a15537f35025\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " Jul 07 17:38:45.814546 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:45.814338 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53ba0933-91e4-4870-858f-a15537f35025-ca-trust-extracted\") pod \"53ba0933-91e4-4870-858f-a15537f35025\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " Jul 07 17:38:45.814546 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:45.814372 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-bound-sa-token\") pod \"53ba0933-91e4-4870-858f-a15537f35025\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " Jul 07 17:38:45.814546 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:45.814404 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7skq\" (UniqueName: \"kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-kube-api-access-f7skq\") pod \"53ba0933-91e4-4870-858f-a15537f35025\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " Jul 07 17:38:45.814546 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:45.814429 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53ba0933-91e4-4870-858f-a15537f35025-trusted-ca\") pod \"53ba0933-91e4-4870-858f-a15537f35025\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " Jul 07 17:38:45.814546 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:45.814493 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53ba0933-91e4-4870-858f-a15537f35025-registry-certificates\") pod \"53ba0933-91e4-4870-858f-a15537f35025\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " Jul 07 17:38:45.814546 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:45.814534 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-registry-tls\") pod \"53ba0933-91e4-4870-858f-a15537f35025\" (UID: \"53ba0933-91e4-4870-858f-a15537f35025\") " Jul 07 17:38:45.815050 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:45.814972 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53ba0933-91e4-4870-858f-a15537f35025-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "53ba0933-91e4-4870-858f-a15537f35025" (UID: "53ba0933-91e4-4870-858f-a15537f35025"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 17:38:45.815050 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:45.814997 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53ba0933-91e4-4870-858f-a15537f35025-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "53ba0933-91e4-4870-858f-a15537f35025" (UID: "53ba0933-91e4-4870-858f-a15537f35025"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 17:38:45.816923 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:45.816844 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "53ba0933-91e4-4870-858f-a15537f35025" (UID: "53ba0933-91e4-4870-858f-a15537f35025"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:38:45.817014 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:45.816942 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-kube-api-access-f7skq" (OuterVolumeSpecName: "kube-api-access-f7skq") pod "53ba0933-91e4-4870-858f-a15537f35025" (UID: "53ba0933-91e4-4870-858f-a15537f35025"). InnerVolumeSpecName "kube-api-access-f7skq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:38:45.817014 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:45.816983 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53ba0933-91e4-4870-858f-a15537f35025-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "53ba0933-91e4-4870-858f-a15537f35025" (UID: "53ba0933-91e4-4870-858f-a15537f35025"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:38:45.817102 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:45.817073 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53ba0933-91e4-4870-858f-a15537f35025-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "53ba0933-91e4-4870-858f-a15537f35025" (UID: "53ba0933-91e4-4870-858f-a15537f35025"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:38:45.817137 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:45.817101 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "53ba0933-91e4-4870-858f-a15537f35025" (UID: "53ba0933-91e4-4870-858f-a15537f35025"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:38:45.822500 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:45.822478 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53ba0933-91e4-4870-858f-a15537f35025-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "53ba0933-91e4-4870-858f-a15537f35025" (UID: "53ba0933-91e4-4870-858f-a15537f35025"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:38:45.915783 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:45.915750 2552 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53ba0933-91e4-4870-858f-a15537f35025-registry-certificates\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:38:45.915783 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:45.915781 2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-registry-tls\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:38:45.915783 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:45.915791 2552 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53ba0933-91e4-4870-858f-a15537f35025-installation-pull-secrets\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:38:45.915931 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:45.915800 2552 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53ba0933-91e4-4870-858f-a15537f35025-image-registry-private-configuration\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:38:45.915931 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:45.915809 2552 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53ba0933-91e4-4870-858f-a15537f35025-ca-trust-extracted\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:38:45.915931 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:45.915818 2552 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-bound-sa-token\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:38:45.915931 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:45.915826 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7skq\" (UniqueName: \"kubernetes.io/projected/53ba0933-91e4-4870-858f-a15537f35025-kube-api-access-f7skq\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:38:45.915931 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:45.915833 2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53ba0933-91e4-4870-858f-a15537f35025-trusted-ca\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:38:46.472961 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:46.472930 2552 generic.go:356] "Generic (PLEG): container finished" podID="53ba0933-91e4-4870-858f-a15537f35025" containerID="9458291caa19e9cb5d19f5aed1f3b2cef21e157eba6dbb53747fe502c7fc1065" exitCode=0 Jul 07 17:38:46.473116 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:46.472976 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" Jul 07 17:38:46.473116 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:46.473013 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" event={"ID":"53ba0933-91e4-4870-858f-a15537f35025","Type":"ContainerDied","Data":"9458291caa19e9cb5d19f5aed1f3b2cef21e157eba6dbb53747fe502c7fc1065"} Jul 07 17:38:46.473116 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:46.473059 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54b8fcb74-vmn2p" event={"ID":"53ba0933-91e4-4870-858f-a15537f35025","Type":"ContainerDied","Data":"64f740421e2d72e1b1fa3b5ef4a6f24f68824c1a22c066b432395f82c8554716"} Jul 07 17:38:46.473116 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:46.473082 2552 scope.go:117] "RemoveContainer" containerID="9458291caa19e9cb5d19f5aed1f3b2cef21e157eba6dbb53747fe502c7fc1065" Jul 07 17:38:46.480773 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:46.480757 2552 scope.go:117] "RemoveContainer" containerID="9458291caa19e9cb5d19f5aed1f3b2cef21e157eba6dbb53747fe502c7fc1065" Jul 07 17:38:46.481009 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:38:46.480991 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9458291caa19e9cb5d19f5aed1f3b2cef21e157eba6dbb53747fe502c7fc1065\": container with ID starting with 9458291caa19e9cb5d19f5aed1f3b2cef21e157eba6dbb53747fe502c7fc1065 not found: ID does not exist" containerID="9458291caa19e9cb5d19f5aed1f3b2cef21e157eba6dbb53747fe502c7fc1065" Jul 07 17:38:46.481079 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:46.481022 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9458291caa19e9cb5d19f5aed1f3b2cef21e157eba6dbb53747fe502c7fc1065"} err="failed to get container status \"9458291caa19e9cb5d19f5aed1f3b2cef21e157eba6dbb53747fe502c7fc1065\": rpc error: code = NotFound desc = could not find container \"9458291caa19e9cb5d19f5aed1f3b2cef21e157eba6dbb53747fe502c7fc1065\": container with ID starting with 9458291caa19e9cb5d19f5aed1f3b2cef21e157eba6dbb53747fe502c7fc1065 not found: ID does not exist" Jul 07 17:38:46.487405 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:46.487385 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54b8fcb74-vmn2p"] Jul 07 17:38:46.495897 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:46.495879 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-54b8fcb74-vmn2p"] Jul 07 17:38:47.971170 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:47.971137 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53ba0933-91e4-4870-858f-a15537f35025" path="/var/lib/kubelet/pods/53ba0933-91e4-4870-858f-a15537f35025/volumes" Jul 07 17:38:49.641991 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:49.641964 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/169258da-bb2c-4e58-8e93-447b39ef7da2-metrics-certs\") pod \"network-metrics-daemon-nrwlq\" (UID: \"169258da-bb2c-4e58-8e93-447b39ef7da2\") " pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:38:49.644181 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:49.644157 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/169258da-bb2c-4e58-8e93-447b39ef7da2-metrics-certs\") pod \"network-metrics-daemon-nrwlq\" (UID: \"169258da-bb2c-4e58-8e93-447b39ef7da2\") " pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:38:49.883569 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:49.883544 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pkhdg\"" Jul 07 17:38:49.892230 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:49.892184 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrwlq" Jul 07 17:38:50.013876 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:50.013846 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nrwlq"] Jul 07 17:38:50.017450 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:38:50.017423 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod169258da_bb2c_4e58_8e93_447b39ef7da2.slice/crio-8bef352cbbe18f6af04e370ac0349a9d6807011cde02ed6299ff53335525b6d9 WatchSource:0}: Error finding container 8bef352cbbe18f6af04e370ac0349a9d6807011cde02ed6299ff53335525b6d9: Status 404 returned error can't find the container with id 8bef352cbbe18f6af04e370ac0349a9d6807011cde02ed6299ff53335525b6d9 Jul 07 17:38:50.488247 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:50.488204 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nrwlq" event={"ID":"169258da-bb2c-4e58-8e93-447b39ef7da2","Type":"ContainerStarted","Data":"8bef352cbbe18f6af04e370ac0349a9d6807011cde02ed6299ff53335525b6d9"} Jul 07 17:38:51.493333 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:51.493288 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nrwlq" event={"ID":"169258da-bb2c-4e58-8e93-447b39ef7da2","Type":"ContainerStarted","Data":"2541346af4335a85193da12e2e2279099ab1e0d6ba58ea1b9cc42fce154ad3e4"} Jul 07 17:38:51.493716 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:51.493382 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nrwlq" event={"ID":"169258da-bb2c-4e58-8e93-447b39ef7da2","Type":"ContainerStarted","Data":"3e233614734fc866d454aa75b7d00e806fcb729069374cbde706d5e0d8454689"} Jul 07 17:38:51.508547 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:51.508505 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nrwlq" podStartSLOduration=130.605018647 podStartE2EDuration="2m11.508493113s" totalImagesPullingTime="903.474466ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:38:51.507318818 +0000 UTC m=+132.089325557" watchObservedRunningTime="2026-07-07 17:38:51.508493113 +0000 UTC m=+132.090499856" Jul 07 17:38:59.522908 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:59.522872 2552 generic.go:356] "Generic (PLEG): container finished" podID="a58d9422-ad7b-4281-b918-bbe01ccff305" containerID="5150148c43dc965c4a25adb91904576868e1577a84895a8cf1f4ac0f5cc73b20" exitCode=0 Jul 07 17:38:59.523262 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:59.522943 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-fn9zf" event={"ID":"a58d9422-ad7b-4281-b918-bbe01ccff305","Type":"ContainerDied","Data":"5150148c43dc965c4a25adb91904576868e1577a84895a8cf1f4ac0f5cc73b20"} Jul 07 17:38:59.523262 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:38:59.523231 2552 scope.go:117] "RemoveContainer" containerID="5150148c43dc965c4a25adb91904576868e1577a84895a8cf1f4ac0f5cc73b20" Jul 07 17:39:00.527751 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:39:00.527716 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-fn9zf" event={"ID":"a58d9422-ad7b-4281-b918-bbe01ccff305","Type":"ContainerStarted","Data":"9a8d5c50a0c15e62d5a4db0c06fe1e44b408c4745cf82e185da9c49e5192471c"} Jul 07 17:41:01.004806 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:01.004776 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg"] Jul 07 17:41:01.005246 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:01.005017 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53ba0933-91e4-4870-858f-a15537f35025" containerName="registry" Jul 07 17:41:01.005246 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:01.005028 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="53ba0933-91e4-4870-858f-a15537f35025" containerName="registry" Jul 07 17:41:01.005246 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:01.005072 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="53ba0933-91e4-4870-858f-a15537f35025" containerName="registry" Jul 07 17:41:01.007705 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:01.007690 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg" Jul 07 17:41:01.009776 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:01.009746 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 17:41:01.010399 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:01.010382 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 17:41:01.010503 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:01.010449 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-96wth\"" Jul 07 17:41:01.015003 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:01.014981 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg"] Jul 07 17:41:01.115681 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:01.115654 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80679f99-a3a1-4800-8cf8-951777e5e7e7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg\" (UID: \"80679f99-a3a1-4800-8cf8-951777e5e7e7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg" Jul 07 17:41:01.115681 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:01.115684 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80679f99-a3a1-4800-8cf8-951777e5e7e7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg\" (UID: \"80679f99-a3a1-4800-8cf8-951777e5e7e7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg" Jul 07 17:41:01.115836 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:01.115721 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgcwc\" (UniqueName: \"kubernetes.io/projected/80679f99-a3a1-4800-8cf8-951777e5e7e7-kube-api-access-tgcwc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg\" (UID: \"80679f99-a3a1-4800-8cf8-951777e5e7e7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg" Jul 07 17:41:01.216400 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:01.216339 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgcwc\" (UniqueName: \"kubernetes.io/projected/80679f99-a3a1-4800-8cf8-951777e5e7e7-kube-api-access-tgcwc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg\" (UID: \"80679f99-a3a1-4800-8cf8-951777e5e7e7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg" Jul 07 17:41:01.216400 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:01.216388 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80679f99-a3a1-4800-8cf8-951777e5e7e7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg\" (UID: \"80679f99-a3a1-4800-8cf8-951777e5e7e7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg" Jul 07 17:41:01.216536 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:01.216407 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80679f99-a3a1-4800-8cf8-951777e5e7e7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg\" (UID: \"80679f99-a3a1-4800-8cf8-951777e5e7e7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg" Jul 07 17:41:01.216770 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:01.216753 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80679f99-a3a1-4800-8cf8-951777e5e7e7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg\" (UID: \"80679f99-a3a1-4800-8cf8-951777e5e7e7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg" Jul 07 17:41:01.216816 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:01.216768 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80679f99-a3a1-4800-8cf8-951777e5e7e7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg\" (UID: \"80679f99-a3a1-4800-8cf8-951777e5e7e7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg" Jul 07 17:41:01.223397 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:01.223381 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgcwc\" (UniqueName: \"kubernetes.io/projected/80679f99-a3a1-4800-8cf8-951777e5e7e7-kube-api-access-tgcwc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg\" (UID: \"80679f99-a3a1-4800-8cf8-951777e5e7e7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg" Jul 07 17:41:01.316413 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:01.316358 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg" Jul 07 17:41:01.431918 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:01.431773 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg"] Jul 07 17:41:01.434329 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:41:01.434294 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80679f99_a3a1_4800_8cf8_951777e5e7e7.slice/crio-8062edd25ad358b6178e87715bcb40aa65c217c02ab4968a7a2b95eee9808d31 WatchSource:0}: Error finding container 8062edd25ad358b6178e87715bcb40aa65c217c02ab4968a7a2b95eee9808d31: Status 404 returned error can't find the container with id 8062edd25ad358b6178e87715bcb40aa65c217c02ab4968a7a2b95eee9808d31 Jul 07 17:41:01.930533 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:01.930502 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg" event={"ID":"80679f99-a3a1-4800-8cf8-951777e5e7e7","Type":"ContainerStarted","Data":"8062edd25ad358b6178e87715bcb40aa65c217c02ab4968a7a2b95eee9808d31"} Jul 07 17:41:10.962825 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:10.962792 2552 generic.go:356] "Generic (PLEG): container finished" podID="80679f99-a3a1-4800-8cf8-951777e5e7e7" containerID="47ac6e0a38a1b4d61088941407d4f4c3361596e4ba4a17acbb020f8989936691" exitCode=0 Jul 07 17:41:10.963322 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:10.962884 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg" event={"ID":"80679f99-a3a1-4800-8cf8-951777e5e7e7","Type":"ContainerDied","Data":"47ac6e0a38a1b4d61088941407d4f4c3361596e4ba4a17acbb020f8989936691"} Jul 07 17:41:12.971925 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:12.971895 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg" event={"ID":"80679f99-a3a1-4800-8cf8-951777e5e7e7","Type":"ContainerStarted","Data":"b981bff643272196cd7cd164818cc5000ecce46290c9769d2df95c671830053d"} Jul 07 17:41:13.976712 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:13.976682 2552 generic.go:356] "Generic (PLEG): container finished" podID="80679f99-a3a1-4800-8cf8-951777e5e7e7" containerID="b981bff643272196cd7cd164818cc5000ecce46290c9769d2df95c671830053d" exitCode=0 Jul 07 17:41:13.977098 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:13.976744 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg" event={"ID":"80679f99-a3a1-4800-8cf8-951777e5e7e7","Type":"ContainerDied","Data":"b981bff643272196cd7cd164818cc5000ecce46290c9769d2df95c671830053d"} Jul 07 17:41:24.013505 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:24.013471 2552 generic.go:356] "Generic (PLEG): container finished" podID="80679f99-a3a1-4800-8cf8-951777e5e7e7" containerID="3d2da51c09bf68a8d7691589a47a6941f18ab1ac4cd19bda0dadcd5d027e1d53" exitCode=0 Jul 07 17:41:24.013505 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:24.013501 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg" event={"ID":"80679f99-a3a1-4800-8cf8-951777e5e7e7","Type":"ContainerDied","Data":"3d2da51c09bf68a8d7691589a47a6941f18ab1ac4cd19bda0dadcd5d027e1d53"} Jul 07 17:41:25.159268 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:25.159247 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg" Jul 07 17:41:25.292731 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:25.292674 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80679f99-a3a1-4800-8cf8-951777e5e7e7-util\") pod \"80679f99-a3a1-4800-8cf8-951777e5e7e7\" (UID: \"80679f99-a3a1-4800-8cf8-951777e5e7e7\") " Jul 07 17:41:25.292731 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:25.292705 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80679f99-a3a1-4800-8cf8-951777e5e7e7-bundle\") pod \"80679f99-a3a1-4800-8cf8-951777e5e7e7\" (UID: \"80679f99-a3a1-4800-8cf8-951777e5e7e7\") " Jul 07 17:41:25.292731 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:25.292731 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgcwc\" (UniqueName: \"kubernetes.io/projected/80679f99-a3a1-4800-8cf8-951777e5e7e7-kube-api-access-tgcwc\") pod \"80679f99-a3a1-4800-8cf8-951777e5e7e7\" (UID: \"80679f99-a3a1-4800-8cf8-951777e5e7e7\") " Jul 07 17:41:25.293261 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:25.293239 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80679f99-a3a1-4800-8cf8-951777e5e7e7-bundle" (OuterVolumeSpecName: "bundle") pod "80679f99-a3a1-4800-8cf8-951777e5e7e7" (UID: "80679f99-a3a1-4800-8cf8-951777e5e7e7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:41:25.294807 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:25.294780 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80679f99-a3a1-4800-8cf8-951777e5e7e7-kube-api-access-tgcwc" (OuterVolumeSpecName: "kube-api-access-tgcwc") pod "80679f99-a3a1-4800-8cf8-951777e5e7e7" (UID: "80679f99-a3a1-4800-8cf8-951777e5e7e7"). InnerVolumeSpecName "kube-api-access-tgcwc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:41:25.297701 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:25.297683 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80679f99-a3a1-4800-8cf8-951777e5e7e7-util" (OuterVolumeSpecName: "util") pod "80679f99-a3a1-4800-8cf8-951777e5e7e7" (UID: "80679f99-a3a1-4800-8cf8-951777e5e7e7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:41:25.393220 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:25.393200 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80679f99-a3a1-4800-8cf8-951777e5e7e7-util\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:41:25.393220 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:25.393219 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80679f99-a3a1-4800-8cf8-951777e5e7e7-bundle\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:41:25.393364 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:25.393228 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgcwc\" (UniqueName: \"kubernetes.io/projected/80679f99-a3a1-4800-8cf8-951777e5e7e7-kube-api-access-tgcwc\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:41:26.023016 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:26.022983 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg" event={"ID":"80679f99-a3a1-4800-8cf8-951777e5e7e7","Type":"ContainerDied","Data":"8062edd25ad358b6178e87715bcb40aa65c217c02ab4968a7a2b95eee9808d31"} Jul 07 17:41:26.023161 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:26.023036 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8062edd25ad358b6178e87715bcb40aa65c217c02ab4968a7a2b95eee9808d31" Jul 07 17:41:26.023161 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:26.022995 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m74jg" Jul 07 17:41:29.409373 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:29.409340 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q6lmf"] Jul 07 17:41:29.409832 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:29.409578 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80679f99-a3a1-4800-8cf8-951777e5e7e7" containerName="util" Jul 07 17:41:29.409832 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:29.409588 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="80679f99-a3a1-4800-8cf8-951777e5e7e7" containerName="util" Jul 07 17:41:29.409832 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:29.409597 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80679f99-a3a1-4800-8cf8-951777e5e7e7" containerName="extract" Jul 07 17:41:29.409832 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:29.409602 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="80679f99-a3a1-4800-8cf8-951777e5e7e7" containerName="extract" Jul 07 17:41:29.409832 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:29.409614 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80679f99-a3a1-4800-8cf8-951777e5e7e7" containerName="pull" Jul 07 17:41:29.409832 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:29.409620 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="80679f99-a3a1-4800-8cf8-951777e5e7e7" containerName="pull" Jul 07 17:41:29.409832 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:29.409662 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="80679f99-a3a1-4800-8cf8-951777e5e7e7" containerName="extract" Jul 07 17:41:29.411399 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:29.411384 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q6lmf" Jul 07 17:41:29.413590 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:29.413569 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 07 17:41:29.413702 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:29.413645 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-dmfgw\"" Jul 07 17:41:29.413702 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:29.413645 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 07 17:41:29.424279 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:29.424258 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q6lmf"] Jul 07 17:41:29.519349 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:29.519291 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntsmh\" (UniqueName: \"kubernetes.io/projected/05312c03-7a1e-446d-afa3-996bca8780cb-kube-api-access-ntsmh\") pod \"cert-manager-operator-controller-manager-55c444bf86-q6lmf\" (UID: \"05312c03-7a1e-446d-afa3-996bca8780cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q6lmf" Jul 07 17:41:29.519506 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:29.519372 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05312c03-7a1e-446d-afa3-996bca8780cb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-q6lmf\" (UID: \"05312c03-7a1e-446d-afa3-996bca8780cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q6lmf" Jul 07 17:41:29.619980 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:29.619941 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05312c03-7a1e-446d-afa3-996bca8780cb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-q6lmf\" (UID: \"05312c03-7a1e-446d-afa3-996bca8780cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q6lmf" Jul 07 17:41:29.620123 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:29.620032 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntsmh\" (UniqueName: \"kubernetes.io/projected/05312c03-7a1e-446d-afa3-996bca8780cb-kube-api-access-ntsmh\") pod \"cert-manager-operator-controller-manager-55c444bf86-q6lmf\" (UID: \"05312c03-7a1e-446d-afa3-996bca8780cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q6lmf" Jul 07 17:41:29.620367 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:29.620347 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05312c03-7a1e-446d-afa3-996bca8780cb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-q6lmf\" (UID: \"05312c03-7a1e-446d-afa3-996bca8780cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q6lmf" Jul 07 17:41:29.627648 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:29.627630 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntsmh\" (UniqueName: \"kubernetes.io/projected/05312c03-7a1e-446d-afa3-996bca8780cb-kube-api-access-ntsmh\") pod \"cert-manager-operator-controller-manager-55c444bf86-q6lmf\" (UID: \"05312c03-7a1e-446d-afa3-996bca8780cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q6lmf" Jul 07 17:41:29.720001 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:29.719909 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q6lmf" Jul 07 17:41:29.841713 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:29.841672 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q6lmf"] Jul 07 17:41:29.845311 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:41:29.845272 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05312c03_7a1e_446d_afa3_996bca8780cb.slice/crio-eb26704e245425f6d5b884334e7227f1fd705854734fc87a8b88eaf97d454a05 WatchSource:0}: Error finding container eb26704e245425f6d5b884334e7227f1fd705854734fc87a8b88eaf97d454a05: Status 404 returned error can't find the container with id eb26704e245425f6d5b884334e7227f1fd705854734fc87a8b88eaf97d454a05 Jul 07 17:41:30.036406 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:30.036337 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q6lmf" event={"ID":"05312c03-7a1e-446d-afa3-996bca8780cb","Type":"ContainerStarted","Data":"eb26704e245425f6d5b884334e7227f1fd705854734fc87a8b88eaf97d454a05"} Jul 07 17:41:32.045320 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:32.045261 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q6lmf" event={"ID":"05312c03-7a1e-446d-afa3-996bca8780cb","Type":"ContainerStarted","Data":"60d9cea4a92129eb05bddb1e133dd817a94b27d8e44c4645a166dfb5aadfc975"} Jul 07 17:41:32.064395 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:32.064181 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q6lmf" podStartSLOduration=1.43800882 podStartE2EDuration="3.064163377s" totalImagesPullingTime="1.626154557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:41:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:32.062151272 +0000 UTC m=+292.644158017" watchObservedRunningTime="2026-07-07 17:41:32.064163377 +0000 UTC m=+292.646170123" Jul 07 17:41:33.293902 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:33.293874 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655"] Jul 07 17:41:33.295763 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:33.295749 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655" Jul 07 17:41:33.298082 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:33.298062 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-96wth\"" Jul 07 17:41:33.298191 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:33.298098 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 17:41:33.298706 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:33.298685 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 17:41:33.304781 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:33.304764 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655"] Jul 07 17:41:33.450573 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:33.450544 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655\" (UID: \"7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655" Jul 07 17:41:33.450708 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:33.450594 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655\" (UID: \"7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655" Jul 07 17:41:33.450708 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:33.450626 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fbr2\" (UniqueName: \"kubernetes.io/projected/7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d-kube-api-access-9fbr2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655\" (UID: \"7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655" Jul 07 17:41:33.551738 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:33.551677 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655\" (UID: \"7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655" Jul 07 17:41:33.551738 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:33.551717 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655\" (UID: \"7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655" Jul 07 17:41:33.551738 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:33.551738 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fbr2\" (UniqueName: \"kubernetes.io/projected/7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d-kube-api-access-9fbr2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655\" (UID: \"7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655" Jul 07 17:41:33.552057 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:33.552035 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655\" (UID: \"7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655" Jul 07 17:41:33.552119 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:33.552075 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655\" (UID: \"7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655" Jul 07 17:41:33.559221 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:33.559190 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fbr2\" (UniqueName: \"kubernetes.io/projected/7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d-kube-api-access-9fbr2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655\" (UID: \"7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655" Jul 07 17:41:33.604175 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:33.604152 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655" Jul 07 17:41:33.726640 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:33.726526 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655"] Jul 07 17:41:33.729142 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:41:33.729117 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e6c6b7a_09d6_47f4_80ff_d1cacbf65c1d.slice/crio-23bc1c42081d16334d10a918ba44f4b1e85abc02d2bff9b04b0274d6b7014591 WatchSource:0}: Error finding container 23bc1c42081d16334d10a918ba44f4b1e85abc02d2bff9b04b0274d6b7014591: Status 404 returned error can't find the container with id 23bc1c42081d16334d10a918ba44f4b1e85abc02d2bff9b04b0274d6b7014591 Jul 07 17:41:34.057074 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:34.057042 2552 generic.go:356] "Generic (PLEG): container finished" podID="7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d" containerID="70e24d1d826a8ef945fbafd3d82b555f053ef6c17e2af76bd5c942b979b53834" exitCode=0 Jul 07 17:41:34.057194 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:34.057128 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655" event={"ID":"7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d","Type":"ContainerDied","Data":"70e24d1d826a8ef945fbafd3d82b555f053ef6c17e2af76bd5c942b979b53834"} Jul 07 17:41:34.057194 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:34.057175 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655" event={"ID":"7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d","Type":"ContainerStarted","Data":"23bc1c42081d16334d10a918ba44f4b1e85abc02d2bff9b04b0274d6b7014591"} Jul 07 17:41:35.595216 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:35.595186 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-s6zz9"] Jul 07 17:41:35.597363 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:35.597334 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s6zz9" Jul 07 17:41:35.601106 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:35.601088 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 07 17:41:35.603094 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:35.603076 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-qzxp2\"" Jul 07 17:41:35.603209 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:35.603093 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 07 17:41:35.608989 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:35.608971 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-s6zz9"] Jul 07 17:41:35.765723 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:35.765693 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1da9476-0b08-4e82-82fa-55c275860407-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-s6zz9\" (UID: \"c1da9476-0b08-4e82-82fa-55c275860407\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s6zz9" Jul 07 17:41:35.765881 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:35.765728 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7w6w\" (UniqueName: \"kubernetes.io/projected/c1da9476-0b08-4e82-82fa-55c275860407-kube-api-access-r7w6w\") pod \"cert-manager-cainjector-559cdd8c87-s6zz9\" (UID: \"c1da9476-0b08-4e82-82fa-55c275860407\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s6zz9" Jul 07 17:41:35.867058 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:35.866986 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1da9476-0b08-4e82-82fa-55c275860407-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-s6zz9\" (UID: \"c1da9476-0b08-4e82-82fa-55c275860407\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s6zz9" Jul 07 17:41:35.867058 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:35.867017 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7w6w\" (UniqueName: \"kubernetes.io/projected/c1da9476-0b08-4e82-82fa-55c275860407-kube-api-access-r7w6w\") pod \"cert-manager-cainjector-559cdd8c87-s6zz9\" (UID: \"c1da9476-0b08-4e82-82fa-55c275860407\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s6zz9" Jul 07 17:41:35.876342 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:35.876320 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1da9476-0b08-4e82-82fa-55c275860407-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-s6zz9\" (UID: \"c1da9476-0b08-4e82-82fa-55c275860407\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s6zz9" Jul 07 17:41:35.876604 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:35.876584 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7w6w\" (UniqueName: \"kubernetes.io/projected/c1da9476-0b08-4e82-82fa-55c275860407-kube-api-access-r7w6w\") pod \"cert-manager-cainjector-559cdd8c87-s6zz9\" (UID: \"c1da9476-0b08-4e82-82fa-55c275860407\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-s6zz9" Jul 07 17:41:35.907389 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:35.907369 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s6zz9" Jul 07 17:41:36.393159 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:36.393136 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-s6zz9"] Jul 07 17:41:36.395637 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:41:36.395607 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1da9476_0b08_4e82_82fa_55c275860407.slice/crio-d2edaf801d4447839b6f84c80cc3433588c8f457c554cb499329fb0c9f3dde7d WatchSource:0}: Error finding container d2edaf801d4447839b6f84c80cc3433588c8f457c554cb499329fb0c9f3dde7d: Status 404 returned error can't find the container with id d2edaf801d4447839b6f84c80cc3433588c8f457c554cb499329fb0c9f3dde7d Jul 07 17:41:37.071355 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:37.071322 2552 generic.go:356] "Generic (PLEG): container finished" podID="7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d" containerID="f61a3dcc19a203f1b6c9f4f57d0b11fc9fac0e25efc7ace995d7a6f7036fc896" exitCode=0 Jul 07 17:41:37.071766 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:37.071405 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655" event={"ID":"7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d","Type":"ContainerDied","Data":"f61a3dcc19a203f1b6c9f4f57d0b11fc9fac0e25efc7ace995d7a6f7036fc896"} Jul 07 17:41:37.072771 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:37.072752 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s6zz9" event={"ID":"c1da9476-0b08-4e82-82fa-55c275860407","Type":"ContainerStarted","Data":"d2edaf801d4447839b6f84c80cc3433588c8f457c554cb499329fb0c9f3dde7d"} Jul 07 17:41:38.079165 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:38.079115 2552 generic.go:356] "Generic (PLEG): container finished" podID="7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d" containerID="19801e0a1d61f589821cf558bb7273970b94536cbb4eeb11665809bdb6af4cc5" exitCode=0 Jul 07 17:41:38.079576 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:38.079182 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655" event={"ID":"7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d","Type":"ContainerDied","Data":"19801e0a1d61f589821cf558bb7273970b94536cbb4eeb11665809bdb6af4cc5"} Jul 07 17:41:39.084903 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:39.084797 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s6zz9" event={"ID":"c1da9476-0b08-4e82-82fa-55c275860407","Type":"ContainerStarted","Data":"35d63e1a9506efba04b83d09cdde1aa9fc8cf5a782564dc1bc23481a21ea5a8d"} Jul 07 17:41:39.100498 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:39.100446 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-s6zz9" podStartSLOduration=1.83310654 podStartE2EDuration="4.100423448s" totalImagesPullingTime="2.267316908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:41:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:39.100277877 +0000 UTC m=+299.682284622" watchObservedRunningTime="2026-07-07 17:41:39.100423448 +0000 UTC m=+299.682430193" Jul 07 17:41:39.207600 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:39.207578 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655" Jul 07 17:41:39.296812 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:39.296787 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d-bundle\") pod \"7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d\" (UID: \"7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d\") " Jul 07 17:41:39.296930 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:39.296828 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fbr2\" (UniqueName: \"kubernetes.io/projected/7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d-kube-api-access-9fbr2\") pod \"7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d\" (UID: \"7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d\") " Jul 07 17:41:39.296930 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:39.296861 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d-util\") pod \"7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d\" (UID: \"7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d\") " Jul 07 17:41:39.297185 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:39.297166 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d-bundle" (OuterVolumeSpecName: "bundle") pod "7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d" (UID: "7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:41:39.298758 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:39.298739 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d-kube-api-access-9fbr2" (OuterVolumeSpecName: "kube-api-access-9fbr2") pod "7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d" (UID: "7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d"). InnerVolumeSpecName "kube-api-access-9fbr2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:41:39.300882 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:39.300858 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d-util" (OuterVolumeSpecName: "util") pod "7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d" (UID: "7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:41:39.397382 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:39.397362 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d-bundle\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:41:39.397382 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:39.397380 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fbr2\" (UniqueName: \"kubernetes.io/projected/7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d-kube-api-access-9fbr2\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:41:39.397513 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:39.397391 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d-util\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:41:39.769940 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:39.769869 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/ovn-acl-logging/0.log" Jul 07 17:41:39.770821 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:39.770802 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/ovn-acl-logging/0.log" Jul 07 17:41:39.773945 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:39.773925 2552 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 17:41:40.090291 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:40.090216 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655" Jul 07 17:41:40.090291 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:40.090244 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5p655" event={"ID":"7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d","Type":"ContainerDied","Data":"23bc1c42081d16334d10a918ba44f4b1e85abc02d2bff9b04b0274d6b7014591"} Jul 07 17:41:40.090291 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:40.090283 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="23bc1c42081d16334d10a918ba44f4b1e85abc02d2bff9b04b0274d6b7014591" Jul 07 17:41:51.769577 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:51.769543 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr"] Jul 07 17:41:51.769932 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:51.769776 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d" containerName="util" Jul 07 17:41:51.769932 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:51.769787 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d" containerName="util" Jul 07 17:41:51.769932 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:51.769802 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d" containerName="pull" Jul 07 17:41:51.769932 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:51.769807 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d" containerName="pull" Jul 07 17:41:51.769932 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:51.769817 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d" containerName="extract" Jul 07 17:41:51.769932 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:51.769823 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d" containerName="extract" Jul 07 17:41:51.769932 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:51.769865 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e6c6b7a-09d6-47f4-80ff-d1cacbf65c1d" containerName="extract" Jul 07 17:41:51.813661 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:51.813636 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr"] Jul 07 17:41:51.813812 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:51.813731 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr" Jul 07 17:41:51.815943 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:51.815920 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 17:41:51.816761 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:51.816741 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-96wth\"" Jul 07 17:41:51.816853 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:51.816811 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 17:41:51.981565 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:51.981539 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1842adae-b138-4b6a-ad7f-fd2860d8cf77-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr\" (UID: \"1842adae-b138-4b6a-ad7f-fd2860d8cf77\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr" Jul 07 17:41:51.981705 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:51.981610 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1842adae-b138-4b6a-ad7f-fd2860d8cf77-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr\" (UID: \"1842adae-b138-4b6a-ad7f-fd2860d8cf77\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr" Jul 07 17:41:51.981705 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:51.981629 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgq6m\" (UniqueName: \"kubernetes.io/projected/1842adae-b138-4b6a-ad7f-fd2860d8cf77-kube-api-access-lgq6m\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr\" (UID: \"1842adae-b138-4b6a-ad7f-fd2860d8cf77\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr" Jul 07 17:41:52.081960 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:52.081889 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1842adae-b138-4b6a-ad7f-fd2860d8cf77-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr\" (UID: \"1842adae-b138-4b6a-ad7f-fd2860d8cf77\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr" Jul 07 17:41:52.081960 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:52.081923 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgq6m\" (UniqueName: \"kubernetes.io/projected/1842adae-b138-4b6a-ad7f-fd2860d8cf77-kube-api-access-lgq6m\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr\" (UID: \"1842adae-b138-4b6a-ad7f-fd2860d8cf77\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr" Jul 07 17:41:52.081960 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:52.081953 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1842adae-b138-4b6a-ad7f-fd2860d8cf77-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr\" (UID: \"1842adae-b138-4b6a-ad7f-fd2860d8cf77\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr" Jul 07 17:41:52.082234 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:52.082215 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1842adae-b138-4b6a-ad7f-fd2860d8cf77-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr\" (UID: \"1842adae-b138-4b6a-ad7f-fd2860d8cf77\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr" Jul 07 17:41:52.082331 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:52.082278 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1842adae-b138-4b6a-ad7f-fd2860d8cf77-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr\" (UID: \"1842adae-b138-4b6a-ad7f-fd2860d8cf77\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr" Jul 07 17:41:52.088809 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:52.088787 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgq6m\" (UniqueName: \"kubernetes.io/projected/1842adae-b138-4b6a-ad7f-fd2860d8cf77-kube-api-access-lgq6m\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr\" (UID: \"1842adae-b138-4b6a-ad7f-fd2860d8cf77\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr" Jul 07 17:41:52.122254 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:52.122238 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr" Jul 07 17:41:52.271697 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:52.271626 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr"] Jul 07 17:41:52.274062 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:41:52.274039 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1842adae_b138_4b6a_ad7f_fd2860d8cf77.slice/crio-e90f4c33fd314bdce46f78d128d3bab9485b5e67445a811339242460b35ba6d2 WatchSource:0}: Error finding container e90f4c33fd314bdce46f78d128d3bab9485b5e67445a811339242460b35ba6d2: Status 404 returned error can't find the container with id e90f4c33fd314bdce46f78d128d3bab9485b5e67445a811339242460b35ba6d2 Jul 07 17:41:53.139851 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:53.139812 2552 generic.go:356] "Generic (PLEG): container finished" podID="1842adae-b138-4b6a-ad7f-fd2860d8cf77" containerID="1b1529b7edd558361f607d75851fd7fdad173c0a5d1192aee420f3c54451a17f" exitCode=0 Jul 07 17:41:53.140162 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:53.139873 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr" event={"ID":"1842adae-b138-4b6a-ad7f-fd2860d8cf77","Type":"ContainerDied","Data":"1b1529b7edd558361f607d75851fd7fdad173c0a5d1192aee420f3c54451a17f"} Jul 07 17:41:53.140162 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:53.139911 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr" event={"ID":"1842adae-b138-4b6a-ad7f-fd2860d8cf77","Type":"ContainerStarted","Data":"e90f4c33fd314bdce46f78d128d3bab9485b5e67445a811339242460b35ba6d2"} Jul 07 17:41:53.140264 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:53.140250 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 17:41:54.144852 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:54.144820 2552 generic.go:356] "Generic (PLEG): container finished" podID="1842adae-b138-4b6a-ad7f-fd2860d8cf77" containerID="2f4342246d13fbef896e3ecb10f0414e08e35f9ac075bea333b06964d61eade1" exitCode=0 Jul 07 17:41:54.145195 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:54.144897 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr" event={"ID":"1842adae-b138-4b6a-ad7f-fd2860d8cf77","Type":"ContainerDied","Data":"2f4342246d13fbef896e3ecb10f0414e08e35f9ac075bea333b06964d61eade1"} Jul 07 17:41:55.151277 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:55.151249 2552 generic.go:356] "Generic (PLEG): container finished" podID="1842adae-b138-4b6a-ad7f-fd2860d8cf77" containerID="1270373667af011f2e41152578cb2d4f3831ac2f771e7994409f8189116ae934" exitCode=0 Jul 07 17:41:55.151660 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:55.151288 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr" event={"ID":"1842adae-b138-4b6a-ad7f-fd2860d8cf77","Type":"ContainerDied","Data":"1270373667af011f2e41152578cb2d4f3831ac2f771e7994409f8189116ae934"} Jul 07 17:41:56.269537 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:56.269514 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr" Jul 07 17:41:56.410100 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:56.410033 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1842adae-b138-4b6a-ad7f-fd2860d8cf77-util\") pod \"1842adae-b138-4b6a-ad7f-fd2860d8cf77\" (UID: \"1842adae-b138-4b6a-ad7f-fd2860d8cf77\") " Jul 07 17:41:56.410100 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:56.410067 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1842adae-b138-4b6a-ad7f-fd2860d8cf77-bundle\") pod \"1842adae-b138-4b6a-ad7f-fd2860d8cf77\" (UID: \"1842adae-b138-4b6a-ad7f-fd2860d8cf77\") " Jul 07 17:41:56.410100 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:56.410092 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgq6m\" (UniqueName: \"kubernetes.io/projected/1842adae-b138-4b6a-ad7f-fd2860d8cf77-kube-api-access-lgq6m\") pod \"1842adae-b138-4b6a-ad7f-fd2860d8cf77\" (UID: \"1842adae-b138-4b6a-ad7f-fd2860d8cf77\") " Jul 07 17:41:56.410806 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:56.410779 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1842adae-b138-4b6a-ad7f-fd2860d8cf77-bundle" (OuterVolumeSpecName: "bundle") pod "1842adae-b138-4b6a-ad7f-fd2860d8cf77" (UID: "1842adae-b138-4b6a-ad7f-fd2860d8cf77"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:41:56.412103 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:56.412068 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1842adae-b138-4b6a-ad7f-fd2860d8cf77-kube-api-access-lgq6m" (OuterVolumeSpecName: "kube-api-access-lgq6m") pod "1842adae-b138-4b6a-ad7f-fd2860d8cf77" (UID: "1842adae-b138-4b6a-ad7f-fd2860d8cf77"). InnerVolumeSpecName "kube-api-access-lgq6m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:41:56.415275 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:56.415242 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1842adae-b138-4b6a-ad7f-fd2860d8cf77-util" (OuterVolumeSpecName: "util") pod "1842adae-b138-4b6a-ad7f-fd2860d8cf77" (UID: "1842adae-b138-4b6a-ad7f-fd2860d8cf77"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:41:56.511363 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:56.511341 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1842adae-b138-4b6a-ad7f-fd2860d8cf77-util\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:41:56.511363 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:56.511361 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1842adae-b138-4b6a-ad7f-fd2860d8cf77-bundle\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:41:56.511484 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:56.511370 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgq6m\" (UniqueName: \"kubernetes.io/projected/1842adae-b138-4b6a-ad7f-fd2860d8cf77-kube-api-access-lgq6m\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:41:57.160654 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:57.160616 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr" event={"ID":"1842adae-b138-4b6a-ad7f-fd2860d8cf77","Type":"ContainerDied","Data":"e90f4c33fd314bdce46f78d128d3bab9485b5e67445a811339242460b35ba6d2"} Jul 07 17:41:57.160815 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:57.160674 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e90f4c33fd314bdce46f78d128d3bab9485b5e67445a811339242460b35ba6d2" Jul 07 17:41:57.160815 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:41:57.160630 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgrwsr" Jul 07 17:42:10.402871 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.402844 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-b7zxw"] Jul 07 17:42:10.403320 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.403092 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1842adae-b138-4b6a-ad7f-fd2860d8cf77" containerName="pull" Jul 07 17:42:10.403320 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.403103 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="1842adae-b138-4b6a-ad7f-fd2860d8cf77" containerName="pull" Jul 07 17:42:10.403320 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.403116 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1842adae-b138-4b6a-ad7f-fd2860d8cf77" containerName="extract" Jul 07 17:42:10.403320 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.403121 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="1842adae-b138-4b6a-ad7f-fd2860d8cf77" containerName="extract" Jul 07 17:42:10.403320 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.403129 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1842adae-b138-4b6a-ad7f-fd2860d8cf77" containerName="util" Jul 07 17:42:10.403320 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.403135 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="1842adae-b138-4b6a-ad7f-fd2860d8cf77" containerName="util" Jul 07 17:42:10.403320 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.403180 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="1842adae-b138-4b6a-ad7f-fd2860d8cf77" containerName="extract" Jul 07 17:42:10.405122 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.405107 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-b7zxw" Jul 07 17:42:10.407694 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.407674 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 17:42:10.408122 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.408103 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 17:42:10.408342 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.408328 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 17:42:10.408420 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.408352 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lj49x\"" Jul 07 17:42:10.408663 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.408646 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 17:42:10.430498 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.430481 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-b7zxw"] Jul 07 17:42:10.501546 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.501521 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/570c00ab-1625-472a-a3df-e8ff8e744b08-manifests\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-b7zxw\" (UID: \"570c00ab-1625-472a-a3df-e8ff8e744b08\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-b7zxw" Jul 07 17:42:10.501648 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.501559 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/570c00ab-1625-472a-a3df-e8ff8e744b08-tmp\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-b7zxw\" (UID: \"570c00ab-1625-472a-a3df-e8ff8e744b08\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-b7zxw" Jul 07 17:42:10.501648 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.501589 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/570c00ab-1625-472a-a3df-e8ff8e744b08-webhook-cert\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-b7zxw\" (UID: \"570c00ab-1625-472a-a3df-e8ff8e744b08\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-b7zxw" Jul 07 17:42:10.501721 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.501661 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/570c00ab-1625-472a-a3df-e8ff8e744b08-apiservice-cert\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-b7zxw\" (UID: \"570c00ab-1625-472a-a3df-e8ff8e744b08\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-b7zxw" Jul 07 17:42:10.501721 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.501700 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jjqq\" (UniqueName: \"kubernetes.io/projected/570c00ab-1625-472a-a3df-e8ff8e744b08-kube-api-access-5jjqq\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-b7zxw\" (UID: \"570c00ab-1625-472a-a3df-e8ff8e744b08\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-b7zxw" Jul 07 17:42:10.602856 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.602831 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/570c00ab-1625-472a-a3df-e8ff8e744b08-tmp\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-b7zxw\" (UID: \"570c00ab-1625-472a-a3df-e8ff8e744b08\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-b7zxw" Jul 07 17:42:10.602944 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.602862 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/570c00ab-1625-472a-a3df-e8ff8e744b08-webhook-cert\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-b7zxw\" (UID: \"570c00ab-1625-472a-a3df-e8ff8e744b08\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-b7zxw" Jul 07 17:42:10.602944 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.602888 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/570c00ab-1625-472a-a3df-e8ff8e744b08-apiservice-cert\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-b7zxw\" (UID: \"570c00ab-1625-472a-a3df-e8ff8e744b08\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-b7zxw" Jul 07 17:42:10.602944 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.602918 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jjqq\" (UniqueName: \"kubernetes.io/projected/570c00ab-1625-472a-a3df-e8ff8e744b08-kube-api-access-5jjqq\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-b7zxw\" (UID: \"570c00ab-1625-472a-a3df-e8ff8e744b08\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-b7zxw" Jul 07 17:42:10.603047 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.602963 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/570c00ab-1625-472a-a3df-e8ff8e744b08-manifests\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-b7zxw\" (UID: \"570c00ab-1625-472a-a3df-e8ff8e744b08\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-b7zxw" Jul 07 17:42:10.603317 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.603282 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/570c00ab-1625-472a-a3df-e8ff8e744b08-manifests\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-b7zxw\" (UID: \"570c00ab-1625-472a-a3df-e8ff8e744b08\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-b7zxw" Jul 07 17:42:10.605021 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.604999 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/570c00ab-1625-472a-a3df-e8ff8e744b08-tmp\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-b7zxw\" (UID: \"570c00ab-1625-472a-a3df-e8ff8e744b08\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-b7zxw" Jul 07 17:42:10.605257 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.605238 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/570c00ab-1625-472a-a3df-e8ff8e744b08-apiservice-cert\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-b7zxw\" (UID: \"570c00ab-1625-472a-a3df-e8ff8e744b08\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-b7zxw" Jul 07 17:42:10.605377 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.605356 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/570c00ab-1625-472a-a3df-e8ff8e744b08-webhook-cert\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-b7zxw\" (UID: \"570c00ab-1625-472a-a3df-e8ff8e744b08\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-b7zxw" Jul 07 17:42:10.610315 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.610284 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jjqq\" (UniqueName: \"kubernetes.io/projected/570c00ab-1625-472a-a3df-e8ff8e744b08-kube-api-access-5jjqq\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-b7zxw\" (UID: \"570c00ab-1625-472a-a3df-e8ff8e744b08\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-b7zxw" Jul 07 17:42:10.714574 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.714519 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-b7zxw" Jul 07 17:42:10.838132 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:10.838112 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-b7zxw"] Jul 07 17:42:10.840781 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:42:10.840757 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod570c00ab_1625_472a_a3df_e8ff8e744b08.slice/crio-f5519e5cf7e4a23ac489be8e1a13e22a09dca96c5fd6cf0beeaf682c24fd22ef WatchSource:0}: Error finding container f5519e5cf7e4a23ac489be8e1a13e22a09dca96c5fd6cf0beeaf682c24fd22ef: Status 404 returned error can't find the container with id f5519e5cf7e4a23ac489be8e1a13e22a09dca96c5fd6cf0beeaf682c24fd22ef Jul 07 17:42:11.213775 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:11.213743 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-b7zxw" event={"ID":"570c00ab-1625-472a-a3df-e8ff8e744b08","Type":"ContainerStarted","Data":"f5519e5cf7e4a23ac489be8e1a13e22a09dca96c5fd6cf0beeaf682c24fd22ef"} Jul 07 17:42:14.229256 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:14.229228 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-b7zxw" event={"ID":"570c00ab-1625-472a-a3df-e8ff8e744b08","Type":"ContainerStarted","Data":"aaaf4d30cb80fd3a36f5eec6108d18ffef7a27a15b91b5f98d28f56578c620d7"} Jul 07 17:42:15.234133 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:15.234058 2552 generic.go:356] "Generic (PLEG): container finished" podID="570c00ab-1625-472a-a3df-e8ff8e744b08" containerID="aaaf4d30cb80fd3a36f5eec6108d18ffef7a27a15b91b5f98d28f56578c620d7" exitCode=0 Jul 07 17:42:15.234475 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:15.234144 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-b7zxw" event={"ID":"570c00ab-1625-472a-a3df-e8ff8e744b08","Type":"ContainerDied","Data":"aaaf4d30cb80fd3a36f5eec6108d18ffef7a27a15b91b5f98d28f56578c620d7"} Jul 07 17:42:16.240189 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:16.240156 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-b7zxw" event={"ID":"570c00ab-1625-472a-a3df-e8ff8e744b08","Type":"ContainerStarted","Data":"2fb5db864a6e45c76be30579831b92686582a3d273db33e6641af7331fe7b275"} Jul 07 17:42:16.240723 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:16.240288 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-b7zxw" Jul 07 17:42:16.261448 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:16.261402 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-b7zxw" podStartSLOduration=1.9589225350000001 podStartE2EDuration="6.261389032s" totalImagesPullingTime="3.311247995s" totalInitContainerRuntime="991.218502ms" isStatefulPod=false podCreationTimestamp="2026-07-07 17:42:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:16.259408334 +0000 UTC m=+336.841415097" watchObservedRunningTime="2026-07-07 17:42:16.261389032 +0000 UTC m=+336.843395833" Jul 07 17:42:27.245840 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:27.245810 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-b7zxw" Jul 07 17:42:30.263352 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:30.263313 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-99f6fd64d-qmmsf"] Jul 07 17:42:30.372142 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:30.372111 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-99f6fd64d-qmmsf"] Jul 07 17:42:30.372289 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:30.372198 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-99f6fd64d-qmmsf" Jul 07 17:42:30.374467 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:30.374444 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 17:42:30.375189 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:30.375173 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 07 17:42:30.375274 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:30.375176 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 07 17:42:30.375274 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:30.375178 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 17:42:30.375274 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:30.375222 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-rv66s\"" Jul 07 17:42:30.435366 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:30.435326 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f5ec344-7722-4a65-9c4a-12a3c25b20dd-tmp\") pod \"kube-auth-proxy-99f6fd64d-qmmsf\" (UID: \"6f5ec344-7722-4a65-9c4a-12a3c25b20dd\") " pod="openshift-ingress/kube-auth-proxy-99f6fd64d-qmmsf" Jul 07 17:42:30.435366 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:30.435366 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f5ec344-7722-4a65-9c4a-12a3c25b20dd-tls-certs\") pod \"kube-auth-proxy-99f6fd64d-qmmsf\" (UID: \"6f5ec344-7722-4a65-9c4a-12a3c25b20dd\") " pod="openshift-ingress/kube-auth-proxy-99f6fd64d-qmmsf" Jul 07 17:42:30.435564 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:30.435401 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx9l6\" (UniqueName: \"kubernetes.io/projected/6f5ec344-7722-4a65-9c4a-12a3c25b20dd-kube-api-access-cx9l6\") pod \"kube-auth-proxy-99f6fd64d-qmmsf\" (UID: \"6f5ec344-7722-4a65-9c4a-12a3c25b20dd\") " pod="openshift-ingress/kube-auth-proxy-99f6fd64d-qmmsf" Jul 07 17:42:30.536560 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:30.536479 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f5ec344-7722-4a65-9c4a-12a3c25b20dd-tmp\") pod \"kube-auth-proxy-99f6fd64d-qmmsf\" (UID: \"6f5ec344-7722-4a65-9c4a-12a3c25b20dd\") " pod="openshift-ingress/kube-auth-proxy-99f6fd64d-qmmsf" Jul 07 17:42:30.536560 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:30.536521 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f5ec344-7722-4a65-9c4a-12a3c25b20dd-tls-certs\") pod \"kube-auth-proxy-99f6fd64d-qmmsf\" (UID: \"6f5ec344-7722-4a65-9c4a-12a3c25b20dd\") " pod="openshift-ingress/kube-auth-proxy-99f6fd64d-qmmsf" Jul 07 17:42:30.536773 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:30.536623 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx9l6\" (UniqueName: \"kubernetes.io/projected/6f5ec344-7722-4a65-9c4a-12a3c25b20dd-kube-api-access-cx9l6\") pod \"kube-auth-proxy-99f6fd64d-qmmsf\" (UID: \"6f5ec344-7722-4a65-9c4a-12a3c25b20dd\") " pod="openshift-ingress/kube-auth-proxy-99f6fd64d-qmmsf" Jul 07 17:42:30.536773 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:42:30.536731 2552 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 07 17:42:30.536880 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:42:30.536803 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f5ec344-7722-4a65-9c4a-12a3c25b20dd-tls-certs podName:6f5ec344-7722-4a65-9c4a-12a3c25b20dd nodeName:}" failed. No retries permitted until 2026-07-07 17:42:31.03678166 +0000 UTC m=+351.618788385 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/6f5ec344-7722-4a65-9c4a-12a3c25b20dd-tls-certs") pod "kube-auth-proxy-99f6fd64d-qmmsf" (UID: "6f5ec344-7722-4a65-9c4a-12a3c25b20dd") : secret "kube-auth-proxy-tls" not found Jul 07 17:42:30.538777 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:30.538755 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f5ec344-7722-4a65-9c4a-12a3c25b20dd-tmp\") pod \"kube-auth-proxy-99f6fd64d-qmmsf\" (UID: \"6f5ec344-7722-4a65-9c4a-12a3c25b20dd\") " pod="openshift-ingress/kube-auth-proxy-99f6fd64d-qmmsf" Jul 07 17:42:30.546881 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:30.546857 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx9l6\" (UniqueName: \"kubernetes.io/projected/6f5ec344-7722-4a65-9c4a-12a3c25b20dd-kube-api-access-cx9l6\") pod \"kube-auth-proxy-99f6fd64d-qmmsf\" (UID: \"6f5ec344-7722-4a65-9c4a-12a3c25b20dd\") " pod="openshift-ingress/kube-auth-proxy-99f6fd64d-qmmsf" Jul 07 17:42:31.041314 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.041269 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f5ec344-7722-4a65-9c4a-12a3c25b20dd-tls-certs\") pod \"kube-auth-proxy-99f6fd64d-qmmsf\" (UID: \"6f5ec344-7722-4a65-9c4a-12a3c25b20dd\") " pod="openshift-ingress/kube-auth-proxy-99f6fd64d-qmmsf" Jul 07 17:42:31.043677 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.043654 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f5ec344-7722-4a65-9c4a-12a3c25b20dd-tls-certs\") pod \"kube-auth-proxy-99f6fd64d-qmmsf\" (UID: \"6f5ec344-7722-4a65-9c4a-12a3c25b20dd\") " pod="openshift-ingress/kube-auth-proxy-99f6fd64d-qmmsf" Jul 07 17:42:31.234537 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.234459 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9kp84"] Jul 07 17:42:31.237116 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.237101 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" Jul 07 17:42:31.239585 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.239557 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 07 17:42:31.239585 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.239563 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 07 17:42:31.239771 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.239614 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 07 17:42:31.239771 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.239636 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 17:42:31.239771 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.239578 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-pqksc\"" Jul 07 17:42:31.251235 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.251215 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9kp84"] Jul 07 17:42:31.281786 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.281764 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-99f6fd64d-qmmsf" Jul 07 17:42:31.343095 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.342889 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-istio-token\") pod \"istiod-openshift-gateway-7574459656-9kp84\" (UID: \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" Jul 07 17:42:31.343095 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.342935 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9kp84\" (UID: \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" Jul 07 17:42:31.343095 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.342999 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-local-certs\") pod \"istiod-openshift-gateway-7574459656-9kp84\" (UID: \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" Jul 07 17:42:31.343095 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.343039 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-cacerts\") pod \"istiod-openshift-gateway-7574459656-9kp84\" (UID: \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" Jul 07 17:42:31.343095 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.343066 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8znlr\" (UniqueName: \"kubernetes.io/projected/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-kube-api-access-8znlr\") pod \"istiod-openshift-gateway-7574459656-9kp84\" (UID: \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" Jul 07 17:42:31.343468 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.343131 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9kp84\" (UID: \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" Jul 07 17:42:31.343468 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.343185 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9kp84\" (UID: \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" Jul 07 17:42:31.410104 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.410081 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-99f6fd64d-qmmsf"] Jul 07 17:42:31.412295 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:42:31.412263 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f5ec344_7722_4a65_9c4a_12a3c25b20dd.slice/crio-174e9cfcd929917e6162981226f903d6e4cab825c5bfcbb9efc6f76dd3dde7c1 WatchSource:0}: Error finding container 174e9cfcd929917e6162981226f903d6e4cab825c5bfcbb9efc6f76dd3dde7c1: Status 404 returned error can't find the container with id 174e9cfcd929917e6162981226f903d6e4cab825c5bfcbb9efc6f76dd3dde7c1 Jul 07 17:42:31.443953 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.443929 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-local-certs\") pod \"istiod-openshift-gateway-7574459656-9kp84\" (UID: \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" Jul 07 17:42:31.444044 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.443964 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-cacerts\") pod \"istiod-openshift-gateway-7574459656-9kp84\" (UID: \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" Jul 07 17:42:31.444044 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.443986 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8znlr\" (UniqueName: \"kubernetes.io/projected/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-kube-api-access-8znlr\") pod \"istiod-openshift-gateway-7574459656-9kp84\" (UID: \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" Jul 07 17:42:31.444044 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.444014 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9kp84\" (UID: \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" Jul 07 17:42:31.444195 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.444050 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9kp84\" (UID: \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" Jul 07 17:42:31.444195 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.444085 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-istio-token\") pod \"istiod-openshift-gateway-7574459656-9kp84\" (UID: \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" Jul 07 17:42:31.444195 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.444113 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9kp84\" (UID: \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" Jul 07 17:42:31.444783 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.444760 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9kp84\" (UID: \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" Jul 07 17:42:31.446094 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.446077 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-local-certs\") pod \"istiod-openshift-gateway-7574459656-9kp84\" (UID: \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" Jul 07 17:42:31.446818 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.446799 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9kp84\" (UID: \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" Jul 07 17:42:31.446876 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.446841 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9kp84\" (UID: \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" Jul 07 17:42:31.446876 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.446850 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-cacerts\") pod \"istiod-openshift-gateway-7574459656-9kp84\" (UID: \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" Jul 07 17:42:31.451217 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.451194 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-istio-token\") pod \"istiod-openshift-gateway-7574459656-9kp84\" (UID: \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" Jul 07 17:42:31.451445 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.451430 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8znlr\" (UniqueName: \"kubernetes.io/projected/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-kube-api-access-8znlr\") pod \"istiod-openshift-gateway-7574459656-9kp84\" (UID: \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" Jul 07 17:42:31.546644 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.546593 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" Jul 07 17:42:31.694260 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:31.694236 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9kp84"] Jul 07 17:42:31.696483 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:42:31.696454 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8e9abb2_9bde_47ef_bb15_a2fdbf8a2ae4.slice/crio-13dcdf36dcd21d00940361b0ee916635e8100633126532b3e672a9a2189b6d27 WatchSource:0}: Error finding container 13dcdf36dcd21d00940361b0ee916635e8100633126532b3e672a9a2189b6d27: Status 404 returned error can't find the container with id 13dcdf36dcd21d00940361b0ee916635e8100633126532b3e672a9a2189b6d27 Jul 07 17:42:32.303809 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:32.303771 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-99f6fd64d-qmmsf" event={"ID":"6f5ec344-7722-4a65-9c4a-12a3c25b20dd","Type":"ContainerStarted","Data":"174e9cfcd929917e6162981226f903d6e4cab825c5bfcbb9efc6f76dd3dde7c1"} Jul 07 17:42:32.305928 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:32.305897 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" event={"ID":"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4","Type":"ContainerStarted","Data":"13dcdf36dcd21d00940361b0ee916635e8100633126532b3e672a9a2189b6d27"} Jul 07 17:42:34.909053 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:34.909014 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 17:42:34.909329 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:34.909089 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 17:42:35.323424 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:35.323325 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" event={"ID":"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4","Type":"ContainerStarted","Data":"850e7a1f64e9d0d3b484a79017a5c435c7a0c4c65c6ec41d1763899e9be442b0"} Jul 07 17:42:35.323424 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:35.323387 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" Jul 07 17:42:35.324974 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:35.324943 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-99f6fd64d-qmmsf" event={"ID":"6f5ec344-7722-4a65-9c4a-12a3c25b20dd","Type":"ContainerStarted","Data":"f3fd8e32cc160cf40af2f5d8dcebf02587b9c0957548713b489f5f8ed09142e4"} Jul 07 17:42:35.325557 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:35.325526 2552 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-9kp84 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 17:42:35.325633 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:35.325577 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" podUID="a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 17:42:35.353795 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:35.353759 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" podStartSLOduration=1.1434625330000001 podStartE2EDuration="4.353746637s" totalImagesPullingTime="3.210284104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:42:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:35.352102579 +0000 UTC m=+355.934109328" watchObservedRunningTime="2026-07-07 17:42:35.353746637 +0000 UTC m=+355.935753381" Jul 07 17:42:35.382049 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:35.381999 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-99f6fd64d-qmmsf" podStartSLOduration=1.886373973 podStartE2EDuration="5.381987346s" totalImagesPullingTime="3.495613373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:42:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:35.381208981 +0000 UTC m=+355.963215725" watchObservedRunningTime="2026-07-07 17:42:35.381987346 +0000 UTC m=+355.963994089" Jul 07 17:42:36.329726 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:36.329703 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" Jul 07 17:42:40.649826 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:40.649788 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-vfmtk"] Jul 07 17:42:40.654215 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:40.654196 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vfmtk" Jul 07 17:42:40.658872 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:40.658852 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-5g4jk\"" Jul 07 17:42:40.659122 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:40.659108 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 07 17:42:40.660250 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:40.660230 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4fscl"] Jul 07 17:42:40.663218 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:40.663202 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4fscl" Jul 07 17:42:40.666424 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:40.666406 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 07 17:42:40.666599 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:40.666586 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-4j2g2\"" Jul 07 17:42:40.676553 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:40.676532 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-vfmtk"] Jul 07 17:42:40.695646 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:40.695618 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4fscl"] Jul 07 17:42:40.714822 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:40.714798 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vzth\" (UniqueName: \"kubernetes.io/projected/f342dce6-1de6-44e1-97f5-e44303edb74e-kube-api-access-7vzth\") pod \"llmisvc-controller-manager-777c6bd7d5-4fscl\" (UID: \"f342dce6-1de6-44e1-97f5-e44303edb74e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4fscl" Jul 07 17:42:40.714933 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:40.714838 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f342dce6-1de6-44e1-97f5-e44303edb74e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4fscl\" (UID: \"f342dce6-1de6-44e1-97f5-e44303edb74e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4fscl" Jul 07 17:42:40.714933 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:40.714870 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vt2w\" (UniqueName: \"kubernetes.io/projected/d21b6c50-9a23-4856-8b9c-7d3a7eba9c8b-kube-api-access-9vt2w\") pod \"kserve-controller-manager-d6f4b65b8-vfmtk\" (UID: \"d21b6c50-9a23-4856-8b9c-7d3a7eba9c8b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vfmtk" Jul 07 17:42:40.714933 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:40.714907 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d21b6c50-9a23-4856-8b9c-7d3a7eba9c8b-cert\") pod \"kserve-controller-manager-d6f4b65b8-vfmtk\" (UID: \"d21b6c50-9a23-4856-8b9c-7d3a7eba9c8b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vfmtk" Jul 07 17:42:40.815644 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:40.815617 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vzth\" (UniqueName: \"kubernetes.io/projected/f342dce6-1de6-44e1-97f5-e44303edb74e-kube-api-access-7vzth\") pod \"llmisvc-controller-manager-777c6bd7d5-4fscl\" (UID: \"f342dce6-1de6-44e1-97f5-e44303edb74e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4fscl" Jul 07 17:42:40.815762 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:40.815661 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f342dce6-1de6-44e1-97f5-e44303edb74e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4fscl\" (UID: \"f342dce6-1de6-44e1-97f5-e44303edb74e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4fscl" Jul 07 17:42:40.815762 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:40.815719 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vt2w\" (UniqueName: \"kubernetes.io/projected/d21b6c50-9a23-4856-8b9c-7d3a7eba9c8b-kube-api-access-9vt2w\") pod \"kserve-controller-manager-d6f4b65b8-vfmtk\" (UID: \"d21b6c50-9a23-4856-8b9c-7d3a7eba9c8b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vfmtk" Jul 07 17:42:40.815762 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:42:40.815750 2552 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 07 17:42:40.815906 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:40.815762 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d21b6c50-9a23-4856-8b9c-7d3a7eba9c8b-cert\") pod \"kserve-controller-manager-d6f4b65b8-vfmtk\" (UID: \"d21b6c50-9a23-4856-8b9c-7d3a7eba9c8b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vfmtk" Jul 07 17:42:40.815906 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:42:40.815803 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f342dce6-1de6-44e1-97f5-e44303edb74e-cert podName:f342dce6-1de6-44e1-97f5-e44303edb74e nodeName:}" failed. No retries permitted until 2026-07-07 17:42:41.315787519 +0000 UTC m=+361.897794243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f342dce6-1de6-44e1-97f5-e44303edb74e-cert") pod "llmisvc-controller-manager-777c6bd7d5-4fscl" (UID: "f342dce6-1de6-44e1-97f5-e44303edb74e") : secret "llmisvc-webhook-server-cert" not found Jul 07 17:42:40.815986 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:42:40.815928 2552 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 07 17:42:40.815986 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:42:40.815979 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d21b6c50-9a23-4856-8b9c-7d3a7eba9c8b-cert podName:d21b6c50-9a23-4856-8b9c-7d3a7eba9c8b nodeName:}" failed. No retries permitted until 2026-07-07 17:42:41.315962521 +0000 UTC m=+361.897969244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d21b6c50-9a23-4856-8b9c-7d3a7eba9c8b-cert") pod "kserve-controller-manager-d6f4b65b8-vfmtk" (UID: "d21b6c50-9a23-4856-8b9c-7d3a7eba9c8b") : secret "kserve-webhook-server-cert" not found Jul 07 17:42:40.824190 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:40.824169 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vzth\" (UniqueName: \"kubernetes.io/projected/f342dce6-1de6-44e1-97f5-e44303edb74e-kube-api-access-7vzth\") pod \"llmisvc-controller-manager-777c6bd7d5-4fscl\" (UID: \"f342dce6-1de6-44e1-97f5-e44303edb74e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4fscl" Jul 07 17:42:40.824461 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:40.824446 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vt2w\" (UniqueName: \"kubernetes.io/projected/d21b6c50-9a23-4856-8b9c-7d3a7eba9c8b-kube-api-access-9vt2w\") pod \"kserve-controller-manager-d6f4b65b8-vfmtk\" (UID: \"d21b6c50-9a23-4856-8b9c-7d3a7eba9c8b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vfmtk" Jul 07 17:42:41.320390 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:41.320357 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f342dce6-1de6-44e1-97f5-e44303edb74e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4fscl\" (UID: \"f342dce6-1de6-44e1-97f5-e44303edb74e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4fscl" Jul 07 17:42:41.320553 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:41.320412 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d21b6c50-9a23-4856-8b9c-7d3a7eba9c8b-cert\") pod \"kserve-controller-manager-d6f4b65b8-vfmtk\" (UID: \"d21b6c50-9a23-4856-8b9c-7d3a7eba9c8b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vfmtk" Jul 07 17:42:41.322683 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:41.322660 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f342dce6-1de6-44e1-97f5-e44303edb74e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4fscl\" (UID: \"f342dce6-1de6-44e1-97f5-e44303edb74e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4fscl" Jul 07 17:42:41.323135 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:41.323117 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d21b6c50-9a23-4856-8b9c-7d3a7eba9c8b-cert\") pod \"kserve-controller-manager-d6f4b65b8-vfmtk\" (UID: \"d21b6c50-9a23-4856-8b9c-7d3a7eba9c8b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vfmtk" Jul 07 17:42:41.564975 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:41.564943 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vfmtk" Jul 07 17:42:41.572159 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:41.572092 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4fscl" Jul 07 17:42:41.706218 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:41.706193 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-vfmtk"] Jul 07 17:42:41.710026 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:42:41.710004 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd21b6c50_9a23_4856_8b9c_7d3a7eba9c8b.slice/crio-1eebaae8f66d8c504df1b1095b4ca6058994de0d01e88f2dcd6d434382b9ae93 WatchSource:0}: Error finding container 1eebaae8f66d8c504df1b1095b4ca6058994de0d01e88f2dcd6d434382b9ae93: Status 404 returned error can't find the container with id 1eebaae8f66d8c504df1b1095b4ca6058994de0d01e88f2dcd6d434382b9ae93 Jul 07 17:42:41.729525 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:41.729503 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4fscl"] Jul 07 17:42:41.731682 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:42:41.731661 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf342dce6_1de6_44e1_97f5_e44303edb74e.slice/crio-7f8fb1d298ff81019c70fdf713814302b4e27dcd3455e8ee3089e73c9df451d3 WatchSource:0}: Error finding container 7f8fb1d298ff81019c70fdf713814302b4e27dcd3455e8ee3089e73c9df451d3: Status 404 returned error can't find the container with id 7f8fb1d298ff81019c70fdf713814302b4e27dcd3455e8ee3089e73c9df451d3 Jul 07 17:42:42.354448 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:42.354413 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vfmtk" event={"ID":"d21b6c50-9a23-4856-8b9c-7d3a7eba9c8b","Type":"ContainerStarted","Data":"1eebaae8f66d8c504df1b1095b4ca6058994de0d01e88f2dcd6d434382b9ae93"} Jul 07 17:42:42.355411 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:42.355383 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4fscl" event={"ID":"f342dce6-1de6-44e1-97f5-e44303edb74e","Type":"ContainerStarted","Data":"7f8fb1d298ff81019c70fdf713814302b4e27dcd3455e8ee3089e73c9df451d3"} Jul 07 17:42:45.370095 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:45.370002 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4fscl" event={"ID":"f342dce6-1de6-44e1-97f5-e44303edb74e","Type":"ContainerStarted","Data":"bb4871f3c7711669fb9ce0fb1f91cb762d146f18847181ec8cfbc689d19ef4b8"} Jul 07 17:42:45.370095 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:45.370075 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4fscl" Jul 07 17:42:45.371381 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:45.371356 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vfmtk" event={"ID":"d21b6c50-9a23-4856-8b9c-7d3a7eba9c8b","Type":"ContainerStarted","Data":"7360a3f628e0e52a923093a9c230e924423225874d1dd663f2019e2954d7717c"} Jul 07 17:42:45.371487 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:45.371476 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vfmtk" Jul 07 17:42:45.388173 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:45.388113 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4fscl" podStartSLOduration=2.045839271 podStartE2EDuration="5.388099039s" totalImagesPullingTime="3.342259768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:42:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:45.38740618 +0000 UTC m=+365.969412923" watchObservedRunningTime="2026-07-07 17:42:45.388099039 +0000 UTC m=+365.970105781" Jul 07 17:42:45.403514 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:45.403471 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vfmtk" podStartSLOduration=2.61657536 podStartE2EDuration="5.403453744s" totalImagesPullingTime="2.786878384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:42:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:45.402792865 +0000 UTC m=+365.984799635" watchObservedRunningTime="2026-07-07 17:42:45.403453744 +0000 UTC m=+365.985460493" Jul 07 17:42:46.282383 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:46.282355 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9kp84"] Jul 07 17:42:46.282584 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:46.282545 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" podUID="a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4" containerName="discovery" containerID="cri-o://850e7a1f64e9d0d3b484a79017a5c435c7a0c4c65c6ec41d1763899e9be442b0" gracePeriod=30 Jul 07 17:42:46.508936 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:46.508916 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" Jul 07 17:42:46.571349 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:46.571277 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8znlr\" (UniqueName: \"kubernetes.io/projected/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-kube-api-access-8znlr\") pod \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\" (UID: \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\") " Jul 07 17:42:46.571349 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:46.571330 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-cacerts\") pod \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\" (UID: \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\") " Jul 07 17:42:46.571492 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:46.571357 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-istio-kubeconfig\") pod \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\" (UID: \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\") " Jul 07 17:42:46.571492 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:46.571418 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-istio-csr-dns-cert\") pod \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\" (UID: \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\") " Jul 07 17:42:46.571492 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:46.571447 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-istio-csr-ca-configmap\") pod \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\" (UID: \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\") " Jul 07 17:42:46.571492 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:46.571473 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-istio-token\") pod \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\" (UID: \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\") " Jul 07 17:42:46.571492 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:46.571490 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-local-certs\") pod \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\" (UID: \"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4\") " Jul 07 17:42:46.571918 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:46.571877 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4" (UID: "a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 17:42:46.573714 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:46.573678 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-kube-api-access-8znlr" (OuterVolumeSpecName: "kube-api-access-8znlr") pod "a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4" (UID: "a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4"). InnerVolumeSpecName "kube-api-access-8znlr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:42:46.573805 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:46.573786 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-local-certs" (OuterVolumeSpecName: "local-certs") pod "a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4" (UID: "a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:42:46.573922 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:46.573888 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-istio-token" (OuterVolumeSpecName: "istio-token") pod "a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4" (UID: "a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:42:46.574011 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:46.573902 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4" (UID: "a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:42:46.574011 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:46.573926 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-cacerts" (OuterVolumeSpecName: "cacerts") pod "a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4" (UID: "a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:42:46.574011 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:46.573941 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4" (UID: "a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:42:46.672920 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:46.672882 2552 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-istio-kubeconfig\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:42:46.672920 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:46.672913 2552 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-istio-csr-dns-cert\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:42:46.673086 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:46.672927 2552 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-istio-csr-ca-configmap\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:42:46.673086 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:46.672940 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-istio-token\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:42:46.673086 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:46.672952 2552 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-local-certs\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:42:46.673086 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:46.672965 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8znlr\" (UniqueName: \"kubernetes.io/projected/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-kube-api-access-8znlr\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:42:46.673086 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:46.672977 2552 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4-cacerts\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:42:47.381172 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:47.381144 2552 generic.go:356] "Generic (PLEG): container finished" podID="a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4" containerID="850e7a1f64e9d0d3b484a79017a5c435c7a0c4c65c6ec41d1763899e9be442b0" exitCode=0 Jul 07 17:42:47.381342 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:47.381186 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" Jul 07 17:42:47.381342 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:47.381188 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" event={"ID":"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4","Type":"ContainerDied","Data":"850e7a1f64e9d0d3b484a79017a5c435c7a0c4c65c6ec41d1763899e9be442b0"} Jul 07 17:42:47.381342 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:47.381285 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9kp84" event={"ID":"a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4","Type":"ContainerDied","Data":"13dcdf36dcd21d00940361b0ee916635e8100633126532b3e672a9a2189b6d27"} Jul 07 17:42:47.381342 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:47.381325 2552 scope.go:117] "RemoveContainer" containerID="850e7a1f64e9d0d3b484a79017a5c435c7a0c4c65c6ec41d1763899e9be442b0" Jul 07 17:42:47.389794 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:47.389778 2552 scope.go:117] "RemoveContainer" containerID="850e7a1f64e9d0d3b484a79017a5c435c7a0c4c65c6ec41d1763899e9be442b0" Jul 07 17:42:47.390027 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:42:47.390010 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"850e7a1f64e9d0d3b484a79017a5c435c7a0c4c65c6ec41d1763899e9be442b0\": container with ID starting with 850e7a1f64e9d0d3b484a79017a5c435c7a0c4c65c6ec41d1763899e9be442b0 not found: ID does not exist" containerID="850e7a1f64e9d0d3b484a79017a5c435c7a0c4c65c6ec41d1763899e9be442b0" Jul 07 17:42:47.390069 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:47.390036 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"850e7a1f64e9d0d3b484a79017a5c435c7a0c4c65c6ec41d1763899e9be442b0"} err="failed to get container status \"850e7a1f64e9d0d3b484a79017a5c435c7a0c4c65c6ec41d1763899e9be442b0\": rpc error: code = NotFound desc = could not find container \"850e7a1f64e9d0d3b484a79017a5c435c7a0c4c65c6ec41d1763899e9be442b0\": container with ID starting with 850e7a1f64e9d0d3b484a79017a5c435c7a0c4c65c6ec41d1763899e9be442b0 not found: ID does not exist" Jul 07 17:42:47.402159 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:47.402138 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9kp84"] Jul 07 17:42:47.411561 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:47.411543 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9kp84"] Jul 07 17:42:47.971648 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:42:47.971618 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4" path="/var/lib/kubelet/pods/a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4/volumes" Jul 07 17:43:16.377367 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:16.377334 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4fscl" Jul 07 17:43:16.380214 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:16.380194 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vfmtk" Jul 07 17:43:31.247579 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:31.247509 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hz29d"] Jul 07 17:43:31.248184 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:31.247790 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4" containerName="discovery" Jul 07 17:43:31.248184 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:31.247801 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4" containerName="discovery" Jul 07 17:43:31.248184 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:31.247867 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8e9abb2-9bde-47ef-bb15-a2fdbf8a2ae4" containerName="discovery" Jul 07 17:43:31.260082 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:31.260057 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hz29d"] Jul 07 17:43:31.260225 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:31.260169 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hz29d" Jul 07 17:43:31.262550 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:31.262525 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 17:43:31.263287 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:31.263262 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 17:43:31.263420 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:31.263335 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-n4m95\"" Jul 07 17:43:31.398508 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:31.398480 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzr9t\" (UniqueName: \"kubernetes.io/projected/50795050-a940-405b-afeb-d17e3d6d9e50-kube-api-access-mzr9t\") pod \"kuadrant-operator-catalog-hz29d\" (UID: \"50795050-a940-405b-afeb-d17e3d6d9e50\") " pod="kuadrant-system/kuadrant-operator-catalog-hz29d" Jul 07 17:43:31.499928 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:31.499839 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzr9t\" (UniqueName: \"kubernetes.io/projected/50795050-a940-405b-afeb-d17e3d6d9e50-kube-api-access-mzr9t\") pod \"kuadrant-operator-catalog-hz29d\" (UID: \"50795050-a940-405b-afeb-d17e3d6d9e50\") " pod="kuadrant-system/kuadrant-operator-catalog-hz29d" Jul 07 17:43:31.507216 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:31.507186 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzr9t\" (UniqueName: \"kubernetes.io/projected/50795050-a940-405b-afeb-d17e3d6d9e50-kube-api-access-mzr9t\") pod \"kuadrant-operator-catalog-hz29d\" (UID: \"50795050-a940-405b-afeb-d17e3d6d9e50\") " pod="kuadrant-system/kuadrant-operator-catalog-hz29d" Jul 07 17:43:31.570854 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:31.570829 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hz29d" Jul 07 17:43:31.691885 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:31.691827 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hz29d"] Jul 07 17:43:31.694226 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:43:31.694181 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50795050_a940_405b_afeb_d17e3d6d9e50.slice/crio-4ed9d5137f318fbcff32b33675e98bdda9eaf4f1ebda937a45a3e883b769c641 WatchSource:0}: Error finding container 4ed9d5137f318fbcff32b33675e98bdda9eaf4f1ebda937a45a3e883b769c641: Status 404 returned error can't find the container with id 4ed9d5137f318fbcff32b33675e98bdda9eaf4f1ebda937a45a3e883b769c641 Jul 07 17:43:31.732260 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:31.732239 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hz29d"] Jul 07 17:43:31.822802 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:31.822740 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-72qvr"] Jul 07 17:43:31.825824 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:31.825810 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-72qvr" Jul 07 17:43:31.832936 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:31.832911 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-72qvr"] Jul 07 17:43:32.003938 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:32.003910 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcgc9\" (UniqueName: \"kubernetes.io/projected/0bc6548a-d35d-4f9e-8a20-9eda3c4a193e-kube-api-access-qcgc9\") pod \"kuadrant-operator-catalog-72qvr\" (UID: \"0bc6548a-d35d-4f9e-8a20-9eda3c4a193e\") " pod="kuadrant-system/kuadrant-operator-catalog-72qvr" Jul 07 17:43:32.104697 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:32.104604 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcgc9\" (UniqueName: \"kubernetes.io/projected/0bc6548a-d35d-4f9e-8a20-9eda3c4a193e-kube-api-access-qcgc9\") pod \"kuadrant-operator-catalog-72qvr\" (UID: \"0bc6548a-d35d-4f9e-8a20-9eda3c4a193e\") " pod="kuadrant-system/kuadrant-operator-catalog-72qvr" Jul 07 17:43:32.111847 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:32.111827 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcgc9\" (UniqueName: \"kubernetes.io/projected/0bc6548a-d35d-4f9e-8a20-9eda3c4a193e-kube-api-access-qcgc9\") pod \"kuadrant-operator-catalog-72qvr\" (UID: \"0bc6548a-d35d-4f9e-8a20-9eda3c4a193e\") " pod="kuadrant-system/kuadrant-operator-catalog-72qvr" Jul 07 17:43:32.135794 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:32.135769 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-72qvr" Jul 07 17:43:32.260271 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:32.260248 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-72qvr"] Jul 07 17:43:32.262708 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:43:32.262682 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bc6548a_d35d_4f9e_8a20_9eda3c4a193e.slice/crio-b541e9eb142dacfd93f3492846720250067efd90417ecff7dc5e0a5bfe74916c WatchSource:0}: Error finding container b541e9eb142dacfd93f3492846720250067efd90417ecff7dc5e0a5bfe74916c: Status 404 returned error can't find the container with id b541e9eb142dacfd93f3492846720250067efd90417ecff7dc5e0a5bfe74916c Jul 07 17:43:32.567475 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:32.567429 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hz29d" event={"ID":"50795050-a940-405b-afeb-d17e3d6d9e50","Type":"ContainerStarted","Data":"4ed9d5137f318fbcff32b33675e98bdda9eaf4f1ebda937a45a3e883b769c641"} Jul 07 17:43:32.568793 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:32.568762 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-72qvr" event={"ID":"0bc6548a-d35d-4f9e-8a20-9eda3c4a193e","Type":"ContainerStarted","Data":"b541e9eb142dacfd93f3492846720250067efd90417ecff7dc5e0a5bfe74916c"} Jul 07 17:43:34.580292 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:34.580241 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hz29d" event={"ID":"50795050-a940-405b-afeb-d17e3d6d9e50","Type":"ContainerStarted","Data":"3ec7f24f5aefe66b644066f099805b66f5db4b5a5383e3157bb5437250537ccc"} Jul 07 17:43:34.580292 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:34.580265 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-hz29d" podUID="50795050-a940-405b-afeb-d17e3d6d9e50" containerName="registry-server" containerID="cri-o://3ec7f24f5aefe66b644066f099805b66f5db4b5a5383e3157bb5437250537ccc" gracePeriod=2 Jul 07 17:43:34.581703 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:34.581678 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-72qvr" event={"ID":"0bc6548a-d35d-4f9e-8a20-9eda3c4a193e","Type":"ContainerStarted","Data":"ff62f3a3ef93944b89510187d5d7f115befc5a6c5d29d5d78164cf0e9a2a18ac"} Jul 07 17:43:34.598801 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:34.598762 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hz29d" podStartSLOduration=1.5132053970000001 podStartE2EDuration="3.598747871s" totalImagesPullingTime="2.085542474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:43:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:43:34.597553202 +0000 UTC m=+415.179559947" watchObservedRunningTime="2026-07-07 17:43:34.598747871 +0000 UTC m=+415.180754615" Jul 07 17:43:34.612535 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:34.612497 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-72qvr" podStartSLOduration=2.094988459 podStartE2EDuration="3.612483777s" totalImagesPullingTime="1.517495318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:43:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:43:34.611344925 +0000 UTC m=+415.193351681" watchObservedRunningTime="2026-07-07 17:43:34.612483777 +0000 UTC m=+415.194490521" Jul 07 17:43:34.813354 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:34.813334 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hz29d" Jul 07 17:43:34.929354 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:34.929332 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzr9t\" (UniqueName: \"kubernetes.io/projected/50795050-a940-405b-afeb-d17e3d6d9e50-kube-api-access-mzr9t\") pod \"50795050-a940-405b-afeb-d17e3d6d9e50\" (UID: \"50795050-a940-405b-afeb-d17e3d6d9e50\") " Jul 07 17:43:34.931353 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:34.931324 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50795050-a940-405b-afeb-d17e3d6d9e50-kube-api-access-mzr9t" (OuterVolumeSpecName: "kube-api-access-mzr9t") pod "50795050-a940-405b-afeb-d17e3d6d9e50" (UID: "50795050-a940-405b-afeb-d17e3d6d9e50"). InnerVolumeSpecName "kube-api-access-mzr9t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:43:35.029980 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:35.029948 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzr9t\" (UniqueName: \"kubernetes.io/projected/50795050-a940-405b-afeb-d17e3d6d9e50-kube-api-access-mzr9t\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:43:35.587270 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:35.587238 2552 generic.go:356] "Generic (PLEG): container finished" podID="50795050-a940-405b-afeb-d17e3d6d9e50" containerID="3ec7f24f5aefe66b644066f099805b66f5db4b5a5383e3157bb5437250537ccc" exitCode=0 Jul 07 17:43:35.587689 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:35.587294 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hz29d" Jul 07 17:43:35.587689 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:35.587322 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hz29d" event={"ID":"50795050-a940-405b-afeb-d17e3d6d9e50","Type":"ContainerDied","Data":"3ec7f24f5aefe66b644066f099805b66f5db4b5a5383e3157bb5437250537ccc"} Jul 07 17:43:35.587689 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:35.587397 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hz29d" event={"ID":"50795050-a940-405b-afeb-d17e3d6d9e50","Type":"ContainerDied","Data":"4ed9d5137f318fbcff32b33675e98bdda9eaf4f1ebda937a45a3e883b769c641"} Jul 07 17:43:35.587689 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:35.587418 2552 scope.go:117] "RemoveContainer" containerID="3ec7f24f5aefe66b644066f099805b66f5db4b5a5383e3157bb5437250537ccc" Jul 07 17:43:35.596466 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:35.596450 2552 scope.go:117] "RemoveContainer" containerID="3ec7f24f5aefe66b644066f099805b66f5db4b5a5383e3157bb5437250537ccc" Jul 07 17:43:35.596686 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:43:35.596672 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ec7f24f5aefe66b644066f099805b66f5db4b5a5383e3157bb5437250537ccc\": container with ID starting with 3ec7f24f5aefe66b644066f099805b66f5db4b5a5383e3157bb5437250537ccc not found: ID does not exist" containerID="3ec7f24f5aefe66b644066f099805b66f5db4b5a5383e3157bb5437250537ccc" Jul 07 17:43:35.596729 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:35.596692 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ec7f24f5aefe66b644066f099805b66f5db4b5a5383e3157bb5437250537ccc"} err="failed to get container status \"3ec7f24f5aefe66b644066f099805b66f5db4b5a5383e3157bb5437250537ccc\": rpc error: code = NotFound desc = could not find container \"3ec7f24f5aefe66b644066f099805b66f5db4b5a5383e3157bb5437250537ccc\": container with ID starting with 3ec7f24f5aefe66b644066f099805b66f5db4b5a5383e3157bb5437250537ccc not found: ID does not exist" Jul 07 17:43:35.608531 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:35.608514 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hz29d"] Jul 07 17:43:35.612409 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:35.612390 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hz29d"] Jul 07 17:43:35.970839 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:35.970812 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50795050-a940-405b-afeb-d17e3d6d9e50" path="/var/lib/kubelet/pods/50795050-a940-405b-afeb-d17e3d6d9e50/volumes" Jul 07 17:43:42.136132 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:42.136099 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-72qvr" Jul 07 17:43:42.136528 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:42.136152 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-72qvr" Jul 07 17:43:42.157827 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:42.157805 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-72qvr" Jul 07 17:43:42.637768 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:42.637742 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-72qvr" Jul 07 17:43:46.625476 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:46.625445 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw"] Jul 07 17:43:46.625871 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:46.625714 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50795050-a940-405b-afeb-d17e3d6d9e50" containerName="registry-server" Jul 07 17:43:46.625871 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:46.625723 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="50795050-a940-405b-afeb-d17e3d6d9e50" containerName="registry-server" Jul 07 17:43:46.625871 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:46.625776 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="50795050-a940-405b-afeb-d17e3d6d9e50" containerName="registry-server" Jul 07 17:43:46.630217 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:46.630199 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw" Jul 07 17:43:46.632149 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:46.632132 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9wqfg\"" Jul 07 17:43:46.636803 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:46.636688 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw"] Jul 07 17:43:46.705609 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:46.705581 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35922e00-8322-4597-96a5-27eeba5c7ebf-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw\" (UID: \"35922e00-8322-4597-96a5-27eeba5c7ebf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw" Jul 07 17:43:46.705737 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:46.705631 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtrd2\" (UniqueName: \"kubernetes.io/projected/35922e00-8322-4597-96a5-27eeba5c7ebf-kube-api-access-qtrd2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw\" (UID: \"35922e00-8322-4597-96a5-27eeba5c7ebf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw" Jul 07 17:43:46.705737 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:46.705696 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35922e00-8322-4597-96a5-27eeba5c7ebf-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw\" (UID: \"35922e00-8322-4597-96a5-27eeba5c7ebf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw" Jul 07 17:43:46.806847 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:46.806825 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35922e00-8322-4597-96a5-27eeba5c7ebf-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw\" (UID: \"35922e00-8322-4597-96a5-27eeba5c7ebf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw" Jul 07 17:43:46.806967 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:46.806859 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtrd2\" (UniqueName: \"kubernetes.io/projected/35922e00-8322-4597-96a5-27eeba5c7ebf-kube-api-access-qtrd2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw\" (UID: \"35922e00-8322-4597-96a5-27eeba5c7ebf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw" Jul 07 17:43:46.806967 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:46.806892 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35922e00-8322-4597-96a5-27eeba5c7ebf-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw\" (UID: \"35922e00-8322-4597-96a5-27eeba5c7ebf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw" Jul 07 17:43:46.807234 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:46.807214 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35922e00-8322-4597-96a5-27eeba5c7ebf-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw\" (UID: \"35922e00-8322-4597-96a5-27eeba5c7ebf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw" Jul 07 17:43:46.807234 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:46.807227 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35922e00-8322-4597-96a5-27eeba5c7ebf-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw\" (UID: \"35922e00-8322-4597-96a5-27eeba5c7ebf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw" Jul 07 17:43:46.817259 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:46.817231 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtrd2\" (UniqueName: \"kubernetes.io/projected/35922e00-8322-4597-96a5-27eeba5c7ebf-kube-api-access-qtrd2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw\" (UID: \"35922e00-8322-4597-96a5-27eeba5c7ebf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw" Jul 07 17:43:46.939572 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:46.939549 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw" Jul 07 17:43:47.041822 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.041783 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg"] Jul 07 17:43:47.046570 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.046548 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg" Jul 07 17:43:47.052143 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.052118 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg"] Jul 07 17:43:47.069902 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.069885 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw"] Jul 07 17:43:47.072059 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:43:47.072041 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35922e00_8322_4597_96a5_27eeba5c7ebf.slice/crio-7bc0a9b3015cc6e0034adb877ae72c5ca2e70d2854370da143b72f4eb7321891 WatchSource:0}: Error finding container 7bc0a9b3015cc6e0034adb877ae72c5ca2e70d2854370da143b72f4eb7321891: Status 404 returned error can't find the container with id 7bc0a9b3015cc6e0034adb877ae72c5ca2e70d2854370da143b72f4eb7321891 Jul 07 17:43:47.109290 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.109269 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg52p\" (UniqueName: \"kubernetes.io/projected/a0b2bb73-ec63-48ee-ad76-2e57118c09d9-kube-api-access-xg52p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg\" (UID: \"a0b2bb73-ec63-48ee-ad76-2e57118c09d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg" Jul 07 17:43:47.109401 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.109311 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0b2bb73-ec63-48ee-ad76-2e57118c09d9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg\" (UID: \"a0b2bb73-ec63-48ee-ad76-2e57118c09d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg" Jul 07 17:43:47.109401 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.109330 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0b2bb73-ec63-48ee-ad76-2e57118c09d9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg\" (UID: \"a0b2bb73-ec63-48ee-ad76-2e57118c09d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg" Jul 07 17:43:47.210607 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.210531 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg52p\" (UniqueName: \"kubernetes.io/projected/a0b2bb73-ec63-48ee-ad76-2e57118c09d9-kube-api-access-xg52p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg\" (UID: \"a0b2bb73-ec63-48ee-ad76-2e57118c09d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg" Jul 07 17:43:47.210720 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.210653 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0b2bb73-ec63-48ee-ad76-2e57118c09d9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg\" (UID: \"a0b2bb73-ec63-48ee-ad76-2e57118c09d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg" Jul 07 17:43:47.210720 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.210672 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0b2bb73-ec63-48ee-ad76-2e57118c09d9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg\" (UID: \"a0b2bb73-ec63-48ee-ad76-2e57118c09d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg" Jul 07 17:43:47.211022 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.211004 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0b2bb73-ec63-48ee-ad76-2e57118c09d9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg\" (UID: \"a0b2bb73-ec63-48ee-ad76-2e57118c09d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg" Jul 07 17:43:47.211074 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.211034 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0b2bb73-ec63-48ee-ad76-2e57118c09d9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg\" (UID: \"a0b2bb73-ec63-48ee-ad76-2e57118c09d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg" Jul 07 17:43:47.218831 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.218806 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg52p\" (UniqueName: \"kubernetes.io/projected/a0b2bb73-ec63-48ee-ad76-2e57118c09d9-kube-api-access-xg52p\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg\" (UID: \"a0b2bb73-ec63-48ee-ad76-2e57118c09d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg" Jul 07 17:43:47.356315 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.356279 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg" Jul 07 17:43:47.448829 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.448797 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s"] Jul 07 17:43:47.453892 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.453871 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s" Jul 07 17:43:47.461648 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.461619 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s"] Jul 07 17:43:47.481041 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.481022 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg"] Jul 07 17:43:47.482931 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:43:47.482905 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0b2bb73_ec63_48ee_ad76_2e57118c09d9.slice/crio-6e38f25bffcd628b54674c6afc318e0e71c2ebcccac59e5b69696944dfcd93b2 WatchSource:0}: Error finding container 6e38f25bffcd628b54674c6afc318e0e71c2ebcccac59e5b69696944dfcd93b2: Status 404 returned error can't find the container with id 6e38f25bffcd628b54674c6afc318e0e71c2ebcccac59e5b69696944dfcd93b2 Jul 07 17:43:47.512852 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.512831 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dddfc486-07b5-4eaa-bebc-e988b0526d84-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s\" (UID: \"dddfc486-07b5-4eaa-bebc-e988b0526d84\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s" Jul 07 17:43:47.512952 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.512893 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dddfc486-07b5-4eaa-bebc-e988b0526d84-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s\" (UID: \"dddfc486-07b5-4eaa-bebc-e988b0526d84\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s" Jul 07 17:43:47.512952 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.512917 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx6dz\" (UniqueName: \"kubernetes.io/projected/dddfc486-07b5-4eaa-bebc-e988b0526d84-kube-api-access-lx6dz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s\" (UID: \"dddfc486-07b5-4eaa-bebc-e988b0526d84\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s" Jul 07 17:43:47.614215 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.614186 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dddfc486-07b5-4eaa-bebc-e988b0526d84-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s\" (UID: \"dddfc486-07b5-4eaa-bebc-e988b0526d84\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s" Jul 07 17:43:47.614350 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.614244 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dddfc486-07b5-4eaa-bebc-e988b0526d84-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s\" (UID: \"dddfc486-07b5-4eaa-bebc-e988b0526d84\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s" Jul 07 17:43:47.614350 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.614263 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx6dz\" (UniqueName: \"kubernetes.io/projected/dddfc486-07b5-4eaa-bebc-e988b0526d84-kube-api-access-lx6dz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s\" (UID: \"dddfc486-07b5-4eaa-bebc-e988b0526d84\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s" Jul 07 17:43:47.614547 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.614529 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dddfc486-07b5-4eaa-bebc-e988b0526d84-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s\" (UID: \"dddfc486-07b5-4eaa-bebc-e988b0526d84\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s" Jul 07 17:43:47.614632 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.614611 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dddfc486-07b5-4eaa-bebc-e988b0526d84-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s\" (UID: \"dddfc486-07b5-4eaa-bebc-e988b0526d84\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s" Jul 07 17:43:47.629228 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.629200 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx6dz\" (UniqueName: \"kubernetes.io/projected/dddfc486-07b5-4eaa-bebc-e988b0526d84-kube-api-access-lx6dz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s\" (UID: \"dddfc486-07b5-4eaa-bebc-e988b0526d84\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s" Jul 07 17:43:47.637841 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.637818 2552 generic.go:356] "Generic (PLEG): container finished" podID="a0b2bb73-ec63-48ee-ad76-2e57118c09d9" containerID="d55b8ade675b8279bc7fe20741e84629d29b6e383f27c513970dacb1de516ac5" exitCode=0 Jul 07 17:43:47.637933 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.637880 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg" event={"ID":"a0b2bb73-ec63-48ee-ad76-2e57118c09d9","Type":"ContainerDied","Data":"d55b8ade675b8279bc7fe20741e84629d29b6e383f27c513970dacb1de516ac5"} Jul 07 17:43:47.637933 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.637930 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg" event={"ID":"a0b2bb73-ec63-48ee-ad76-2e57118c09d9","Type":"ContainerStarted","Data":"6e38f25bffcd628b54674c6afc318e0e71c2ebcccac59e5b69696944dfcd93b2"} Jul 07 17:43:47.639455 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.639438 2552 generic.go:356] "Generic (PLEG): container finished" podID="35922e00-8322-4597-96a5-27eeba5c7ebf" containerID="becb67fc0fac585751827a44b8799ecb0a0342c9076ae4d1b55cd950f7b92925" exitCode=0 Jul 07 17:43:47.639534 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.639463 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw" event={"ID":"35922e00-8322-4597-96a5-27eeba5c7ebf","Type":"ContainerDied","Data":"becb67fc0fac585751827a44b8799ecb0a0342c9076ae4d1b55cd950f7b92925"} Jul 07 17:43:47.639534 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.639492 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw" event={"ID":"35922e00-8322-4597-96a5-27eeba5c7ebf","Type":"ContainerStarted","Data":"7bc0a9b3015cc6e0034adb877ae72c5ca2e70d2854370da143b72f4eb7321891"} Jul 07 17:43:47.763819 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.763741 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s" Jul 07 17:43:47.904445 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:47.904419 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s"] Jul 07 17:43:47.908200 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:43:47.908173 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddddfc486_07b5_4eaa_bebc_e988b0526d84.slice/crio-f1dea04ca22ca0d7ea6df4c837f833048a1e6743dc553b46c3abe6d8d7d2fd52 WatchSource:0}: Error finding container f1dea04ca22ca0d7ea6df4c837f833048a1e6743dc553b46c3abe6d8d7d2fd52: Status 404 returned error can't find the container with id f1dea04ca22ca0d7ea6df4c837f833048a1e6743dc553b46c3abe6d8d7d2fd52 Jul 07 17:43:48.030227 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:48.030179 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk"] Jul 07 17:43:48.033399 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:48.033385 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk" Jul 07 17:43:48.040481 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:48.040458 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk"] Jul 07 17:43:48.118701 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:48.118679 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25a55bb8-f39a-45fe-912f-ab2af4e3f70b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk\" (UID: \"25a55bb8-f39a-45fe-912f-ab2af4e3f70b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk" Jul 07 17:43:48.118807 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:48.118721 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25a55bb8-f39a-45fe-912f-ab2af4e3f70b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk\" (UID: \"25a55bb8-f39a-45fe-912f-ab2af4e3f70b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk" Jul 07 17:43:48.118807 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:48.118746 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdzpn\" (UniqueName: \"kubernetes.io/projected/25a55bb8-f39a-45fe-912f-ab2af4e3f70b-kube-api-access-jdzpn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk\" (UID: \"25a55bb8-f39a-45fe-912f-ab2af4e3f70b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk" Jul 07 17:43:48.219256 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:48.219225 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25a55bb8-f39a-45fe-912f-ab2af4e3f70b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk\" (UID: \"25a55bb8-f39a-45fe-912f-ab2af4e3f70b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk" Jul 07 17:43:48.219473 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:48.219291 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25a55bb8-f39a-45fe-912f-ab2af4e3f70b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk\" (UID: \"25a55bb8-f39a-45fe-912f-ab2af4e3f70b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk" Jul 07 17:43:48.219473 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:48.219351 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdzpn\" (UniqueName: \"kubernetes.io/projected/25a55bb8-f39a-45fe-912f-ab2af4e3f70b-kube-api-access-jdzpn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk\" (UID: \"25a55bb8-f39a-45fe-912f-ab2af4e3f70b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk" Jul 07 17:43:48.219641 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:48.219620 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25a55bb8-f39a-45fe-912f-ab2af4e3f70b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk\" (UID: \"25a55bb8-f39a-45fe-912f-ab2af4e3f70b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk" Jul 07 17:43:48.219959 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:48.219659 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25a55bb8-f39a-45fe-912f-ab2af4e3f70b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk\" (UID: \"25a55bb8-f39a-45fe-912f-ab2af4e3f70b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk" Jul 07 17:43:48.226934 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:48.226916 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdzpn\" (UniqueName: \"kubernetes.io/projected/25a55bb8-f39a-45fe-912f-ab2af4e3f70b-kube-api-access-jdzpn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk\" (UID: \"25a55bb8-f39a-45fe-912f-ab2af4e3f70b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk" Jul 07 17:43:48.365719 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:48.365650 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk" Jul 07 17:43:48.489046 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:48.489015 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk"] Jul 07 17:43:48.524459 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:43:48.524430 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25a55bb8_f39a_45fe_912f_ab2af4e3f70b.slice/crio-e3d83625832764940f92fa5aceb9da90f68928493caab50d4d3a76031c2da570 WatchSource:0}: Error finding container e3d83625832764940f92fa5aceb9da90f68928493caab50d4d3a76031c2da570: Status 404 returned error can't find the container with id e3d83625832764940f92fa5aceb9da90f68928493caab50d4d3a76031c2da570 Jul 07 17:43:48.645138 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:48.645116 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk" event={"ID":"25a55bb8-f39a-45fe-912f-ab2af4e3f70b","Type":"ContainerStarted","Data":"e3d83625832764940f92fa5aceb9da90f68928493caab50d4d3a76031c2da570"} Jul 07 17:43:48.646565 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:48.646536 2552 generic.go:356] "Generic (PLEG): container finished" podID="dddfc486-07b5-4eaa-bebc-e988b0526d84" containerID="f65d06719f98204b4e61181bc1cbb73bae6c0301b4257e760a24977e40c52078" exitCode=0 Jul 07 17:43:48.646652 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:48.646588 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s" event={"ID":"dddfc486-07b5-4eaa-bebc-e988b0526d84","Type":"ContainerDied","Data":"f65d06719f98204b4e61181bc1cbb73bae6c0301b4257e760a24977e40c52078"} Jul 07 17:43:48.646652 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:48.646621 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s" event={"ID":"dddfc486-07b5-4eaa-bebc-e988b0526d84","Type":"ContainerStarted","Data":"f1dea04ca22ca0d7ea6df4c837f833048a1e6743dc553b46c3abe6d8d7d2fd52"} Jul 07 17:43:49.652756 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:49.652731 2552 generic.go:356] "Generic (PLEG): container finished" podID="dddfc486-07b5-4eaa-bebc-e988b0526d84" containerID="c11c563251d0309e740b9c143a4cb3023aed9fe2706e6727681b83844f83e1d3" exitCode=0 Jul 07 17:43:49.653068 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:49.652813 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s" event={"ID":"dddfc486-07b5-4eaa-bebc-e988b0526d84","Type":"ContainerDied","Data":"c11c563251d0309e740b9c143a4cb3023aed9fe2706e6727681b83844f83e1d3"} Jul 07 17:43:49.654569 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:49.654550 2552 generic.go:356] "Generic (PLEG): container finished" podID="a0b2bb73-ec63-48ee-ad76-2e57118c09d9" containerID="c04a6786b8989e128c4149410ee934a46f6f5cbed92e1fb0a187ef9dfb363cb3" exitCode=0 Jul 07 17:43:49.654709 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:49.654638 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg" event={"ID":"a0b2bb73-ec63-48ee-ad76-2e57118c09d9","Type":"ContainerDied","Data":"c04a6786b8989e128c4149410ee934a46f6f5cbed92e1fb0a187ef9dfb363cb3"} Jul 07 17:43:49.656195 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:49.656175 2552 generic.go:356] "Generic (PLEG): container finished" podID="25a55bb8-f39a-45fe-912f-ab2af4e3f70b" containerID="b7ea226fbb4c295313a8e53a1640c3313b37640e3029b402664e8ae2e4fabd84" exitCode=0 Jul 07 17:43:49.656294 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:49.656264 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk" event={"ID":"25a55bb8-f39a-45fe-912f-ab2af4e3f70b","Type":"ContainerDied","Data":"b7ea226fbb4c295313a8e53a1640c3313b37640e3029b402664e8ae2e4fabd84"} Jul 07 17:43:49.658132 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:49.658116 2552 generic.go:356] "Generic (PLEG): container finished" podID="35922e00-8322-4597-96a5-27eeba5c7ebf" containerID="90ef06970e0410061c029ef905401c25aab4c130e71250b25f68fc2bd65ec25b" exitCode=0 Jul 07 17:43:49.658180 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:49.658159 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw" event={"ID":"35922e00-8322-4597-96a5-27eeba5c7ebf","Type":"ContainerDied","Data":"90ef06970e0410061c029ef905401c25aab4c130e71250b25f68fc2bd65ec25b"} Jul 07 17:43:50.664000 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:50.663964 2552 generic.go:356] "Generic (PLEG): container finished" podID="35922e00-8322-4597-96a5-27eeba5c7ebf" containerID="b6c18038180e459285f32565458ece6b2cfb3ead18f269212e00f8687c79d108" exitCode=0 Jul 07 17:43:50.664432 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:50.664062 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw" event={"ID":"35922e00-8322-4597-96a5-27eeba5c7ebf","Type":"ContainerDied","Data":"b6c18038180e459285f32565458ece6b2cfb3ead18f269212e00f8687c79d108"} Jul 07 17:43:50.665938 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:50.665914 2552 generic.go:356] "Generic (PLEG): container finished" podID="dddfc486-07b5-4eaa-bebc-e988b0526d84" containerID="082a10749213f273d93ab54b5aec018e51bad58bbdffa38ce73dd69192b0c2c0" exitCode=0 Jul 07 17:43:50.666060 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:50.665982 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s" event={"ID":"dddfc486-07b5-4eaa-bebc-e988b0526d84","Type":"ContainerDied","Data":"082a10749213f273d93ab54b5aec018e51bad58bbdffa38ce73dd69192b0c2c0"} Jul 07 17:43:50.667957 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:50.667938 2552 generic.go:356] "Generic (PLEG): container finished" podID="a0b2bb73-ec63-48ee-ad76-2e57118c09d9" containerID="9f9d685452d6a9c56a4b1cd84a535eb9b506b6f39c45a414cbc2b731cef39238" exitCode=0 Jul 07 17:43:50.668031 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:50.667959 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg" event={"ID":"a0b2bb73-ec63-48ee-ad76-2e57118c09d9","Type":"ContainerDied","Data":"9f9d685452d6a9c56a4b1cd84a535eb9b506b6f39c45a414cbc2b731cef39238"} Jul 07 17:43:51.674509 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:51.674466 2552 generic.go:356] "Generic (PLEG): container finished" podID="25a55bb8-f39a-45fe-912f-ab2af4e3f70b" containerID="99eb1a8699afe9a5d309a38ebe614982535c8473190941c80e4167be60a72560" exitCode=0 Jul 07 17:43:51.674905 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:51.674533 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk" event={"ID":"25a55bb8-f39a-45fe-912f-ab2af4e3f70b","Type":"ContainerDied","Data":"99eb1a8699afe9a5d309a38ebe614982535c8473190941c80e4167be60a72560"} Jul 07 17:43:51.856479 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:51.856458 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg" Jul 07 17:43:51.865639 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:51.865619 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw" Jul 07 17:43:51.868910 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:51.868895 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s" Jul 07 17:43:51.946743 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:51.946675 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35922e00-8322-4597-96a5-27eeba5c7ebf-util\") pod \"35922e00-8322-4597-96a5-27eeba5c7ebf\" (UID: \"35922e00-8322-4597-96a5-27eeba5c7ebf\") " Jul 07 17:43:51.946743 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:51.946707 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtrd2\" (UniqueName: \"kubernetes.io/projected/35922e00-8322-4597-96a5-27eeba5c7ebf-kube-api-access-qtrd2\") pod \"35922e00-8322-4597-96a5-27eeba5c7ebf\" (UID: \"35922e00-8322-4597-96a5-27eeba5c7ebf\") " Jul 07 17:43:51.946743 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:51.946735 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lx6dz\" (UniqueName: \"kubernetes.io/projected/dddfc486-07b5-4eaa-bebc-e988b0526d84-kube-api-access-lx6dz\") pod \"dddfc486-07b5-4eaa-bebc-e988b0526d84\" (UID: \"dddfc486-07b5-4eaa-bebc-e988b0526d84\") " Jul 07 17:43:51.946965 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:51.946759 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0b2bb73-ec63-48ee-ad76-2e57118c09d9-util\") pod \"a0b2bb73-ec63-48ee-ad76-2e57118c09d9\" (UID: \"a0b2bb73-ec63-48ee-ad76-2e57118c09d9\") " Jul 07 17:43:51.946965 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:51.946784 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dddfc486-07b5-4eaa-bebc-e988b0526d84-bundle\") pod \"dddfc486-07b5-4eaa-bebc-e988b0526d84\" (UID: \"dddfc486-07b5-4eaa-bebc-e988b0526d84\") " Jul 07 17:43:51.946965 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:51.946804 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0b2bb73-ec63-48ee-ad76-2e57118c09d9-bundle\") pod \"a0b2bb73-ec63-48ee-ad76-2e57118c09d9\" (UID: \"a0b2bb73-ec63-48ee-ad76-2e57118c09d9\") " Jul 07 17:43:51.946965 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:51.946832 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dddfc486-07b5-4eaa-bebc-e988b0526d84-util\") pod \"dddfc486-07b5-4eaa-bebc-e988b0526d84\" (UID: \"dddfc486-07b5-4eaa-bebc-e988b0526d84\") " Jul 07 17:43:51.946965 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:51.946852 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xg52p\" (UniqueName: \"kubernetes.io/projected/a0b2bb73-ec63-48ee-ad76-2e57118c09d9-kube-api-access-xg52p\") pod \"a0b2bb73-ec63-48ee-ad76-2e57118c09d9\" (UID: \"a0b2bb73-ec63-48ee-ad76-2e57118c09d9\") " Jul 07 17:43:51.946965 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:51.946883 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35922e00-8322-4597-96a5-27eeba5c7ebf-bundle\") pod \"35922e00-8322-4597-96a5-27eeba5c7ebf\" (UID: \"35922e00-8322-4597-96a5-27eeba5c7ebf\") " Jul 07 17:43:51.947828 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:51.947774 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dddfc486-07b5-4eaa-bebc-e988b0526d84-bundle" (OuterVolumeSpecName: "bundle") pod "dddfc486-07b5-4eaa-bebc-e988b0526d84" (UID: "dddfc486-07b5-4eaa-bebc-e988b0526d84"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:43:51.948188 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:51.948160 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0b2bb73-ec63-48ee-ad76-2e57118c09d9-bundle" (OuterVolumeSpecName: "bundle") pod "a0b2bb73-ec63-48ee-ad76-2e57118c09d9" (UID: "a0b2bb73-ec63-48ee-ad76-2e57118c09d9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:43:51.948278 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:51.948255 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35922e00-8322-4597-96a5-27eeba5c7ebf-bundle" (OuterVolumeSpecName: "bundle") pod "35922e00-8322-4597-96a5-27eeba5c7ebf" (UID: "35922e00-8322-4597-96a5-27eeba5c7ebf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:43:51.949280 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:51.949257 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35922e00-8322-4597-96a5-27eeba5c7ebf-kube-api-access-qtrd2" (OuterVolumeSpecName: "kube-api-access-qtrd2") pod "35922e00-8322-4597-96a5-27eeba5c7ebf" (UID: "35922e00-8322-4597-96a5-27eeba5c7ebf"). InnerVolumeSpecName "kube-api-access-qtrd2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:43:51.949390 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:51.949273 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dddfc486-07b5-4eaa-bebc-e988b0526d84-kube-api-access-lx6dz" (OuterVolumeSpecName: "kube-api-access-lx6dz") pod "dddfc486-07b5-4eaa-bebc-e988b0526d84" (UID: "dddfc486-07b5-4eaa-bebc-e988b0526d84"). InnerVolumeSpecName "kube-api-access-lx6dz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:43:51.949517 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:51.949491 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0b2bb73-ec63-48ee-ad76-2e57118c09d9-kube-api-access-xg52p" (OuterVolumeSpecName: "kube-api-access-xg52p") pod "a0b2bb73-ec63-48ee-ad76-2e57118c09d9" (UID: "a0b2bb73-ec63-48ee-ad76-2e57118c09d9"). InnerVolumeSpecName "kube-api-access-xg52p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:43:51.952772 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:51.952744 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dddfc486-07b5-4eaa-bebc-e988b0526d84-util" (OuterVolumeSpecName: "util") pod "dddfc486-07b5-4eaa-bebc-e988b0526d84" (UID: "dddfc486-07b5-4eaa-bebc-e988b0526d84"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:43:51.955497 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:51.955472 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35922e00-8322-4597-96a5-27eeba5c7ebf-util" (OuterVolumeSpecName: "util") pod "35922e00-8322-4597-96a5-27eeba5c7ebf" (UID: "35922e00-8322-4597-96a5-27eeba5c7ebf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:43:51.956227 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:51.956180 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0b2bb73-ec63-48ee-ad76-2e57118c09d9-util" (OuterVolumeSpecName: "util") pod "a0b2bb73-ec63-48ee-ad76-2e57118c09d9" (UID: "a0b2bb73-ec63-48ee-ad76-2e57118c09d9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:43:52.047847 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:52.047825 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lx6dz\" (UniqueName: \"kubernetes.io/projected/dddfc486-07b5-4eaa-bebc-e988b0526d84-kube-api-access-lx6dz\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:43:52.047847 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:52.047847 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0b2bb73-ec63-48ee-ad76-2e57118c09d9-util\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:43:52.047965 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:52.047864 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dddfc486-07b5-4eaa-bebc-e988b0526d84-bundle\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:43:52.047965 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:52.047873 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0b2bb73-ec63-48ee-ad76-2e57118c09d9-bundle\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:43:52.047965 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:52.047879 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dddfc486-07b5-4eaa-bebc-e988b0526d84-util\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:43:52.047965 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:52.047887 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xg52p\" (UniqueName: \"kubernetes.io/projected/a0b2bb73-ec63-48ee-ad76-2e57118c09d9-kube-api-access-xg52p\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:43:52.047965 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:52.047895 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35922e00-8322-4597-96a5-27eeba5c7ebf-bundle\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:43:52.047965 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:52.047903 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35922e00-8322-4597-96a5-27eeba5c7ebf-util\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:43:52.047965 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:52.047910 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtrd2\" (UniqueName: \"kubernetes.io/projected/35922e00-8322-4597-96a5-27eeba5c7ebf-kube-api-access-qtrd2\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:43:52.681043 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:52.681016 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg" Jul 07 17:43:52.681452 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:52.681046 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg" event={"ID":"a0b2bb73-ec63-48ee-ad76-2e57118c09d9","Type":"ContainerDied","Data":"6e38f25bffcd628b54674c6afc318e0e71c2ebcccac59e5b69696944dfcd93b2"} Jul 07 17:43:52.681452 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:52.681098 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e38f25bffcd628b54674c6afc318e0e71c2ebcccac59e5b69696944dfcd93b2" Jul 07 17:43:52.683419 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:52.683398 2552 generic.go:356] "Generic (PLEG): container finished" podID="25a55bb8-f39a-45fe-912f-ab2af4e3f70b" containerID="5969f5ce3c72054d2de66b7c3f999596ee6ae9022a20a70f8841d014cc05074f" exitCode=0 Jul 07 17:43:52.683529 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:52.683420 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk" event={"ID":"25a55bb8-f39a-45fe-912f-ab2af4e3f70b","Type":"ContainerDied","Data":"5969f5ce3c72054d2de66b7c3f999596ee6ae9022a20a70f8841d014cc05074f"} Jul 07 17:43:52.685105 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:52.685087 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw" Jul 07 17:43:52.685193 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:52.685107 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw" event={"ID":"35922e00-8322-4597-96a5-27eeba5c7ebf","Type":"ContainerDied","Data":"7bc0a9b3015cc6e0034adb877ae72c5ca2e70d2854370da143b72f4eb7321891"} Jul 07 17:43:52.685193 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:52.685139 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7bc0a9b3015cc6e0034adb877ae72c5ca2e70d2854370da143b72f4eb7321891" Jul 07 17:43:52.687126 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:52.687106 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s" event={"ID":"dddfc486-07b5-4eaa-bebc-e988b0526d84","Type":"ContainerDied","Data":"f1dea04ca22ca0d7ea6df4c837f833048a1e6743dc553b46c3abe6d8d7d2fd52"} Jul 07 17:43:52.687210 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:52.687138 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f1dea04ca22ca0d7ea6df4c837f833048a1e6743dc553b46c3abe6d8d7d2fd52" Jul 07 17:43:52.687210 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:52.687150 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s" Jul 07 17:43:53.813281 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:53.813261 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk" Jul 07 17:43:53.859550 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:53.859525 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25a55bb8-f39a-45fe-912f-ab2af4e3f70b-bundle\") pod \"25a55bb8-f39a-45fe-912f-ab2af4e3f70b\" (UID: \"25a55bb8-f39a-45fe-912f-ab2af4e3f70b\") " Jul 07 17:43:53.859675 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:53.859555 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdzpn\" (UniqueName: \"kubernetes.io/projected/25a55bb8-f39a-45fe-912f-ab2af4e3f70b-kube-api-access-jdzpn\") pod \"25a55bb8-f39a-45fe-912f-ab2af4e3f70b\" (UID: \"25a55bb8-f39a-45fe-912f-ab2af4e3f70b\") " Jul 07 17:43:53.859675 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:53.859595 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25a55bb8-f39a-45fe-912f-ab2af4e3f70b-util\") pod \"25a55bb8-f39a-45fe-912f-ab2af4e3f70b\" (UID: \"25a55bb8-f39a-45fe-912f-ab2af4e3f70b\") " Jul 07 17:43:53.859967 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:53.859943 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25a55bb8-f39a-45fe-912f-ab2af4e3f70b-bundle" (OuterVolumeSpecName: "bundle") pod "25a55bb8-f39a-45fe-912f-ab2af4e3f70b" (UID: "25a55bb8-f39a-45fe-912f-ab2af4e3f70b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:43:53.861502 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:53.861474 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25a55bb8-f39a-45fe-912f-ab2af4e3f70b-kube-api-access-jdzpn" (OuterVolumeSpecName: "kube-api-access-jdzpn") pod "25a55bb8-f39a-45fe-912f-ab2af4e3f70b" (UID: "25a55bb8-f39a-45fe-912f-ab2af4e3f70b"). InnerVolumeSpecName "kube-api-access-jdzpn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:43:53.867200 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:53.867177 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25a55bb8-f39a-45fe-912f-ab2af4e3f70b-util" (OuterVolumeSpecName: "util") pod "25a55bb8-f39a-45fe-912f-ab2af4e3f70b" (UID: "25a55bb8-f39a-45fe-912f-ab2af4e3f70b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:43:53.960912 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:53.960838 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25a55bb8-f39a-45fe-912f-ab2af4e3f70b-bundle\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:43:53.960912 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:53.960862 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdzpn\" (UniqueName: \"kubernetes.io/projected/25a55bb8-f39a-45fe-912f-ab2af4e3f70b-kube-api-access-jdzpn\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:43:53.960912 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:53.960872 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25a55bb8-f39a-45fe-912f-ab2af4e3f70b-util\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:43:54.697347 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:54.697324 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk" Jul 07 17:43:54.697498 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:54.697316 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk" event={"ID":"25a55bb8-f39a-45fe-912f-ab2af4e3f70b","Type":"ContainerDied","Data":"e3d83625832764940f92fa5aceb9da90f68928493caab50d4d3a76031c2da570"} Jul 07 17:43:54.697498 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:43:54.697476 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3d83625832764940f92fa5aceb9da90f68928493caab50d4d3a76031c2da570" Jul 07 17:44:03.523038 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.522961 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-57bzf"] Jul 07 17:44:03.523421 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.523214 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0b2bb73-ec63-48ee-ad76-2e57118c09d9" containerName="extract" Jul 07 17:44:03.523421 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.523225 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0b2bb73-ec63-48ee-ad76-2e57118c09d9" containerName="extract" Jul 07 17:44:03.523421 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.523237 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dddfc486-07b5-4eaa-bebc-e988b0526d84" containerName="util" Jul 07 17:44:03.523421 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.523243 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="dddfc486-07b5-4eaa-bebc-e988b0526d84" containerName="util" Jul 07 17:44:03.523421 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.523249 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35922e00-8322-4597-96a5-27eeba5c7ebf" containerName="pull" Jul 07 17:44:03.523421 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.523255 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="35922e00-8322-4597-96a5-27eeba5c7ebf" containerName="pull" Jul 07 17:44:03.523421 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.523264 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35922e00-8322-4597-96a5-27eeba5c7ebf" containerName="util" Jul 07 17:44:03.523421 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.523268 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="35922e00-8322-4597-96a5-27eeba5c7ebf" containerName="util" Jul 07 17:44:03.523421 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.523274 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0b2bb73-ec63-48ee-ad76-2e57118c09d9" containerName="pull" Jul 07 17:44:03.523421 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.523279 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0b2bb73-ec63-48ee-ad76-2e57118c09d9" containerName="pull" Jul 07 17:44:03.523421 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.523285 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25a55bb8-f39a-45fe-912f-ab2af4e3f70b" containerName="pull" Jul 07 17:44:03.523421 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.523289 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="25a55bb8-f39a-45fe-912f-ab2af4e3f70b" containerName="pull" Jul 07 17:44:03.523421 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.523313 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dddfc486-07b5-4eaa-bebc-e988b0526d84" containerName="extract" Jul 07 17:44:03.523421 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.523318 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="dddfc486-07b5-4eaa-bebc-e988b0526d84" containerName="extract" Jul 07 17:44:03.523421 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.523335 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0b2bb73-ec63-48ee-ad76-2e57118c09d9" containerName="util" Jul 07 17:44:03.523421 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.523340 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0b2bb73-ec63-48ee-ad76-2e57118c09d9" containerName="util" Jul 07 17:44:03.523421 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.523345 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25a55bb8-f39a-45fe-912f-ab2af4e3f70b" containerName="util" Jul 07 17:44:03.523421 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.523349 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="25a55bb8-f39a-45fe-912f-ab2af4e3f70b" containerName="util" Jul 07 17:44:03.523421 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.523354 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25a55bb8-f39a-45fe-912f-ab2af4e3f70b" containerName="extract" Jul 07 17:44:03.523421 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.523359 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="25a55bb8-f39a-45fe-912f-ab2af4e3f70b" containerName="extract" Jul 07 17:44:03.523421 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.523366 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35922e00-8322-4597-96a5-27eeba5c7ebf" containerName="extract" Jul 07 17:44:03.523421 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.523371 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="35922e00-8322-4597-96a5-27eeba5c7ebf" containerName="extract" Jul 07 17:44:03.523421 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.523379 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dddfc486-07b5-4eaa-bebc-e988b0526d84" containerName="pull" Jul 07 17:44:03.523421 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.523383 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="dddfc486-07b5-4eaa-bebc-e988b0526d84" containerName="pull" Jul 07 17:44:03.523421 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.523427 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="dddfc486-07b5-4eaa-bebc-e988b0526d84" containerName="extract" Jul 07 17:44:03.523421 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.523438 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="25a55bb8-f39a-45fe-912f-ab2af4e3f70b" containerName="extract" Jul 07 17:44:03.523421 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.523443 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="35922e00-8322-4597-96a5-27eeba5c7ebf" containerName="extract" Jul 07 17:44:03.524514 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.523449 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0b2bb73-ec63-48ee-ad76-2e57118c09d9" containerName="extract" Jul 07 17:44:03.526132 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.526113 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-57bzf" Jul 07 17:44:03.528152 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.528132 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-6lnsc\"" Jul 07 17:44:03.528254 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.528132 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 07 17:44:03.535089 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.535067 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-57bzf"] Jul 07 17:44:03.626979 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.626960 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns8zj\" (UniqueName: \"kubernetes.io/projected/af91963c-c39b-46ff-a6b1-303c6750a224-kube-api-access-ns8zj\") pod \"dns-operator-controller-manager-864dd78c4c-57bzf\" (UID: \"af91963c-c39b-46ff-a6b1-303c6750a224\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-57bzf" Jul 07 17:44:03.727399 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.727375 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns8zj\" (UniqueName: \"kubernetes.io/projected/af91963c-c39b-46ff-a6b1-303c6750a224-kube-api-access-ns8zj\") pod \"dns-operator-controller-manager-864dd78c4c-57bzf\" (UID: \"af91963c-c39b-46ff-a6b1-303c6750a224\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-57bzf" Jul 07 17:44:03.741454 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.741430 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns8zj\" (UniqueName: \"kubernetes.io/projected/af91963c-c39b-46ff-a6b1-303c6750a224-kube-api-access-ns8zj\") pod \"dns-operator-controller-manager-864dd78c4c-57bzf\" (UID: \"af91963c-c39b-46ff-a6b1-303c6750a224\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-57bzf" Jul 07 17:44:03.836401 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.836344 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-57bzf" Jul 07 17:44:03.969137 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:44:03.969113 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf91963c_c39b_46ff_a6b1_303c6750a224.slice/crio-c0d2eb1aec1dd18fcc414f91f980878f37b80b712918b1db105c6abd0ada1514 WatchSource:0}: Error finding container c0d2eb1aec1dd18fcc414f91f980878f37b80b712918b1db105c6abd0ada1514: Status 404 returned error can't find the container with id c0d2eb1aec1dd18fcc414f91f980878f37b80b712918b1db105c6abd0ada1514 Jul 07 17:44:03.972155 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:03.972133 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-57bzf"] Jul 07 17:44:04.743364 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:04.743332 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-57bzf" event={"ID":"af91963c-c39b-46ff-a6b1-303c6750a224","Type":"ContainerStarted","Data":"c0d2eb1aec1dd18fcc414f91f980878f37b80b712918b1db105c6abd0ada1514"} Jul 07 17:44:06.755147 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:06.755115 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-57bzf" event={"ID":"af91963c-c39b-46ff-a6b1-303c6750a224","Type":"ContainerStarted","Data":"6483c3a0aeb69b7dddb9261f39062f111d607cebef4606b21aaf2c42a2632afe"} Jul 07 17:44:06.755542 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:06.755253 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-57bzf" Jul 07 17:44:06.774053 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:06.774014 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-57bzf" podStartSLOduration=1.653245986 podStartE2EDuration="3.774001968s" totalImagesPullingTime="2.120755982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:44:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:44:06.772005339 +0000 UTC m=+447.354012096" watchObservedRunningTime="2026-07-07 17:44:06.774001968 +0000 UTC m=+447.356008712" Jul 07 17:44:08.396164 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:08.396130 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz"] Jul 07 17:44:08.402446 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:08.402427 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz" Jul 07 17:44:08.404590 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:08.404571 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8wt5d\"" Jul 07 17:44:08.408664 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:08.408645 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz"] Jul 07 17:44:08.467262 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:08.467237 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b756faf-b2f7-4f10-aa95-5115d8446606-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-msvfz\" (UID: \"5b756faf-b2f7-4f10-aa95-5115d8446606\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz" Jul 07 17:44:08.467379 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:08.467308 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlsb7\" (UniqueName: \"kubernetes.io/projected/5b756faf-b2f7-4f10-aa95-5115d8446606-kube-api-access-mlsb7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-msvfz\" (UID: \"5b756faf-b2f7-4f10-aa95-5115d8446606\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz" Jul 07 17:44:08.568209 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:08.568185 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b756faf-b2f7-4f10-aa95-5115d8446606-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-msvfz\" (UID: \"5b756faf-b2f7-4f10-aa95-5115d8446606\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz" Jul 07 17:44:08.568332 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:08.568242 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlsb7\" (UniqueName: \"kubernetes.io/projected/5b756faf-b2f7-4f10-aa95-5115d8446606-kube-api-access-mlsb7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-msvfz\" (UID: \"5b756faf-b2f7-4f10-aa95-5115d8446606\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz" Jul 07 17:44:08.568570 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:08.568554 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b756faf-b2f7-4f10-aa95-5115d8446606-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-msvfz\" (UID: \"5b756faf-b2f7-4f10-aa95-5115d8446606\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz" Jul 07 17:44:08.579602 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:08.579572 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlsb7\" (UniqueName: \"kubernetes.io/projected/5b756faf-b2f7-4f10-aa95-5115d8446606-kube-api-access-mlsb7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-msvfz\" (UID: \"5b756faf-b2f7-4f10-aa95-5115d8446606\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz" Jul 07 17:44:08.713612 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:08.713555 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz" Jul 07 17:44:08.843220 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:08.843199 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz"] Jul 07 17:44:08.845668 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:44:08.845643 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b756faf_b2f7_4f10_aa95_5115d8446606.slice/crio-cfe13f4933f0b24ee92b265e0cadd4e9042539b6d0c1e0a157d80cdc354b1989 WatchSource:0}: Error finding container cfe13f4933f0b24ee92b265e0cadd4e9042539b6d0c1e0a157d80cdc354b1989: Status 404 returned error can't find the container with id cfe13f4933f0b24ee92b265e0cadd4e9042539b6d0c1e0a157d80cdc354b1989 Jul 07 17:44:09.773470 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:09.773435 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz" event={"ID":"5b756faf-b2f7-4f10-aa95-5115d8446606","Type":"ContainerStarted","Data":"cfe13f4933f0b24ee92b265e0cadd4e9042539b6d0c1e0a157d80cdc354b1989"} Jul 07 17:44:12.281918 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:12.281892 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7rzfw"] Jul 07 17:44:12.285338 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:12.285322 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7rzfw" Jul 07 17:44:12.287534 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:12.287507 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-ds4pf\"" Jul 07 17:44:12.296832 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:12.296812 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7rzfw"] Jul 07 17:44:12.397188 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:12.397165 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6q9g\" (UniqueName: \"kubernetes.io/projected/6b72a839-4b63-49f3-bfdb-127b9fb67581-kube-api-access-x6q9g\") pod \"authorino-operator-75cc8d5cb7-7rzfw\" (UID: \"6b72a839-4b63-49f3-bfdb-127b9fb67581\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7rzfw" Jul 07 17:44:12.497856 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:12.497826 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6q9g\" (UniqueName: \"kubernetes.io/projected/6b72a839-4b63-49f3-bfdb-127b9fb67581-kube-api-access-x6q9g\") pod \"authorino-operator-75cc8d5cb7-7rzfw\" (UID: \"6b72a839-4b63-49f3-bfdb-127b9fb67581\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7rzfw" Jul 07 17:44:12.507135 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:12.507105 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6q9g\" (UniqueName: \"kubernetes.io/projected/6b72a839-4b63-49f3-bfdb-127b9fb67581-kube-api-access-x6q9g\") pod \"authorino-operator-75cc8d5cb7-7rzfw\" (UID: \"6b72a839-4b63-49f3-bfdb-127b9fb67581\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7rzfw" Jul 07 17:44:12.597780 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:12.597710 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7rzfw" Jul 07 17:44:12.743701 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:12.743681 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7rzfw"] Jul 07 17:44:12.745580 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:44:12.745547 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b72a839_4b63_49f3_bfdb_127b9fb67581.slice/crio-17b08be5e4812f42fb2454693ad018665686bcdd6387a81b2fa3e9cc4de32852 WatchSource:0}: Error finding container 17b08be5e4812f42fb2454693ad018665686bcdd6387a81b2fa3e9cc4de32852: Status 404 returned error can't find the container with id 17b08be5e4812f42fb2454693ad018665686bcdd6387a81b2fa3e9cc4de32852 Jul 07 17:44:12.787897 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:12.787869 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7rzfw" event={"ID":"6b72a839-4b63-49f3-bfdb-127b9fb67581","Type":"ContainerStarted","Data":"17b08be5e4812f42fb2454693ad018665686bcdd6387a81b2fa3e9cc4de32852"} Jul 07 17:44:15.309701 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:15.309628 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gqgf"] Jul 07 17:44:15.313002 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:15.312973 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gqgf" Jul 07 17:44:15.323699 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:15.323675 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-pdqk8\"" Jul 07 17:44:15.332388 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:15.332370 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gqgf"] Jul 07 17:44:15.424646 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:15.424614 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvc4g\" (UniqueName: \"kubernetes.io/projected/6c86029a-1498-4154-9bdd-e33d670ddec8-kube-api-access-dvc4g\") pod \"limitador-operator-controller-manager-859d7b78bd-2gqgf\" (UID: \"6c86029a-1498-4154-9bdd-e33d670ddec8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gqgf" Jul 07 17:44:15.525849 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:15.525816 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvc4g\" (UniqueName: \"kubernetes.io/projected/6c86029a-1498-4154-9bdd-e33d670ddec8-kube-api-access-dvc4g\") pod \"limitador-operator-controller-manager-859d7b78bd-2gqgf\" (UID: \"6c86029a-1498-4154-9bdd-e33d670ddec8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gqgf" Jul 07 17:44:15.533721 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:15.533699 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvc4g\" (UniqueName: \"kubernetes.io/projected/6c86029a-1498-4154-9bdd-e33d670ddec8-kube-api-access-dvc4g\") pod \"limitador-operator-controller-manager-859d7b78bd-2gqgf\" (UID: \"6c86029a-1498-4154-9bdd-e33d670ddec8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gqgf" Jul 07 17:44:15.624032 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:15.623978 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gqgf" Jul 07 17:44:15.766507 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:15.766487 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gqgf"] Jul 07 17:44:15.805659 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:15.805626 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7rzfw" event={"ID":"6b72a839-4b63-49f3-bfdb-127b9fb67581","Type":"ContainerStarted","Data":"4315b0220a44630512d2ce07b3bdfb08e0877f394b3cb3906c80f5ef34de27d4"} Jul 07 17:44:15.805793 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:15.805715 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7rzfw" Jul 07 17:44:15.821880 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:15.821793 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7rzfw" podStartSLOduration=1.539170542 podStartE2EDuration="3.821777554s" totalImagesPullingTime="2.282607012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:44:15.821765626 +0000 UTC m=+456.403772372" watchObservedRunningTime="2026-07-07 17:44:15.821777554 +0000 UTC m=+456.403784300" Jul 07 17:44:16.816694 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:44:16.816663 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c86029a_1498_4154_9bdd_e33d670ddec8.slice/crio-ddff07f58c98f09918032f566204bc27891102415456fef144260c3766b9a726 WatchSource:0}: Error finding container ddff07f58c98f09918032f566204bc27891102415456fef144260c3766b9a726: Status 404 returned error can't find the container with id ddff07f58c98f09918032f566204bc27891102415456fef144260c3766b9a726 Jul 07 17:44:17.760823 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:17.760799 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-57bzf" Jul 07 17:44:17.818162 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:17.818090 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz" event={"ID":"5b756faf-b2f7-4f10-aa95-5115d8446606","Type":"ContainerStarted","Data":"a9951e6b0cb0b2f31dcefb2aba690f548508a1da8ccb1f71102cac88779bb836"} Jul 07 17:44:17.818637 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:17.818221 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz" Jul 07 17:44:17.819398 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:17.819377 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gqgf" event={"ID":"6c86029a-1498-4154-9bdd-e33d670ddec8","Type":"ContainerStarted","Data":"ddff07f58c98f09918032f566204bc27891102415456fef144260c3766b9a726"} Jul 07 17:44:17.836262 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:17.836216 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz" podStartSLOduration=1.811199556 podStartE2EDuration="9.836203842s" totalImagesPullingTime="8.025004286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:44:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:44:17.834140822 +0000 UTC m=+458.416147568" watchObservedRunningTime="2026-07-07 17:44:17.836203842 +0000 UTC m=+458.418210643" Jul 07 17:44:18.830168 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:18.830132 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gqgf" event={"ID":"6c86029a-1498-4154-9bdd-e33d670ddec8","Type":"ContainerStarted","Data":"08a09a2c454b77f3355fa47dca929d97395a48bbadcaeb422528a6fae62e28d7"} Jul 07 17:44:18.830570 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:18.830407 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gqgf" Jul 07 17:44:18.845843 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:18.845797 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gqgf" podStartSLOduration=1.963981125 podStartE2EDuration="3.845783205s" totalImagesPullingTime="1.88180208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:44:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:44:18.844873995 +0000 UTC m=+459.426880751" watchObservedRunningTime="2026-07-07 17:44:18.845783205 +0000 UTC m=+459.427789949" Jul 07 17:44:19.736435 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:19.736406 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jbmpj"] Jul 07 17:44:19.739702 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:19.739681 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jbmpj" Jul 07 17:44:19.741681 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:19.741648 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 07 17:44:19.741781 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:19.741698 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 07 17:44:19.741781 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:19.741740 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9wqfg\"" Jul 07 17:44:19.748257 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:19.748238 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jbmpj"] Jul 07 17:44:19.864448 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:19.864387 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e934b6ee-aa8a-4e21-9d85-7a9c85330ee8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jbmpj\" (UID: \"e934b6ee-aa8a-4e21-9d85-7a9c85330ee8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jbmpj" Jul 07 17:44:19.864448 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:19.864412 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e934b6ee-aa8a-4e21-9d85-7a9c85330ee8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jbmpj\" (UID: \"e934b6ee-aa8a-4e21-9d85-7a9c85330ee8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jbmpj" Jul 07 17:44:19.864448 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:19.864444 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsk47\" (UniqueName: \"kubernetes.io/projected/e934b6ee-aa8a-4e21-9d85-7a9c85330ee8-kube-api-access-jsk47\") pod \"kuadrant-console-plugin-66b5774985-jbmpj\" (UID: \"e934b6ee-aa8a-4e21-9d85-7a9c85330ee8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jbmpj" Jul 07 17:44:19.965002 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:19.964981 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e934b6ee-aa8a-4e21-9d85-7a9c85330ee8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jbmpj\" (UID: \"e934b6ee-aa8a-4e21-9d85-7a9c85330ee8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jbmpj" Jul 07 17:44:19.965113 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:19.965008 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e934b6ee-aa8a-4e21-9d85-7a9c85330ee8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jbmpj\" (UID: \"e934b6ee-aa8a-4e21-9d85-7a9c85330ee8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jbmpj" Jul 07 17:44:19.965113 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:19.965030 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsk47\" (UniqueName: \"kubernetes.io/projected/e934b6ee-aa8a-4e21-9d85-7a9c85330ee8-kube-api-access-jsk47\") pod \"kuadrant-console-plugin-66b5774985-jbmpj\" (UID: \"e934b6ee-aa8a-4e21-9d85-7a9c85330ee8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jbmpj" Jul 07 17:44:19.965773 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:19.965747 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e934b6ee-aa8a-4e21-9d85-7a9c85330ee8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jbmpj\" (UID: \"e934b6ee-aa8a-4e21-9d85-7a9c85330ee8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jbmpj" Jul 07 17:44:19.967359 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:19.967339 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e934b6ee-aa8a-4e21-9d85-7a9c85330ee8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jbmpj\" (UID: \"e934b6ee-aa8a-4e21-9d85-7a9c85330ee8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jbmpj" Jul 07 17:44:19.972073 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:19.972052 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsk47\" (UniqueName: \"kubernetes.io/projected/e934b6ee-aa8a-4e21-9d85-7a9c85330ee8-kube-api-access-jsk47\") pod \"kuadrant-console-plugin-66b5774985-jbmpj\" (UID: \"e934b6ee-aa8a-4e21-9d85-7a9c85330ee8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jbmpj" Jul 07 17:44:20.048488 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:20.048460 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jbmpj" Jul 07 17:44:20.172338 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:20.172314 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jbmpj"] Jul 07 17:44:20.173986 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:44:20.173962 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode934b6ee_aa8a_4e21_9d85_7a9c85330ee8.slice/crio-706a5891994a08b159b75d15fec9d21692a031e3ea4abf2baf8304a857ee6d27 WatchSource:0}: Error finding container 706a5891994a08b159b75d15fec9d21692a031e3ea4abf2baf8304a857ee6d27: Status 404 returned error can't find the container with id 706a5891994a08b159b75d15fec9d21692a031e3ea4abf2baf8304a857ee6d27 Jul 07 17:44:20.845097 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:20.845068 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jbmpj" event={"ID":"e934b6ee-aa8a-4e21-9d85-7a9c85330ee8","Type":"ContainerStarted","Data":"706a5891994a08b159b75d15fec9d21692a031e3ea4abf2baf8304a857ee6d27"} Jul 07 17:44:26.814227 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:26.814200 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7rzfw" Jul 07 17:44:28.832525 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:28.832492 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz" Jul 07 17:44:29.840673 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:29.840646 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gqgf" Jul 07 17:44:30.563756 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.563728 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz"] Jul 07 17:44:30.564124 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.563935 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz" podUID="5b756faf-b2f7-4f10-aa95-5115d8446606" containerName="manager" containerID="cri-o://a9951e6b0cb0b2f31dcefb2aba690f548508a1da8ccb1f71102cac88779bb836" gracePeriod=2 Jul 07 17:44:30.580108 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.580083 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz"] Jul 07 17:44:30.591188 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:44:30.591158 2552 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"5b756faf-b2f7-4f10-aa95-5115d8446606\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-msvfz\": pods \"kuadrant-operator-controller-manager-8684c9ff49-msvfz\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz" Jul 07 17:44:30.598018 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.597972 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btc5j"] Jul 07 17:44:30.598402 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.598377 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b756faf-b2f7-4f10-aa95-5115d8446606" containerName="manager" Jul 07 17:44:30.598402 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.598401 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b756faf-b2f7-4f10-aa95-5115d8446606" containerName="manager" Jul 07 17:44:30.598548 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.598519 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b756faf-b2f7-4f10-aa95-5115d8446606" containerName="manager" Jul 07 17:44:30.601701 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.601683 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gqgf"] Jul 07 17:44:30.601944 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.601856 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gqgf" podUID="6c86029a-1498-4154-9bdd-e33d670ddec8" containerName="manager" containerID="cri-o://08a09a2c454b77f3355fa47dca929d97395a48bbadcaeb422528a6fae62e28d7" gracePeriod=2 Jul 07 17:44:30.602076 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.602052 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btc5j" Jul 07 17:44:30.604342 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:44:30.604204 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-msvfz\" is forbidden: User \"system:node:ip-10-0-131-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-96.ec2.internal' and this object" podUID="5b756faf-b2f7-4f10-aa95-5115d8446606" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz" Jul 07 17:44:30.606494 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.606472 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gqgf"] Jul 07 17:44:30.608147 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:44:30.608047 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2gqgf\" is forbidden: User \"system:node:ip-10-0-131-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-96.ec2.internal' and this object" podUID="6c86029a-1498-4154-9bdd-e33d670ddec8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gqgf" Jul 07 17:44:30.610413 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:44:30.610376 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-msvfz\" is forbidden: User \"system:node:ip-10-0-131-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-96.ec2.internal' and this object" podUID="5b756faf-b2f7-4f10-aa95-5115d8446606" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz" Jul 07 17:44:30.612604 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:44:30.612443 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2gqgf\" is forbidden: User \"system:node:ip-10-0-131-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-96.ec2.internal' and this object" podUID="6c86029a-1498-4154-9bdd-e33d670ddec8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gqgf" Jul 07 17:44:30.617377 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.617323 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btc5j"] Jul 07 17:44:30.622502 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.622482 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fts2n"] Jul 07 17:44:30.622869 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.622853 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c86029a-1498-4154-9bdd-e33d670ddec8" containerName="manager" Jul 07 17:44:30.622991 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.622973 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c86029a-1498-4154-9bdd-e33d670ddec8" containerName="manager" Jul 07 17:44:30.623094 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.623081 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c86029a-1498-4154-9bdd-e33d670ddec8" containerName="manager" Jul 07 17:44:30.626068 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.626052 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fts2n" Jul 07 17:44:30.641801 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.641771 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fts2n"] Jul 07 17:44:30.644156 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:44:30.644093 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-msvfz\" is forbidden: User \"system:node:ip-10-0-131-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-96.ec2.internal' and this object" podUID="5b756faf-b2f7-4f10-aa95-5115d8446606" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz" Jul 07 17:44:30.646740 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:44:30.646633 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2gqgf\" is forbidden: User \"system:node:ip-10-0-131-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-96.ec2.internal' and this object" podUID="6c86029a-1498-4154-9bdd-e33d670ddec8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gqgf" Jul 07 17:44:30.750393 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.750356 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr6tq\" (UniqueName: \"kubernetes.io/projected/61af0df5-7e27-44f1-8bdc-b0289e186ea7-kube-api-access-nr6tq\") pod \"limitador-operator-controller-manager-859d7b78bd-fts2n\" (UID: \"61af0df5-7e27-44f1-8bdc-b0289e186ea7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fts2n" Jul 07 17:44:30.750558 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.750444 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnghs\" (UniqueName: \"kubernetes.io/projected/d830a787-8012-4f7e-a3ba-b48bb209c4a8-kube-api-access-nnghs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-btc5j\" (UID: \"d830a787-8012-4f7e-a3ba-b48bb209c4a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btc5j" Jul 07 17:44:30.750558 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.750481 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d830a787-8012-4f7e-a3ba-b48bb209c4a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-btc5j\" (UID: \"d830a787-8012-4f7e-a3ba-b48bb209c4a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btc5j" Jul 07 17:44:30.851589 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.851536 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnghs\" (UniqueName: \"kubernetes.io/projected/d830a787-8012-4f7e-a3ba-b48bb209c4a8-kube-api-access-nnghs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-btc5j\" (UID: \"d830a787-8012-4f7e-a3ba-b48bb209c4a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btc5j" Jul 07 17:44:30.851589 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.851583 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d830a787-8012-4f7e-a3ba-b48bb209c4a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-btc5j\" (UID: \"d830a787-8012-4f7e-a3ba-b48bb209c4a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btc5j" Jul 07 17:44:30.852700 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.851661 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr6tq\" (UniqueName: \"kubernetes.io/projected/61af0df5-7e27-44f1-8bdc-b0289e186ea7-kube-api-access-nr6tq\") pod \"limitador-operator-controller-manager-859d7b78bd-fts2n\" (UID: \"61af0df5-7e27-44f1-8bdc-b0289e186ea7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fts2n" Jul 07 17:44:30.852700 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.852220 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d830a787-8012-4f7e-a3ba-b48bb209c4a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-btc5j\" (UID: \"d830a787-8012-4f7e-a3ba-b48bb209c4a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btc5j" Jul 07 17:44:30.860000 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.859950 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr6tq\" (UniqueName: \"kubernetes.io/projected/61af0df5-7e27-44f1-8bdc-b0289e186ea7-kube-api-access-nr6tq\") pod \"limitador-operator-controller-manager-859d7b78bd-fts2n\" (UID: \"61af0df5-7e27-44f1-8bdc-b0289e186ea7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fts2n" Jul 07 17:44:30.860113 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.860085 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnghs\" (UniqueName: \"kubernetes.io/projected/d830a787-8012-4f7e-a3ba-b48bb209c4a8-kube-api-access-nnghs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-btc5j\" (UID: \"d830a787-8012-4f7e-a3ba-b48bb209c4a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btc5j" Jul 07 17:44:30.863288 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.863267 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz" Jul 07 17:44:30.865326 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:44:30.865184 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-msvfz\" is forbidden: User \"system:node:ip-10-0-131-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-96.ec2.internal' and this object" podUID="5b756faf-b2f7-4f10-aa95-5115d8446606" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz" Jul 07 17:44:30.866819 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:44:30.866790 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2gqgf\" is forbidden: User \"system:node:ip-10-0-131-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-96.ec2.internal' and this object" podUID="6c86029a-1498-4154-9bdd-e33d670ddec8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gqgf" Jul 07 17:44:30.874403 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.874382 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gqgf" Jul 07 17:44:30.876057 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:44:30.876030 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-msvfz\" is forbidden: User \"system:node:ip-10-0-131-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-96.ec2.internal' and this object" podUID="5b756faf-b2f7-4f10-aa95-5115d8446606" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz" Jul 07 17:44:30.877562 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:44:30.877536 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2gqgf\" is forbidden: User \"system:node:ip-10-0-131-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-96.ec2.internal' and this object" podUID="6c86029a-1498-4154-9bdd-e33d670ddec8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gqgf" Jul 07 17:44:30.904566 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.904537 2552 generic.go:356] "Generic (PLEG): container finished" podID="5b756faf-b2f7-4f10-aa95-5115d8446606" containerID="a9951e6b0cb0b2f31dcefb2aba690f548508a1da8ccb1f71102cac88779bb836" exitCode=0 Jul 07 17:44:30.904643 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.904581 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz" Jul 07 17:44:30.904689 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.904640 2552 scope.go:117] "RemoveContainer" containerID="a9951e6b0cb0b2f31dcefb2aba690f548508a1da8ccb1f71102cac88779bb836" Jul 07 17:44:30.906090 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.906071 2552 generic.go:356] "Generic (PLEG): container finished" podID="6c86029a-1498-4154-9bdd-e33d670ddec8" containerID="08a09a2c454b77f3355fa47dca929d97395a48bbadcaeb422528a6fae62e28d7" exitCode=0 Jul 07 17:44:30.906166 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.906107 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gqgf" Jul 07 17:44:30.906499 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:44:30.906477 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-msvfz\" is forbidden: User \"system:node:ip-10-0-131-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-96.ec2.internal' and this object" podUID="5b756faf-b2f7-4f10-aa95-5115d8446606" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz" Jul 07 17:44:30.908067 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:44:30.908048 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2gqgf\" is forbidden: User \"system:node:ip-10-0-131-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-96.ec2.internal' and this object" podUID="6c86029a-1498-4154-9bdd-e33d670ddec8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gqgf" Jul 07 17:44:30.909585 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:44:30.909555 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-msvfz\" is forbidden: User \"system:node:ip-10-0-131-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-96.ec2.internal' and this object" podUID="5b756faf-b2f7-4f10-aa95-5115d8446606" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz" Jul 07 17:44:30.911027 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:44:30.911008 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2gqgf\" is forbidden: User \"system:node:ip-10-0-131-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-96.ec2.internal' and this object" podUID="6c86029a-1498-4154-9bdd-e33d670ddec8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gqgf" Jul 07 17:44:30.913268 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.913253 2552 scope.go:117] "RemoveContainer" containerID="a9951e6b0cb0b2f31dcefb2aba690f548508a1da8ccb1f71102cac88779bb836" Jul 07 17:44:30.913515 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:44:30.913491 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9951e6b0cb0b2f31dcefb2aba690f548508a1da8ccb1f71102cac88779bb836\": container with ID starting with a9951e6b0cb0b2f31dcefb2aba690f548508a1da8ccb1f71102cac88779bb836 not found: ID does not exist" containerID="a9951e6b0cb0b2f31dcefb2aba690f548508a1da8ccb1f71102cac88779bb836" Jul 07 17:44:30.913600 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.913519 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9951e6b0cb0b2f31dcefb2aba690f548508a1da8ccb1f71102cac88779bb836"} err="failed to get container status \"a9951e6b0cb0b2f31dcefb2aba690f548508a1da8ccb1f71102cac88779bb836\": rpc error: code = NotFound desc = could not find container \"a9951e6b0cb0b2f31dcefb2aba690f548508a1da8ccb1f71102cac88779bb836\": container with ID starting with a9951e6b0cb0b2f31dcefb2aba690f548508a1da8ccb1f71102cac88779bb836 not found: ID does not exist" Jul 07 17:44:30.913600 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.913533 2552 scope.go:117] "RemoveContainer" containerID="08a09a2c454b77f3355fa47dca929d97395a48bbadcaeb422528a6fae62e28d7" Jul 07 17:44:30.921105 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.921091 2552 scope.go:117] "RemoveContainer" containerID="08a09a2c454b77f3355fa47dca929d97395a48bbadcaeb422528a6fae62e28d7" Jul 07 17:44:30.921355 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:44:30.921340 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08a09a2c454b77f3355fa47dca929d97395a48bbadcaeb422528a6fae62e28d7\": container with ID starting with 08a09a2c454b77f3355fa47dca929d97395a48bbadcaeb422528a6fae62e28d7 not found: ID does not exist" containerID="08a09a2c454b77f3355fa47dca929d97395a48bbadcaeb422528a6fae62e28d7" Jul 07 17:44:30.921406 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.921360 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08a09a2c454b77f3355fa47dca929d97395a48bbadcaeb422528a6fae62e28d7"} err="failed to get container status \"08a09a2c454b77f3355fa47dca929d97395a48bbadcaeb422528a6fae62e28d7\": rpc error: code = NotFound desc = could not find container \"08a09a2c454b77f3355fa47dca929d97395a48bbadcaeb422528a6fae62e28d7\": container with ID starting with 08a09a2c454b77f3355fa47dca929d97395a48bbadcaeb422528a6fae62e28d7 not found: ID does not exist" Jul 07 17:44:30.952637 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.952616 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvc4g\" (UniqueName: \"kubernetes.io/projected/6c86029a-1498-4154-9bdd-e33d670ddec8-kube-api-access-dvc4g\") pod \"6c86029a-1498-4154-9bdd-e33d670ddec8\" (UID: \"6c86029a-1498-4154-9bdd-e33d670ddec8\") " Jul 07 17:44:30.952746 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.952686 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b756faf-b2f7-4f10-aa95-5115d8446606-extensions-socket-volume\") pod \"5b756faf-b2f7-4f10-aa95-5115d8446606\" (UID: \"5b756faf-b2f7-4f10-aa95-5115d8446606\") " Jul 07 17:44:30.952806 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.952754 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlsb7\" (UniqueName: \"kubernetes.io/projected/5b756faf-b2f7-4f10-aa95-5115d8446606-kube-api-access-mlsb7\") pod \"5b756faf-b2f7-4f10-aa95-5115d8446606\" (UID: \"5b756faf-b2f7-4f10-aa95-5115d8446606\") " Jul 07 17:44:30.953209 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.953183 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b756faf-b2f7-4f10-aa95-5115d8446606-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5b756faf-b2f7-4f10-aa95-5115d8446606" (UID: "5b756faf-b2f7-4f10-aa95-5115d8446606"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:44:30.954751 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.954726 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c86029a-1498-4154-9bdd-e33d670ddec8-kube-api-access-dvc4g" (OuterVolumeSpecName: "kube-api-access-dvc4g") pod "6c86029a-1498-4154-9bdd-e33d670ddec8" (UID: "6c86029a-1498-4154-9bdd-e33d670ddec8"). InnerVolumeSpecName "kube-api-access-dvc4g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:44:30.954850 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:30.954825 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b756faf-b2f7-4f10-aa95-5115d8446606-kube-api-access-mlsb7" (OuterVolumeSpecName: "kube-api-access-mlsb7") pod "5b756faf-b2f7-4f10-aa95-5115d8446606" (UID: "5b756faf-b2f7-4f10-aa95-5115d8446606"). InnerVolumeSpecName "kube-api-access-mlsb7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:44:31.001561 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:31.001531 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btc5j" Jul 07 17:44:31.006923 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:31.006901 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fts2n" Jul 07 17:44:31.053438 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:31.053408 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlsb7\" (UniqueName: \"kubernetes.io/projected/5b756faf-b2f7-4f10-aa95-5115d8446606-kube-api-access-mlsb7\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:44:31.053438 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:31.053435 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvc4g\" (UniqueName: \"kubernetes.io/projected/6c86029a-1498-4154-9bdd-e33d670ddec8-kube-api-access-dvc4g\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:44:31.053438 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:31.053445 2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b756faf-b2f7-4f10-aa95-5115d8446606-extensions-socket-volume\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:44:31.156003 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:31.155982 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btc5j"] Jul 07 17:44:31.158916 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:44:31.158889 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd830a787_8012_4f7e_a3ba_b48bb209c4a8.slice/crio-3b599dba5c557c69bd09ec1a96994cac3e32b1c94ab2613c3675e90fbc759915 WatchSource:0}: Error finding container 3b599dba5c557c69bd09ec1a96994cac3e32b1c94ab2613c3675e90fbc759915: Status 404 returned error can't find the container with id 3b599dba5c557c69bd09ec1a96994cac3e32b1c94ab2613c3675e90fbc759915 Jul 07 17:44:31.178548 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:31.178486 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fts2n"] Jul 07 17:44:31.180382 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:44:31.180356 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61af0df5_7e27_44f1_8bdc_b0289e186ea7.slice/crio-c6b174d65f586baf8c2b1747955b326acb7e60ec108a43ad4aa864e0afbb7471 WatchSource:0}: Error finding container c6b174d65f586baf8c2b1747955b326acb7e60ec108a43ad4aa864e0afbb7471: Status 404 returned error can't find the container with id c6b174d65f586baf8c2b1747955b326acb7e60ec108a43ad4aa864e0afbb7471 Jul 07 17:44:31.220048 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:44:31.220001 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-msvfz\" is forbidden: User \"system:node:ip-10-0-131-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-96.ec2.internal' and this object" podUID="5b756faf-b2f7-4f10-aa95-5115d8446606" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz" Jul 07 17:44:31.221625 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:44:31.221590 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2gqgf\" is forbidden: User \"system:node:ip-10-0-131-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-96.ec2.internal' and this object" podUID="6c86029a-1498-4154-9bdd-e33d670ddec8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gqgf" Jul 07 17:44:31.223109 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:44:31.223048 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-msvfz\" is forbidden: User \"system:node:ip-10-0-131-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-96.ec2.internal' and this object" podUID="5b756faf-b2f7-4f10-aa95-5115d8446606" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz" Jul 07 17:44:31.224610 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:44:31.224582 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2gqgf\" is forbidden: User \"system:node:ip-10-0-131-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-96.ec2.internal' and this object" podUID="6c86029a-1498-4154-9bdd-e33d670ddec8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gqgf" Jul 07 17:44:31.914681 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:31.914507 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btc5j" event={"ID":"d830a787-8012-4f7e-a3ba-b48bb209c4a8","Type":"ContainerStarted","Data":"0247b8ebab9cdb3ec0bc23d62dab1e972b378b6992dbfe5bc76375d49384a084"} Jul 07 17:44:31.914681 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:31.914567 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btc5j" event={"ID":"d830a787-8012-4f7e-a3ba-b48bb209c4a8","Type":"ContainerStarted","Data":"3b599dba5c557c69bd09ec1a96994cac3e32b1c94ab2613c3675e90fbc759915"} Jul 07 17:44:31.914681 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:31.914638 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btc5j" Jul 07 17:44:31.916235 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:44:31.916200 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-msvfz\" is forbidden: User \"system:node:ip-10-0-131-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-96.ec2.internal' and this object" podUID="5b756faf-b2f7-4f10-aa95-5115d8446606" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz" Jul 07 17:44:31.917430 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:31.917407 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fts2n" event={"ID":"61af0df5-7e27-44f1-8bdc-b0289e186ea7","Type":"ContainerStarted","Data":"3252a0919a2c53c1ab9b6a1ffc612901b207b5fe67b10c9ffdb4b479a1919a53"} Jul 07 17:44:31.917562 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:31.917449 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fts2n" event={"ID":"61af0df5-7e27-44f1-8bdc-b0289e186ea7","Type":"ContainerStarted","Data":"c6b174d65f586baf8c2b1747955b326acb7e60ec108a43ad4aa864e0afbb7471"} Jul 07 17:44:31.917562 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:31.917503 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fts2n" Jul 07 17:44:31.917924 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:44:31.917894 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2gqgf\" is forbidden: User \"system:node:ip-10-0-131-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-96.ec2.internal' and this object" podUID="6c86029a-1498-4154-9bdd-e33d670ddec8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gqgf" Jul 07 17:44:31.939758 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:31.939721 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btc5j" podStartSLOduration=1.939707956 podStartE2EDuration="1.939707956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:44:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:44:31.938615584 +0000 UTC m=+472.520622339" watchObservedRunningTime="2026-07-07 17:44:31.939707956 +0000 UTC m=+472.521714700" Jul 07 17:44:31.958657 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:31.958622 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fts2n" podStartSLOduration=1.95861148 podStartE2EDuration="1.95861148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:44:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:44:31.957103783 +0000 UTC m=+472.539110526" watchObservedRunningTime="2026-07-07 17:44:31.95861148 +0000 UTC m=+472.540618224" Jul 07 17:44:31.958861 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:44:31.958836 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-msvfz\" is forbidden: User \"system:node:ip-10-0-131-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-96.ec2.internal' and this object" podUID="5b756faf-b2f7-4f10-aa95-5115d8446606" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-msvfz" Jul 07 17:44:31.960368 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:44:31.960337 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2gqgf\" is forbidden: User \"system:node:ip-10-0-131-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-96.ec2.internal' and this object" podUID="6c86029a-1498-4154-9bdd-e33d670ddec8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gqgf" Jul 07 17:44:31.974792 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:31.974769 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b756faf-b2f7-4f10-aa95-5115d8446606" path="/var/lib/kubelet/pods/5b756faf-b2f7-4f10-aa95-5115d8446606/volumes" Jul 07 17:44:31.975355 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:31.975336 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c86029a-1498-4154-9bdd-e33d670ddec8" path="/var/lib/kubelet/pods/6c86029a-1498-4154-9bdd-e33d670ddec8/volumes" Jul 07 17:44:42.927537 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:42.927504 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btc5j" Jul 07 17:44:42.928077 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:42.927582 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fts2n" Jul 07 17:44:45.999600 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:45.999562 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jbmpj" event={"ID":"e934b6ee-aa8a-4e21-9d85-7a9c85330ee8","Type":"ContainerStarted","Data":"ab3f660f8a4ffe41188727ce1411ca6cb66b832dfc38b81e49c4b81bcb523ab0"} Jul 07 17:44:46.017228 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:46.017187 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jbmpj" podStartSLOduration=2.049027483 podStartE2EDuration="27.017173007s" totalImagesPullingTime="24.968145524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:44:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:44:46.014697797 +0000 UTC m=+486.596704538" watchObservedRunningTime="2026-07-07 17:44:46.017173007 +0000 UTC m=+486.599179751" Jul 07 17:44:47.806715 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:47.806684 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btc5j"] Jul 07 17:44:47.807153 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:47.806910 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btc5j" podUID="d830a787-8012-4f7e-a3ba-b48bb209c4a8" containerName="manager" containerID="cri-o://0247b8ebab9cdb3ec0bc23d62dab1e972b378b6992dbfe5bc76375d49384a084" gracePeriod=10 Jul 07 17:44:48.758034 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:48.758012 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btc5j" Jul 07 17:44:48.897928 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:48.897910 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d830a787-8012-4f7e-a3ba-b48bb209c4a8-extensions-socket-volume\") pod \"d830a787-8012-4f7e-a3ba-b48bb209c4a8\" (UID: \"d830a787-8012-4f7e-a3ba-b48bb209c4a8\") " Jul 07 17:44:48.898361 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:48.897965 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnghs\" (UniqueName: \"kubernetes.io/projected/d830a787-8012-4f7e-a3ba-b48bb209c4a8-kube-api-access-nnghs\") pod \"d830a787-8012-4f7e-a3ba-b48bb209c4a8\" (UID: \"d830a787-8012-4f7e-a3ba-b48bb209c4a8\") " Jul 07 17:44:48.898361 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:48.898337 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d830a787-8012-4f7e-a3ba-b48bb209c4a8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d830a787-8012-4f7e-a3ba-b48bb209c4a8" (UID: "d830a787-8012-4f7e-a3ba-b48bb209c4a8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:44:48.899898 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:48.899862 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d830a787-8012-4f7e-a3ba-b48bb209c4a8-kube-api-access-nnghs" (OuterVolumeSpecName: "kube-api-access-nnghs") pod "d830a787-8012-4f7e-a3ba-b48bb209c4a8" (UID: "d830a787-8012-4f7e-a3ba-b48bb209c4a8"). InnerVolumeSpecName "kube-api-access-nnghs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:44:48.999109 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:48.999083 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnghs\" (UniqueName: \"kubernetes.io/projected/d830a787-8012-4f7e-a3ba-b48bb209c4a8-kube-api-access-nnghs\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:44:48.999109 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:48.999108 2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d830a787-8012-4f7e-a3ba-b48bb209c4a8-extensions-socket-volume\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:44:49.017551 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:49.017520 2552 generic.go:356] "Generic (PLEG): container finished" podID="d830a787-8012-4f7e-a3ba-b48bb209c4a8" containerID="0247b8ebab9cdb3ec0bc23d62dab1e972b378b6992dbfe5bc76375d49384a084" exitCode=0 Jul 07 17:44:49.017654 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:49.017567 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btc5j" Jul 07 17:44:49.017654 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:49.017607 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btc5j" event={"ID":"d830a787-8012-4f7e-a3ba-b48bb209c4a8","Type":"ContainerDied","Data":"0247b8ebab9cdb3ec0bc23d62dab1e972b378b6992dbfe5bc76375d49384a084"} Jul 07 17:44:49.017654 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:49.017649 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btc5j" event={"ID":"d830a787-8012-4f7e-a3ba-b48bb209c4a8","Type":"ContainerDied","Data":"3b599dba5c557c69bd09ec1a96994cac3e32b1c94ab2613c3675e90fbc759915"} Jul 07 17:44:49.017805 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:49.017669 2552 scope.go:117] "RemoveContainer" containerID="0247b8ebab9cdb3ec0bc23d62dab1e972b378b6992dbfe5bc76375d49384a084" Jul 07 17:44:49.026114 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:49.026099 2552 scope.go:117] "RemoveContainer" containerID="0247b8ebab9cdb3ec0bc23d62dab1e972b378b6992dbfe5bc76375d49384a084" Jul 07 17:44:49.026347 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:44:49.026330 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0247b8ebab9cdb3ec0bc23d62dab1e972b378b6992dbfe5bc76375d49384a084\": container with ID starting with 0247b8ebab9cdb3ec0bc23d62dab1e972b378b6992dbfe5bc76375d49384a084 not found: ID does not exist" containerID="0247b8ebab9cdb3ec0bc23d62dab1e972b378b6992dbfe5bc76375d49384a084" Jul 07 17:44:49.026400 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:49.026355 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0247b8ebab9cdb3ec0bc23d62dab1e972b378b6992dbfe5bc76375d49384a084"} err="failed to get container status \"0247b8ebab9cdb3ec0bc23d62dab1e972b378b6992dbfe5bc76375d49384a084\": rpc error: code = NotFound desc = could not find container \"0247b8ebab9cdb3ec0bc23d62dab1e972b378b6992dbfe5bc76375d49384a084\": container with ID starting with 0247b8ebab9cdb3ec0bc23d62dab1e972b378b6992dbfe5bc76375d49384a084 not found: ID does not exist" Jul 07 17:44:49.036738 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:49.036716 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btc5j"] Jul 07 17:44:49.042572 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:49.042555 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-btc5j"] Jul 07 17:44:49.971440 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:44:49.971410 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d830a787-8012-4f7e-a3ba-b48bb209c4a8" path="/var/lib/kubelet/pods/d830a787-8012-4f7e-a3ba-b48bb209c4a8/volumes" Jul 07 17:45:04.100961 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.100927 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4"] Jul 07 17:45:04.101421 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.101362 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d830a787-8012-4f7e-a3ba-b48bb209c4a8" containerName="manager" Jul 07 17:45:04.101421 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.101379 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="d830a787-8012-4f7e-a3ba-b48bb209c4a8" containerName="manager" Jul 07 17:45:04.101535 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.101469 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="d830a787-8012-4f7e-a3ba-b48bb209c4a8" containerName="manager" Jul 07 17:45:04.120675 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.120647 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4"] Jul 07 17:45:04.120817 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.120750 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:04.122890 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.122870 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 17:45:04.122978 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.122870 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-q8wmg\"" Jul 07 17:45:04.209729 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.209696 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6595f65c-fac9-40d6-b133-7a78ea5c225b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hscv4\" (UID: \"6595f65c-fac9-40d6-b133-7a78ea5c225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:04.209901 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.209739 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6595f65c-fac9-40d6-b133-7a78ea5c225b-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hscv4\" (UID: \"6595f65c-fac9-40d6-b133-7a78ea5c225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:04.209901 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.209781 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6595f65c-fac9-40d6-b133-7a78ea5c225b-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hscv4\" (UID: \"6595f65c-fac9-40d6-b133-7a78ea5c225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:04.209901 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.209802 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6595f65c-fac9-40d6-b133-7a78ea5c225b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hscv4\" (UID: \"6595f65c-fac9-40d6-b133-7a78ea5c225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:04.209901 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.209845 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6595f65c-fac9-40d6-b133-7a78ea5c225b-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hscv4\" (UID: \"6595f65c-fac9-40d6-b133-7a78ea5c225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:04.209901 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.209869 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6595f65c-fac9-40d6-b133-7a78ea5c225b-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hscv4\" (UID: \"6595f65c-fac9-40d6-b133-7a78ea5c225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:04.209901 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.209900 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6595f65c-fac9-40d6-b133-7a78ea5c225b-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hscv4\" (UID: \"6595f65c-fac9-40d6-b133-7a78ea5c225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:04.210158 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.209991 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22fsg\" (UniqueName: \"kubernetes.io/projected/6595f65c-fac9-40d6-b133-7a78ea5c225b-kube-api-access-22fsg\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hscv4\" (UID: \"6595f65c-fac9-40d6-b133-7a78ea5c225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:04.210158 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.210019 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6595f65c-fac9-40d6-b133-7a78ea5c225b-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hscv4\" (UID: \"6595f65c-fac9-40d6-b133-7a78ea5c225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:04.310725 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.310698 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6595f65c-fac9-40d6-b133-7a78ea5c225b-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hscv4\" (UID: \"6595f65c-fac9-40d6-b133-7a78ea5c225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:04.310871 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.310734 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22fsg\" (UniqueName: \"kubernetes.io/projected/6595f65c-fac9-40d6-b133-7a78ea5c225b-kube-api-access-22fsg\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hscv4\" (UID: \"6595f65c-fac9-40d6-b133-7a78ea5c225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:04.310871 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.310753 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6595f65c-fac9-40d6-b133-7a78ea5c225b-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hscv4\" (UID: \"6595f65c-fac9-40d6-b133-7a78ea5c225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:04.310871 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.310781 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6595f65c-fac9-40d6-b133-7a78ea5c225b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hscv4\" (UID: \"6595f65c-fac9-40d6-b133-7a78ea5c225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:04.311041 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.310889 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6595f65c-fac9-40d6-b133-7a78ea5c225b-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hscv4\" (UID: \"6595f65c-fac9-40d6-b133-7a78ea5c225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:04.311041 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.310954 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6595f65c-fac9-40d6-b133-7a78ea5c225b-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hscv4\" (UID: \"6595f65c-fac9-40d6-b133-7a78ea5c225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:04.311041 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.310979 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6595f65c-fac9-40d6-b133-7a78ea5c225b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hscv4\" (UID: \"6595f65c-fac9-40d6-b133-7a78ea5c225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:04.311041 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.311017 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6595f65c-fac9-40d6-b133-7a78ea5c225b-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hscv4\" (UID: \"6595f65c-fac9-40d6-b133-7a78ea5c225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:04.311263 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.311041 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6595f65c-fac9-40d6-b133-7a78ea5c225b-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hscv4\" (UID: \"6595f65c-fac9-40d6-b133-7a78ea5c225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:04.311263 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.311110 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6595f65c-fac9-40d6-b133-7a78ea5c225b-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hscv4\" (UID: \"6595f65c-fac9-40d6-b133-7a78ea5c225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:04.311263 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.311232 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6595f65c-fac9-40d6-b133-7a78ea5c225b-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hscv4\" (UID: \"6595f65c-fac9-40d6-b133-7a78ea5c225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:04.311435 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.311288 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6595f65c-fac9-40d6-b133-7a78ea5c225b-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hscv4\" (UID: \"6595f65c-fac9-40d6-b133-7a78ea5c225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:04.311435 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.311409 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6595f65c-fac9-40d6-b133-7a78ea5c225b-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hscv4\" (UID: \"6595f65c-fac9-40d6-b133-7a78ea5c225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:04.311532 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.311478 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6595f65c-fac9-40d6-b133-7a78ea5c225b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hscv4\" (UID: \"6595f65c-fac9-40d6-b133-7a78ea5c225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:04.313263 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.313241 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6595f65c-fac9-40d6-b133-7a78ea5c225b-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hscv4\" (UID: \"6595f65c-fac9-40d6-b133-7a78ea5c225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:04.313381 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.313358 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6595f65c-fac9-40d6-b133-7a78ea5c225b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hscv4\" (UID: \"6595f65c-fac9-40d6-b133-7a78ea5c225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:04.320285 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.320266 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6595f65c-fac9-40d6-b133-7a78ea5c225b-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hscv4\" (UID: \"6595f65c-fac9-40d6-b133-7a78ea5c225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:04.320578 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.320559 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22fsg\" (UniqueName: \"kubernetes.io/projected/6595f65c-fac9-40d6-b133-7a78ea5c225b-kube-api-access-22fsg\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hscv4\" (UID: \"6595f65c-fac9-40d6-b133-7a78ea5c225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:04.431461 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.431438 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:04.583379 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:04.583356 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4"] Jul 07 17:45:04.584971 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:45:04.584941 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6595f65c_fac9_40d6_b133_7a78ea5c225b.slice/crio-0319be0f72783b24686e31cc824320ab693d5d34f88b4133f1cb1e956f9d479d WatchSource:0}: Error finding container 0319be0f72783b24686e31cc824320ab693d5d34f88b4133f1cb1e956f9d479d: Status 404 returned error can't find the container with id 0319be0f72783b24686e31cc824320ab693d5d34f88b4133f1cb1e956f9d479d Jul 07 17:45:05.094359 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:05.094321 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" event={"ID":"6595f65c-fac9-40d6-b133-7a78ea5c225b","Type":"ContainerStarted","Data":"0319be0f72783b24686e31cc824320ab693d5d34f88b4133f1cb1e956f9d479d"} Jul 07 17:45:08.295078 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:08.295039 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 17:45:08.295370 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:08.295117 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 17:45:08.295370 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:08.295147 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 17:45:09.117488 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:09.117456 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" event={"ID":"6595f65c-fac9-40d6-b133-7a78ea5c225b","Type":"ContainerStarted","Data":"e32d6509ec3702fa11331bfba251edeeb2b987fc29c0e836d0fbcf904b8da35e"} Jul 07 17:45:09.136221 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:09.136175 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" podStartSLOduration=1.428256205 podStartE2EDuration="5.136162345s" totalImagesPullingTime="3.70790614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:45:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:45:09.134576278 +0000 UTC m=+509.716583022" watchObservedRunningTime="2026-07-07 17:45:09.136162345 +0000 UTC m=+509.718169086" Jul 07 17:45:09.431803 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:09.431772 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:09.436468 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:09.436445 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:10.122150 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:10.122114 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:10.122992 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:10.122970 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:45:10.138576 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:10.138551 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2fjvq"] Jul 07 17:45:10.302148 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:10.302114 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2fjvq"] Jul 07 17:45:10.302345 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:10.302163 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2fjvq"] Jul 07 17:45:10.302345 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:10.302186 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:45:10.302345 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:10.302223 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2fjvq" Jul 07 17:45:10.304443 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:10.304423 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 07 17:45:10.319742 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:10.319721 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:45:10.319846 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:10.319801 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-z79ww" Jul 07 17:45:10.323109 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:10.323090 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:45:10.350016 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:10.349980 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnvwd\" (UniqueName: \"kubernetes.io/projected/1df336c1-3b59-46b4-88f3-2a7fc066cc76-kube-api-access-wnvwd\") pod \"limitador-limitador-54d6d988d5-z79ww\" (UID: \"1df336c1-3b59-46b4-88f3-2a7fc066cc76\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z79ww" Jul 07 17:45:10.350273 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:10.350231 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1df336c1-3b59-46b4-88f3-2a7fc066cc76-config-file\") pod \"limitador-limitador-54d6d988d5-z79ww\" (UID: \"1df336c1-3b59-46b4-88f3-2a7fc066cc76\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z79ww" Jul 07 17:45:10.450964 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:10.450935 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnvwd\" (UniqueName: \"kubernetes.io/projected/1df336c1-3b59-46b4-88f3-2a7fc066cc76-kube-api-access-wnvwd\") pod \"limitador-limitador-54d6d988d5-z79ww\" (UID: \"1df336c1-3b59-46b4-88f3-2a7fc066cc76\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z79ww" Jul 07 17:45:10.451385 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:10.450998 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/884f9df7-0142-4b61-a7a2-3cd3bd6fbcff-config-file\") pod \"limitador-limitador-64c94fd64f-2fjvq\" (UID: \"884f9df7-0142-4b61-a7a2-3cd3bd6fbcff\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2fjvq" Jul 07 17:45:10.451385 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:10.451031 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1df336c1-3b59-46b4-88f3-2a7fc066cc76-config-file\") pod \"limitador-limitador-54d6d988d5-z79ww\" (UID: \"1df336c1-3b59-46b4-88f3-2a7fc066cc76\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z79ww" Jul 07 17:45:10.451385 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:10.451050 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxkzh\" (UniqueName: \"kubernetes.io/projected/884f9df7-0142-4b61-a7a2-3cd3bd6fbcff-kube-api-access-bxkzh\") pod \"limitador-limitador-64c94fd64f-2fjvq\" (UID: \"884f9df7-0142-4b61-a7a2-3cd3bd6fbcff\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2fjvq" Jul 07 17:45:10.451784 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:10.451766 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1df336c1-3b59-46b4-88f3-2a7fc066cc76-config-file\") pod \"limitador-limitador-54d6d988d5-z79ww\" (UID: \"1df336c1-3b59-46b4-88f3-2a7fc066cc76\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z79ww" Jul 07 17:45:10.458338 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:10.458319 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnvwd\" (UniqueName: \"kubernetes.io/projected/1df336c1-3b59-46b4-88f3-2a7fc066cc76-kube-api-access-wnvwd\") pod \"limitador-limitador-54d6d988d5-z79ww\" (UID: \"1df336c1-3b59-46b4-88f3-2a7fc066cc76\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z79ww" Jul 07 17:45:10.552125 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:10.552090 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/884f9df7-0142-4b61-a7a2-3cd3bd6fbcff-config-file\") pod \"limitador-limitador-64c94fd64f-2fjvq\" (UID: \"884f9df7-0142-4b61-a7a2-3cd3bd6fbcff\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2fjvq" Jul 07 17:45:10.552275 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:10.552169 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxkzh\" (UniqueName: \"kubernetes.io/projected/884f9df7-0142-4b61-a7a2-3cd3bd6fbcff-kube-api-access-bxkzh\") pod \"limitador-limitador-64c94fd64f-2fjvq\" (UID: \"884f9df7-0142-4b61-a7a2-3cd3bd6fbcff\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2fjvq" Jul 07 17:45:10.552995 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:10.552970 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/884f9df7-0142-4b61-a7a2-3cd3bd6fbcff-config-file\") pod \"limitador-limitador-64c94fd64f-2fjvq\" (UID: \"884f9df7-0142-4b61-a7a2-3cd3bd6fbcff\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2fjvq" Jul 07 17:45:10.559596 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:10.559566 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxkzh\" (UniqueName: \"kubernetes.io/projected/884f9df7-0142-4b61-a7a2-3cd3bd6fbcff-kube-api-access-bxkzh\") pod \"limitador-limitador-64c94fd64f-2fjvq\" (UID: \"884f9df7-0142-4b61-a7a2-3cd3bd6fbcff\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2fjvq" Jul 07 17:45:10.613408 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:10.613379 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2fjvq" Jul 07 17:45:10.629602 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:10.629581 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-z79ww" Jul 07 17:45:10.768507 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:10.768485 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2fjvq"] Jul 07 17:45:10.770581 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:45:10.770555 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod884f9df7_0142_4b61_a7a2_3cd3bd6fbcff.slice/crio-17a75178e01945c8f34f75532defeaaa99f85445f0f0cc9033e6be31a3506869 WatchSource:0}: Error finding container 17a75178e01945c8f34f75532defeaaa99f85445f0f0cc9033e6be31a3506869: Status 404 returned error can't find the container with id 17a75178e01945c8f34f75532defeaaa99f85445f0f0cc9033e6be31a3506869 Jul 07 17:45:10.781685 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:10.781664 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:45:10.783153 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:45:10.783134 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1df336c1_3b59_46b4_88f3_2a7fc066cc76.slice/crio-f80b40e3af19da380971ebf00fce8029053a119e305018dd12e082e0a24fd0a0 WatchSource:0}: Error finding container f80b40e3af19da380971ebf00fce8029053a119e305018dd12e082e0a24fd0a0: Status 404 returned error can't find the container with id f80b40e3af19da380971ebf00fce8029053a119e305018dd12e082e0a24fd0a0 Jul 07 17:45:11.134704 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:11.134666 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2fjvq" event={"ID":"884f9df7-0142-4b61-a7a2-3cd3bd6fbcff","Type":"ContainerStarted","Data":"17a75178e01945c8f34f75532defeaaa99f85445f0f0cc9033e6be31a3506869"} Jul 07 17:45:11.136270 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:11.136239 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-z79ww" event={"ID":"1df336c1-3b59-46b4-88f3-2a7fc066cc76","Type":"ContainerStarted","Data":"f80b40e3af19da380971ebf00fce8029053a119e305018dd12e082e0a24fd0a0"} Jul 07 17:45:15.162435 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:15.162398 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2fjvq" event={"ID":"884f9df7-0142-4b61-a7a2-3cd3bd6fbcff","Type":"ContainerStarted","Data":"3a59389ee89678a8c55d61a89fab4469a39ba4f99c33b99e33855cc84918c8f3"} Jul 07 17:45:15.162826 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:15.162540 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-2fjvq" Jul 07 17:45:15.163907 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:15.163884 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-z79ww" event={"ID":"1df336c1-3b59-46b4-88f3-2a7fc066cc76","Type":"ContainerStarted","Data":"b8367fbde97ec081051e5fb015b9268441f27abd9f6d7eaf01c0fad7b9be2197"} Jul 07 17:45:15.164009 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:15.164001 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-z79ww" Jul 07 17:45:15.180507 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:15.180461 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-2fjvq" podStartSLOduration=0.897205976 podStartE2EDuration="5.180444965s" totalImagesPullingTime="4.283238989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:45:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:45:15.177788084 +0000 UTC m=+515.759794830" watchObservedRunningTime="2026-07-07 17:45:15.180444965 +0000 UTC m=+515.762451709" Jul 07 17:45:15.192843 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:15.192796 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-z79ww" podStartSLOduration=0.928528684 podStartE2EDuration="5.192783095s" totalImagesPullingTime="4.264254411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:45:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:45:15.191713941 +0000 UTC m=+515.773720706" watchObservedRunningTime="2026-07-07 17:45:15.192783095 +0000 UTC m=+515.774789854" Jul 07 17:45:26.169436 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:26.169405 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-2fjvq" Jul 07 17:45:26.169829 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:26.169469 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-z79ww" Jul 07 17:45:26.224261 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:26.224234 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2fjvq"] Jul 07 17:45:26.224412 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:26.224384 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-2fjvq" podUID="884f9df7-0142-4b61-a7a2-3cd3bd6fbcff" containerName="limitador" containerID="cri-o://3a59389ee89678a8c55d61a89fab4469a39ba4f99c33b99e33855cc84918c8f3" gracePeriod=30 Jul 07 17:45:27.159183 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:27.159162 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2fjvq" Jul 07 17:45:27.190873 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:27.190846 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/884f9df7-0142-4b61-a7a2-3cd3bd6fbcff-config-file\") pod \"884f9df7-0142-4b61-a7a2-3cd3bd6fbcff\" (UID: \"884f9df7-0142-4b61-a7a2-3cd3bd6fbcff\") " Jul 07 17:45:27.191228 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:27.190903 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxkzh\" (UniqueName: \"kubernetes.io/projected/884f9df7-0142-4b61-a7a2-3cd3bd6fbcff-kube-api-access-bxkzh\") pod \"884f9df7-0142-4b61-a7a2-3cd3bd6fbcff\" (UID: \"884f9df7-0142-4b61-a7a2-3cd3bd6fbcff\") " Jul 07 17:45:27.191271 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:27.191245 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/884f9df7-0142-4b61-a7a2-3cd3bd6fbcff-config-file" (OuterVolumeSpecName: "config-file") pod "884f9df7-0142-4b61-a7a2-3cd3bd6fbcff" (UID: "884f9df7-0142-4b61-a7a2-3cd3bd6fbcff"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 17:45:27.192850 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:27.192823 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/884f9df7-0142-4b61-a7a2-3cd3bd6fbcff-kube-api-access-bxkzh" (OuterVolumeSpecName: "kube-api-access-bxkzh") pod "884f9df7-0142-4b61-a7a2-3cd3bd6fbcff" (UID: "884f9df7-0142-4b61-a7a2-3cd3bd6fbcff"). InnerVolumeSpecName "kube-api-access-bxkzh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:45:27.223557 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:27.223526 2552 generic.go:356] "Generic (PLEG): container finished" podID="884f9df7-0142-4b61-a7a2-3cd3bd6fbcff" containerID="3a59389ee89678a8c55d61a89fab4469a39ba4f99c33b99e33855cc84918c8f3" exitCode=0 Jul 07 17:45:27.223557 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:27.223549 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2fjvq" Jul 07 17:45:27.223721 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:27.223591 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2fjvq" event={"ID":"884f9df7-0142-4b61-a7a2-3cd3bd6fbcff","Type":"ContainerDied","Data":"3a59389ee89678a8c55d61a89fab4469a39ba4f99c33b99e33855cc84918c8f3"} Jul 07 17:45:27.223721 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:27.223639 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2fjvq" event={"ID":"884f9df7-0142-4b61-a7a2-3cd3bd6fbcff","Type":"ContainerDied","Data":"17a75178e01945c8f34f75532defeaaa99f85445f0f0cc9033e6be31a3506869"} Jul 07 17:45:27.223721 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:27.223662 2552 scope.go:117] "RemoveContainer" containerID="3a59389ee89678a8c55d61a89fab4469a39ba4f99c33b99e33855cc84918c8f3" Jul 07 17:45:27.233495 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:27.233244 2552 scope.go:117] "RemoveContainer" containerID="3a59389ee89678a8c55d61a89fab4469a39ba4f99c33b99e33855cc84918c8f3" Jul 07 17:45:27.233566 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:45:27.233502 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a59389ee89678a8c55d61a89fab4469a39ba4f99c33b99e33855cc84918c8f3\": container with ID starting with 3a59389ee89678a8c55d61a89fab4469a39ba4f99c33b99e33855cc84918c8f3 not found: ID does not exist" containerID="3a59389ee89678a8c55d61a89fab4469a39ba4f99c33b99e33855cc84918c8f3" Jul 07 17:45:27.233566 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:27.233525 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a59389ee89678a8c55d61a89fab4469a39ba4f99c33b99e33855cc84918c8f3"} err="failed to get container status \"3a59389ee89678a8c55d61a89fab4469a39ba4f99c33b99e33855cc84918c8f3\": rpc error: code = NotFound desc = could not find container \"3a59389ee89678a8c55d61a89fab4469a39ba4f99c33b99e33855cc84918c8f3\": container with ID starting with 3a59389ee89678a8c55d61a89fab4469a39ba4f99c33b99e33855cc84918c8f3 not found: ID does not exist" Jul 07 17:45:27.245252 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:27.245214 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2fjvq"] Jul 07 17:45:27.249751 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:27.249735 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2fjvq"] Jul 07 17:45:27.292376 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:27.292323 2552 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/884f9df7-0142-4b61-a7a2-3cd3bd6fbcff-config-file\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:45:27.292376 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:27.292342 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxkzh\" (UniqueName: \"kubernetes.io/projected/884f9df7-0142-4b61-a7a2-3cd3bd6fbcff-kube-api-access-bxkzh\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:45:27.972382 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:27.972349 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="884f9df7-0142-4b61-a7a2-3cd3bd6fbcff" path="/var/lib/kubelet/pods/884f9df7-0142-4b61-a7a2-3cd3bd6fbcff/volumes" Jul 07 17:45:31.950945 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:31.950860 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-542hq"] Jul 07 17:45:31.951400 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:31.951164 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="884f9df7-0142-4b61-a7a2-3cd3bd6fbcff" containerName="limitador" Jul 07 17:45:31.951400 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:31.951174 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="884f9df7-0142-4b61-a7a2-3cd3bd6fbcff" containerName="limitador" Jul 07 17:45:31.951400 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:31.951249 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="884f9df7-0142-4b61-a7a2-3cd3bd6fbcff" containerName="limitador" Jul 07 17:45:31.955424 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:31.955402 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-542hq" Jul 07 17:45:31.957405 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:31.957385 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 07 17:45:31.957551 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:31.957535 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zjhhm\"" Jul 07 17:45:31.962363 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:31.962344 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-542hq"] Jul 07 17:45:32.026458 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:32.026429 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sn2k\" (UniqueName: \"kubernetes.io/projected/149beda9-6d40-46f3-9ec1-04c9053173cb-kube-api-access-9sn2k\") pod \"postgres-69fb4594cf-542hq\" (UID: \"149beda9-6d40-46f3-9ec1-04c9053173cb\") " pod="opendatahub/postgres-69fb4594cf-542hq" Jul 07 17:45:32.026606 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:32.026536 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/149beda9-6d40-46f3-9ec1-04c9053173cb-data\") pod \"postgres-69fb4594cf-542hq\" (UID: \"149beda9-6d40-46f3-9ec1-04c9053173cb\") " pod="opendatahub/postgres-69fb4594cf-542hq" Jul 07 17:45:32.127427 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:32.127403 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/149beda9-6d40-46f3-9ec1-04c9053173cb-data\") pod \"postgres-69fb4594cf-542hq\" (UID: \"149beda9-6d40-46f3-9ec1-04c9053173cb\") " pod="opendatahub/postgres-69fb4594cf-542hq" Jul 07 17:45:32.127559 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:32.127453 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sn2k\" (UniqueName: \"kubernetes.io/projected/149beda9-6d40-46f3-9ec1-04c9053173cb-kube-api-access-9sn2k\") pod \"postgres-69fb4594cf-542hq\" (UID: \"149beda9-6d40-46f3-9ec1-04c9053173cb\") " pod="opendatahub/postgres-69fb4594cf-542hq" Jul 07 17:45:32.127748 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:32.127731 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/149beda9-6d40-46f3-9ec1-04c9053173cb-data\") pod \"postgres-69fb4594cf-542hq\" (UID: \"149beda9-6d40-46f3-9ec1-04c9053173cb\") " pod="opendatahub/postgres-69fb4594cf-542hq" Jul 07 17:45:32.134389 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:32.134372 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sn2k\" (UniqueName: \"kubernetes.io/projected/149beda9-6d40-46f3-9ec1-04c9053173cb-kube-api-access-9sn2k\") pod \"postgres-69fb4594cf-542hq\" (UID: \"149beda9-6d40-46f3-9ec1-04c9053173cb\") " pod="opendatahub/postgres-69fb4594cf-542hq" Jul 07 17:45:32.271863 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:32.271795 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-542hq" Jul 07 17:45:32.398293 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:32.398257 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-542hq"] Jul 07 17:45:32.400558 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:45:32.400529 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod149beda9_6d40_46f3_9ec1_04c9053173cb.slice/crio-a85925a78927cf5f3ed94cddec193a07fd27df966e9d74f2a5d613583ef4800f WatchSource:0}: Error finding container a85925a78927cf5f3ed94cddec193a07fd27df966e9d74f2a5d613583ef4800f: Status 404 returned error can't find the container with id a85925a78927cf5f3ed94cddec193a07fd27df966e9d74f2a5d613583ef4800f Jul 07 17:45:33.261473 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:33.261434 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-542hq" event={"ID":"149beda9-6d40-46f3-9ec1-04c9053173cb","Type":"ContainerStarted","Data":"a85925a78927cf5f3ed94cddec193a07fd27df966e9d74f2a5d613583ef4800f"} Jul 07 17:45:37.285029 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:37.284995 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-542hq" event={"ID":"149beda9-6d40-46f3-9ec1-04c9053173cb","Type":"ContainerStarted","Data":"1145a4fe8eddcb34828d099a37f82359b6d062b35939d2025f905474de50bcd7"} Jul 07 17:45:37.285417 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:37.285065 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-542hq" Jul 07 17:45:37.300023 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:37.299948 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-542hq" podStartSLOduration=1.8918980680000002 podStartE2EDuration="6.299933692s" totalImagesPullingTime="4.408035624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:45:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:45:37.299254071 +0000 UTC m=+537.881260817" watchObservedRunningTime="2026-07-07 17:45:37.299933692 +0000 UTC m=+537.881940436" Jul 07 17:45:43.318443 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:43.318416 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-542hq" Jul 07 17:45:44.215661 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:44.215631 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-78595655d-zr468"] Jul 07 17:45:44.220357 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:44.220338 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78595655d-zr468" Jul 07 17:45:44.223130 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:44.223109 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8zcq4\"" Jul 07 17:45:44.223237 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:44.223114 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 07 17:45:44.228245 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:44.228225 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78595655d-zr468"] Jul 07 17:45:44.329071 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:44.329045 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d89nf\" (UniqueName: \"kubernetes.io/projected/3dec2ae3-2651-480e-80f2-514747a795d6-kube-api-access-d89nf\") pod \"authorino-78595655d-zr468\" (UID: \"3dec2ae3-2651-480e-80f2-514747a795d6\") " pod="kuadrant-system/authorino-78595655d-zr468" Jul 07 17:45:44.329429 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:44.329078 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3dec2ae3-2651-480e-80f2-514747a795d6-tls-cert\") pod \"authorino-78595655d-zr468\" (UID: \"3dec2ae3-2651-480e-80f2-514747a795d6\") " pod="kuadrant-system/authorino-78595655d-zr468" Jul 07 17:45:44.430354 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:44.430329 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d89nf\" (UniqueName: \"kubernetes.io/projected/3dec2ae3-2651-480e-80f2-514747a795d6-kube-api-access-d89nf\") pod \"authorino-78595655d-zr468\" (UID: \"3dec2ae3-2651-480e-80f2-514747a795d6\") " pod="kuadrant-system/authorino-78595655d-zr468" Jul 07 17:45:44.430478 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:44.430361 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3dec2ae3-2651-480e-80f2-514747a795d6-tls-cert\") pod \"authorino-78595655d-zr468\" (UID: \"3dec2ae3-2651-480e-80f2-514747a795d6\") " pod="kuadrant-system/authorino-78595655d-zr468" Jul 07 17:45:44.432710 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:44.432689 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3dec2ae3-2651-480e-80f2-514747a795d6-tls-cert\") pod \"authorino-78595655d-zr468\" (UID: \"3dec2ae3-2651-480e-80f2-514747a795d6\") " pod="kuadrant-system/authorino-78595655d-zr468" Jul 07 17:45:44.437294 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:44.437273 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d89nf\" (UniqueName: \"kubernetes.io/projected/3dec2ae3-2651-480e-80f2-514747a795d6-kube-api-access-d89nf\") pod \"authorino-78595655d-zr468\" (UID: \"3dec2ae3-2651-480e-80f2-514747a795d6\") " pod="kuadrant-system/authorino-78595655d-zr468" Jul 07 17:45:44.529947 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:44.529888 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78595655d-zr468" Jul 07 17:45:44.651795 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:44.651774 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78595655d-zr468"] Jul 07 17:45:44.653494 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:45:44.653466 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3dec2ae3_2651_480e_80f2_514747a795d6.slice/crio-b431f23c94ff57da237712a89c06d9fb7dc189cfbcb16cf84aed71d038a317a4 WatchSource:0}: Error finding container b431f23c94ff57da237712a89c06d9fb7dc189cfbcb16cf84aed71d038a317a4: Status 404 returned error can't find the container with id b431f23c94ff57da237712a89c06d9fb7dc189cfbcb16cf84aed71d038a317a4 Jul 07 17:45:45.325947 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:45.325911 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78595655d-zr468" event={"ID":"3dec2ae3-2651-480e-80f2-514747a795d6","Type":"ContainerStarted","Data":"b431f23c94ff57da237712a89c06d9fb7dc189cfbcb16cf84aed71d038a317a4"} Jul 07 17:45:48.343764 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:48.343729 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78595655d-zr468" event={"ID":"3dec2ae3-2651-480e-80f2-514747a795d6","Type":"ContainerStarted","Data":"505bd2f4ab08dedaa8e2c9294a32835460dbe72b197a3650077e443e4956167d"} Jul 07 17:45:48.359567 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:45:48.359524 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-78595655d-zr468" podStartSLOduration=1.2764332330000001 podStartE2EDuration="4.35951116s" totalImagesPullingTime="3.083077927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:45:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:45:48.357763771 +0000 UTC m=+548.939770516" watchObservedRunningTime="2026-07-07 17:45:48.35951116 +0000 UTC m=+548.941517903" Jul 07 17:46:25.690519 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:46:25.690486 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:46:33.569134 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:46:33.569099 2552 generic.go:356] "Generic (PLEG): container finished" podID="6595f65c-fac9-40d6-b133-7a78ea5c225b" containerID="e32d6509ec3702fa11331bfba251edeeb2b987fc29c0e836d0fbcf904b8da35e" exitCode=0 Jul 07 17:46:33.569579 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:46:33.569172 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" event={"ID":"6595f65c-fac9-40d6-b133-7a78ea5c225b","Type":"ContainerDied","Data":"e32d6509ec3702fa11331bfba251edeeb2b987fc29c0e836d0fbcf904b8da35e"} Jul 07 17:46:33.569579 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:46:33.569576 2552 scope.go:117] "RemoveContainer" containerID="e32d6509ec3702fa11331bfba251edeeb2b987fc29c0e836d0fbcf904b8da35e" Jul 07 17:46:33.570576 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:46:33.570544 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 17:46:33.570641 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:46:33.570626 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 17:46:33.570678 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:46:33.570666 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 17:46:34.576003 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:46:34.575972 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" event={"ID":"6595f65c-fac9-40d6-b133-7a78ea5c225b","Type":"ContainerStarted","Data":"bfa7413b21d343b94cf0af56fc896598b27edae3775869766d02db1d802b71dc"} Jul 07 17:46:35.432381 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:46:35.432348 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:46:35.433451 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:46:35.433426 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-hscv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 07 17:46:35.433567 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:46:35.433474 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" podUID="6595f65c-fac9-40d6-b133-7a78ea5c225b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 07 17:46:36.432141 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:46:36.432102 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-hscv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 07 17:46:36.432648 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:46:36.432161 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" podUID="6595f65c-fac9-40d6-b133-7a78ea5c225b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 07 17:46:37.431734 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:46:37.431703 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-hscv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 07 17:46:37.431917 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:46:37.431757 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" podUID="6595f65c-fac9-40d6-b133-7a78ea5c225b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 07 17:46:38.436350 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:46:38.436321 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:46:38.436809 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:46:38.436707 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:46:38.437391 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:46:38.437372 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hscv4" Jul 07 17:46:39.803181 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:46:39.803150 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/ovn-acl-logging/0.log" Jul 07 17:46:39.803840 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:46:39.803823 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/ovn-acl-logging/0.log" Jul 07 17:46:50.997148 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:46:50.997116 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:47:03.640460 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:03.640388 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs"] Jul 07 17:47:03.642821 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:03.642788 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs" Jul 07 17:47:03.645976 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:03.645951 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 07 17:47:03.646089 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:03.645951 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 07 17:47:03.646089 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:03.646004 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lvk68\"" Jul 07 17:47:03.646089 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:03.645964 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 07 17:47:03.659029 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:03.659004 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs"] Jul 07 17:47:03.782198 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:03.782164 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca1b8e4f-6cc0-41d8-ab72-f69665a164f0-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jntcs\" (UID: \"ca1b8e4f-6cc0-41d8-ab72-f69665a164f0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs" Jul 07 17:47:03.782198 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:03.782197 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca1b8e4f-6cc0-41d8-ab72-f69665a164f0-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jntcs\" (UID: \"ca1b8e4f-6cc0-41d8-ab72-f69665a164f0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs" Jul 07 17:47:03.782445 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:03.782225 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca1b8e4f-6cc0-41d8-ab72-f69665a164f0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jntcs\" (UID: \"ca1b8e4f-6cc0-41d8-ab72-f69665a164f0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs" Jul 07 17:47:03.782445 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:03.782268 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl9xv\" (UniqueName: \"kubernetes.io/projected/ca1b8e4f-6cc0-41d8-ab72-f69665a164f0-kube-api-access-pl9xv\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jntcs\" (UID: \"ca1b8e4f-6cc0-41d8-ab72-f69665a164f0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs" Jul 07 17:47:03.782445 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:03.782331 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca1b8e4f-6cc0-41d8-ab72-f69665a164f0-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jntcs\" (UID: \"ca1b8e4f-6cc0-41d8-ab72-f69665a164f0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs" Jul 07 17:47:03.782445 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:03.782405 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca1b8e4f-6cc0-41d8-ab72-f69665a164f0-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jntcs\" (UID: \"ca1b8e4f-6cc0-41d8-ab72-f69665a164f0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs" Jul 07 17:47:03.883736 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:03.883703 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca1b8e4f-6cc0-41d8-ab72-f69665a164f0-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jntcs\" (UID: \"ca1b8e4f-6cc0-41d8-ab72-f69665a164f0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs" Jul 07 17:47:03.883736 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:03.883734 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca1b8e4f-6cc0-41d8-ab72-f69665a164f0-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jntcs\" (UID: \"ca1b8e4f-6cc0-41d8-ab72-f69665a164f0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs" Jul 07 17:47:03.883998 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:03.883754 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca1b8e4f-6cc0-41d8-ab72-f69665a164f0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jntcs\" (UID: \"ca1b8e4f-6cc0-41d8-ab72-f69665a164f0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs" Jul 07 17:47:03.883998 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:03.883773 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl9xv\" (UniqueName: \"kubernetes.io/projected/ca1b8e4f-6cc0-41d8-ab72-f69665a164f0-kube-api-access-pl9xv\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jntcs\" (UID: \"ca1b8e4f-6cc0-41d8-ab72-f69665a164f0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs" Jul 07 17:47:03.883998 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:03.883807 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca1b8e4f-6cc0-41d8-ab72-f69665a164f0-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jntcs\" (UID: \"ca1b8e4f-6cc0-41d8-ab72-f69665a164f0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs" Jul 07 17:47:03.883998 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:03.883862 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca1b8e4f-6cc0-41d8-ab72-f69665a164f0-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jntcs\" (UID: \"ca1b8e4f-6cc0-41d8-ab72-f69665a164f0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs" Jul 07 17:47:03.884201 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:03.884168 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca1b8e4f-6cc0-41d8-ab72-f69665a164f0-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jntcs\" (UID: \"ca1b8e4f-6cc0-41d8-ab72-f69665a164f0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs" Jul 07 17:47:03.884201 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:03.884192 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca1b8e4f-6cc0-41d8-ab72-f69665a164f0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jntcs\" (UID: \"ca1b8e4f-6cc0-41d8-ab72-f69665a164f0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs" Jul 07 17:47:03.884325 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:03.884235 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca1b8e4f-6cc0-41d8-ab72-f69665a164f0-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jntcs\" (UID: \"ca1b8e4f-6cc0-41d8-ab72-f69665a164f0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs" Jul 07 17:47:03.886070 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:03.886052 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca1b8e4f-6cc0-41d8-ab72-f69665a164f0-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jntcs\" (UID: \"ca1b8e4f-6cc0-41d8-ab72-f69665a164f0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs" Jul 07 17:47:03.886243 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:03.886227 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca1b8e4f-6cc0-41d8-ab72-f69665a164f0-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jntcs\" (UID: \"ca1b8e4f-6cc0-41d8-ab72-f69665a164f0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs" Jul 07 17:47:03.891412 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:03.891362 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl9xv\" (UniqueName: \"kubernetes.io/projected/ca1b8e4f-6cc0-41d8-ab72-f69665a164f0-kube-api-access-pl9xv\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jntcs\" (UID: \"ca1b8e4f-6cc0-41d8-ab72-f69665a164f0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs" Jul 07 17:47:03.953566 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:03.953535 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs" Jul 07 17:47:04.085343 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:04.085320 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs"] Jul 07 17:47:04.087391 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:47:04.087348 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca1b8e4f_6cc0_41d8_ab72_f69665a164f0.slice/crio-cb927c1dc5190013b0b8b2e1a9dd1f360dd9a809bb8a661da47284e2e9e11652 WatchSource:0}: Error finding container cb927c1dc5190013b0b8b2e1a9dd1f360dd9a809bb8a661da47284e2e9e11652: Status 404 returned error can't find the container with id cb927c1dc5190013b0b8b2e1a9dd1f360dd9a809bb8a661da47284e2e9e11652 Jul 07 17:47:04.089381 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:04.089363 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 17:47:04.387048 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:04.386999 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:47:04.732694 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:04.732600 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs" event={"ID":"ca1b8e4f-6cc0-41d8-ab72-f69665a164f0","Type":"ContainerStarted","Data":"cb927c1dc5190013b0b8b2e1a9dd1f360dd9a809bb8a661da47284e2e9e11652"} Jul 07 17:47:05.738726 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:05.738687 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs" event={"ID":"ca1b8e4f-6cc0-41d8-ab72-f69665a164f0","Type":"ContainerStarted","Data":"38d64859f8dc2f48948e4cb66da3a489635f556039e337d2c4dac863fb033a1e"} Jul 07 17:47:05.759095 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:05.759048 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs" podStartSLOduration=1.6216986169999998 podStartE2EDuration="2.759033985s" totalImagesPullingTime="1.137335368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:47:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:47:05.757506636 +0000 UTC m=+626.339513375" watchObservedRunningTime="2026-07-07 17:47:05.759033985 +0000 UTC m=+626.341041025" Jul 07 17:47:13.954232 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:13.954203 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs" Jul 07 17:47:13.954829 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:13.954536 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs" Jul 07 17:47:13.972065 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:13.972042 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs" Jul 07 17:47:14.795349 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:14.795319 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jntcs" Jul 07 17:47:16.689922 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:16.689895 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:47:22.391473 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:22.391439 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:47:27.492457 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:27.492426 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:47:35.295929 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:47:35.295895 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:48:42.307050 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:48:42.306967 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78595655d-zr468"] Jul 07 17:48:42.307544 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:48:42.307185 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-78595655d-zr468" podUID="3dec2ae3-2651-480e-80f2-514747a795d6" containerName="authorino" containerID="cri-o://505bd2f4ab08dedaa8e2c9294a32835460dbe72b197a3650077e443e4956167d" gracePeriod=30 Jul 07 17:48:42.556008 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:48:42.555983 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78595655d-zr468" Jul 07 17:48:42.699735 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:48:42.699704 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d89nf\" (UniqueName: \"kubernetes.io/projected/3dec2ae3-2651-480e-80f2-514747a795d6-kube-api-access-d89nf\") pod \"3dec2ae3-2651-480e-80f2-514747a795d6\" (UID: \"3dec2ae3-2651-480e-80f2-514747a795d6\") " Jul 07 17:48:42.699916 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:48:42.699812 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3dec2ae3-2651-480e-80f2-514747a795d6-tls-cert\") pod \"3dec2ae3-2651-480e-80f2-514747a795d6\" (UID: \"3dec2ae3-2651-480e-80f2-514747a795d6\") " Jul 07 17:48:42.701799 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:48:42.701769 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dec2ae3-2651-480e-80f2-514747a795d6-kube-api-access-d89nf" (OuterVolumeSpecName: "kube-api-access-d89nf") pod "3dec2ae3-2651-480e-80f2-514747a795d6" (UID: "3dec2ae3-2651-480e-80f2-514747a795d6"). InnerVolumeSpecName "kube-api-access-d89nf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:48:42.709459 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:48:42.709432 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dec2ae3-2651-480e-80f2-514747a795d6-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "3dec2ae3-2651-480e-80f2-514747a795d6" (UID: "3dec2ae3-2651-480e-80f2-514747a795d6"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:48:42.800879 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:48:42.800847 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d89nf\" (UniqueName: \"kubernetes.io/projected/3dec2ae3-2651-480e-80f2-514747a795d6-kube-api-access-d89nf\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:48:42.800879 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:48:42.800873 2552 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3dec2ae3-2651-480e-80f2-514747a795d6-tls-cert\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 17:48:43.225514 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:48:43.225477 2552 generic.go:356] "Generic (PLEG): container finished" podID="3dec2ae3-2651-480e-80f2-514747a795d6" containerID="505bd2f4ab08dedaa8e2c9294a32835460dbe72b197a3650077e443e4956167d" exitCode=0 Jul 07 17:48:43.225514 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:48:43.225516 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78595655d-zr468" Jul 07 17:48:43.225770 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:48:43.225559 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78595655d-zr468" event={"ID":"3dec2ae3-2651-480e-80f2-514747a795d6","Type":"ContainerDied","Data":"505bd2f4ab08dedaa8e2c9294a32835460dbe72b197a3650077e443e4956167d"} Jul 07 17:48:43.225770 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:48:43.225602 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78595655d-zr468" event={"ID":"3dec2ae3-2651-480e-80f2-514747a795d6","Type":"ContainerDied","Data":"b431f23c94ff57da237712a89c06d9fb7dc189cfbcb16cf84aed71d038a317a4"} Jul 07 17:48:43.225770 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:48:43.225621 2552 scope.go:117] "RemoveContainer" containerID="505bd2f4ab08dedaa8e2c9294a32835460dbe72b197a3650077e443e4956167d" Jul 07 17:48:43.236816 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:48:43.236797 2552 scope.go:117] "RemoveContainer" containerID="505bd2f4ab08dedaa8e2c9294a32835460dbe72b197a3650077e443e4956167d" Jul 07 17:48:43.237294 ip-10-0-131-96 kubenswrapper[2552]: E0707 17:48:43.237271 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"505bd2f4ab08dedaa8e2c9294a32835460dbe72b197a3650077e443e4956167d\": container with ID starting with 505bd2f4ab08dedaa8e2c9294a32835460dbe72b197a3650077e443e4956167d not found: ID does not exist" containerID="505bd2f4ab08dedaa8e2c9294a32835460dbe72b197a3650077e443e4956167d" Jul 07 17:48:43.237412 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:48:43.237323 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"505bd2f4ab08dedaa8e2c9294a32835460dbe72b197a3650077e443e4956167d"} err="failed to get container status \"505bd2f4ab08dedaa8e2c9294a32835460dbe72b197a3650077e443e4956167d\": rpc error: code = NotFound desc = could not find container \"505bd2f4ab08dedaa8e2c9294a32835460dbe72b197a3650077e443e4956167d\": container with ID starting with 505bd2f4ab08dedaa8e2c9294a32835460dbe72b197a3650077e443e4956167d not found: ID does not exist" Jul 07 17:48:43.250065 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:48:43.250040 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78595655d-zr468"] Jul 07 17:48:43.257524 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:48:43.257503 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-78595655d-zr468"] Jul 07 17:48:43.972652 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:48:43.972625 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dec2ae3-2651-480e-80f2-514747a795d6" path="/var/lib/kubelet/pods/3dec2ae3-2651-480e-80f2-514747a795d6/volumes" Jul 07 17:49:11.121942 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:49:11.121909 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:49:21.493072 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:49:21.493040 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:49:31.391691 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:49:31.391659 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:49:38.992258 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:49:38.992220 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:49:48.192882 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:49:48.192849 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:49:57.096689 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:49:57.096659 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:50:19.596103 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:50:19.596071 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:50:32.593911 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:50:32.593879 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:51:07.686729 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:51:07.686697 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:51:17.099613 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:51:17.099563 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:51:25.887547 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:51:25.887511 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:51:34.291693 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:51:34.291661 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:51:39.834199 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:51:39.834176 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/ovn-acl-logging/0.log" Jul 07 17:51:39.836718 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:51:39.836699 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/ovn-acl-logging/0.log" Jul 07 17:51:44.193436 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:51:44.193403 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:51:55.494190 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:51:55.494158 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:52:06.591862 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:52:06.591829 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:52:16.094734 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:52:16.094686 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:52:38.894070 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:52:38.894039 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:52:47.786865 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:52:47.786833 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:53:10.897756 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:53:10.897676 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:53:22.788980 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:53:22.788940 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:53:37.200905 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:53:37.200871 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:53:47.492259 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:53:47.492219 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:53:58.889193 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:53:58.889161 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:54:08.088399 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:54:08.088365 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:54:16.993537 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:54:16.993498 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:55:43.861612 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:55:43.861583 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pn6m"] Jul 07 17:55:43.862052 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:55:43.861912 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dec2ae3-2651-480e-80f2-514747a795d6" containerName="authorino" Jul 07 17:55:43.862052 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:55:43.861923 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dec2ae3-2651-480e-80f2-514747a795d6" containerName="authorino" Jul 07 17:55:43.862052 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:55:43.861976 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dec2ae3-2651-480e-80f2-514747a795d6" containerName="authorino" Jul 07 17:55:43.863653 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:55:43.863638 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pn6m" Jul 07 17:55:43.865755 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:55:43.865737 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8wt5d\"" Jul 07 17:55:43.878641 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:55:43.878622 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pn6m"] Jul 07 17:55:43.969510 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:55:43.969488 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b0fa7ef-835b-430b-a0e6-285e4f5f28a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9pn6m\" (UID: \"9b0fa7ef-835b-430b-a0e6-285e4f5f28a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pn6m" Jul 07 17:55:43.969611 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:55:43.969566 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvk6g\" (UniqueName: \"kubernetes.io/projected/9b0fa7ef-835b-430b-a0e6-285e4f5f28a8-kube-api-access-jvk6g\") pod \"kuadrant-operator-controller-manager-86878c769f-9pn6m\" (UID: \"9b0fa7ef-835b-430b-a0e6-285e4f5f28a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pn6m" Jul 07 17:55:44.070230 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:55:44.070203 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvk6g\" (UniqueName: \"kubernetes.io/projected/9b0fa7ef-835b-430b-a0e6-285e4f5f28a8-kube-api-access-jvk6g\") pod \"kuadrant-operator-controller-manager-86878c769f-9pn6m\" (UID: \"9b0fa7ef-835b-430b-a0e6-285e4f5f28a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pn6m" Jul 07 17:55:44.070353 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:55:44.070246 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b0fa7ef-835b-430b-a0e6-285e4f5f28a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9pn6m\" (UID: \"9b0fa7ef-835b-430b-a0e6-285e4f5f28a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pn6m" Jul 07 17:55:44.070570 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:55:44.070540 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b0fa7ef-835b-430b-a0e6-285e4f5f28a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9pn6m\" (UID: \"9b0fa7ef-835b-430b-a0e6-285e4f5f28a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pn6m" Jul 07 17:55:44.078413 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:55:44.078393 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvk6g\" (UniqueName: \"kubernetes.io/projected/9b0fa7ef-835b-430b-a0e6-285e4f5f28a8-kube-api-access-jvk6g\") pod \"kuadrant-operator-controller-manager-86878c769f-9pn6m\" (UID: \"9b0fa7ef-835b-430b-a0e6-285e4f5f28a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pn6m" Jul 07 17:55:44.173012 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:55:44.172980 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pn6m" Jul 07 17:55:44.305383 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:55:44.305360 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pn6m"] Jul 07 17:55:44.307026 ip-10-0-131-96 kubenswrapper[2552]: W0707 17:55:44.307005 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b0fa7ef_835b_430b_a0e6_285e4f5f28a8.slice/crio-1eca5e7bcf802eab16de5a0aedbebca54e3a2cb5df8514005aac3a70d97c4b0b WatchSource:0}: Error finding container 1eca5e7bcf802eab16de5a0aedbebca54e3a2cb5df8514005aac3a70d97c4b0b: Status 404 returned error can't find the container with id 1eca5e7bcf802eab16de5a0aedbebca54e3a2cb5df8514005aac3a70d97c4b0b Jul 07 17:55:44.325190 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:55:44.325167 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pn6m" event={"ID":"9b0fa7ef-835b-430b-a0e6-285e4f5f28a8","Type":"ContainerStarted","Data":"1eca5e7bcf802eab16de5a0aedbebca54e3a2cb5df8514005aac3a70d97c4b0b"} Jul 07 17:55:45.331556 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:55:45.331520 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pn6m" event={"ID":"9b0fa7ef-835b-430b-a0e6-285e4f5f28a8","Type":"ContainerStarted","Data":"75670884fd4acfa456bcc0113586a1c862e6923e7b17d4acfea8d1a9840379b6"} Jul 07 17:55:45.331905 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:55:45.331613 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pn6m" Jul 07 17:55:45.355040 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:55:45.354998 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pn6m" podStartSLOduration=2.354984837 podStartE2EDuration="2.354984837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:55:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:55:45.352030107 +0000 UTC m=+1145.934036854" watchObservedRunningTime="2026-07-07 17:55:45.354984837 +0000 UTC m=+1145.936991560" Jul 07 17:55:56.338744 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:55:56.338715 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9pn6m" Jul 07 17:56:03.415804 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:56:03.415728 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:56:11.855292 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:56:11.855243 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:56:24.559897 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:56:24.559855 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:56:33.452631 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:56:33.452580 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:56:39.869256 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:56:39.869222 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/ovn-acl-logging/0.log" Jul 07 17:56:39.872541 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:56:39.872523 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/ovn-acl-logging/0.log" Jul 07 17:56:42.550886 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:56:42.550849 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:56:51.552453 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:56:51.552412 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:57:02.559236 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:57:02.559205 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:57:13.856467 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:57:13.856431 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:57:22.256995 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:57:22.256961 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:57:33.149419 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:57:33.149345 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:57:45.057341 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:57:45.057308 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:57:52.061838 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:57:52.061797 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:58:13.450214 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:58:13.450184 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:58:20.756985 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:58:20.756951 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:58:29.856466 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:58:29.856423 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:58:40.855905 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:58:40.855874 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:58:47.960075 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:58:47.960039 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:58:58.862701 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:58:58.862671 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:59:09.849356 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:59:09.849259 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:59:18.155479 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:59:18.155448 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:59:29.356017 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:59:29.355976 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:59:38.365861 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:59:38.365821 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 17:59:47.258204 ip-10-0-131-96 kubenswrapper[2552]: I0707 17:59:47.258171 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:00:00.661778 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:00:00.661738 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:00:10.958036 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:00:10.958005 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:00:20.550545 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:00:20.550509 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:00:31.956687 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:00:31.956606 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:00:42.456812 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:00:42.456754 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:00:50.260787 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:00:50.260753 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:01:01.763927 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:01:01.763884 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:01:14.350279 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:01:14.350239 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:01:25.851369 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:01:25.851331 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:01:34.252290 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:01:34.252248 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:01:39.912099 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:01:39.912071 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/ovn-acl-logging/0.log" Jul 07 18:01:39.919492 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:01:39.919469 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/ovn-acl-logging/0.log" Jul 07 18:01:43.660283 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:01:43.660249 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:01:52.054988 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:01:52.054952 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:02:00.554717 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:00.554681 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:02:01.400077 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.399986 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs"] Jul 07 18:02:01.404123 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.404101 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:01.406619 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.406593 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-494e9685-openshift-default-dockercfg-9r8x2\"" Jul 07 18:02:01.421972 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.421948 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs"] Jul 07 18:02:01.477402 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.477373 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istio-data\") pod \"e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:01.477550 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.477411 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istiod-ca-cert\") pod \"e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:01.477550 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.477438 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-workload-certs\") pod \"e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:01.477550 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.477463 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-credential-socket\") pod \"e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:01.477550 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.477499 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istio-envoy\") pod \"e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:01.477550 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.477515 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istio-token\") pod \"e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:01.477710 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.477555 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnkqg\" (UniqueName: \"kubernetes.io/projected/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-kube-api-access-dnkqg\") pod \"e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:01.477710 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.477609 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istio-podinfo\") pod \"e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:01.477710 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.477628 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-workload-socket\") pod \"e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:01.578803 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.578770 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-workload-certs\") pod \"e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:01.578803 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.578804 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-credential-socket\") pod \"e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:01.579340 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.578836 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istio-envoy\") pod \"e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:01.579340 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.578947 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istio-token\") pod \"e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:01.579340 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.578986 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnkqg\" (UniqueName: \"kubernetes.io/projected/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-kube-api-access-dnkqg\") pod \"e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:01.579340 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.579220 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-credential-socket\") pod \"e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:01.579340 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.579235 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istio-podinfo\") pod \"e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:01.579340 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.579259 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-workload-certs\") pod \"e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:01.579340 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.579281 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-workload-socket\") pod \"e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:01.579703 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.579358 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istio-data\") pod \"e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:01.579703 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.579406 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istiod-ca-cert\") pod \"e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:01.579703 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.579583 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-workload-socket\") pod \"e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:01.579830 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.579725 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istio-data\") pod \"e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:01.580125 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.580106 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istiod-ca-cert\") pod \"e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:01.581165 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.581147 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istio-envoy\") pod \"e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:01.581455 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.581438 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istio-podinfo\") pod \"e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:01.586484 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.586460 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istio-token\") pod \"e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:01.586590 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.586492 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnkqg\" (UniqueName: \"kubernetes.io/projected/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-kube-api-access-dnkqg\") pod \"e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:01.715229 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.715150 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:01.844857 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.844835 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs"] Jul 07 18:02:01.846826 ip-10-0-131-96 kubenswrapper[2552]: W0707 18:02:01.846800 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9df9e5f_786c_4b05_aa54_fda8193ee4fb.slice/crio-98184cd69a02a47bccfbdfc1a76e986f3deb6596fe7550ed84449838ee23b690 WatchSource:0}: Error finding container 98184cd69a02a47bccfbdfc1a76e986f3deb6596fe7550ed84449838ee23b690: Status 404 returned error can't find the container with id 98184cd69a02a47bccfbdfc1a76e986f3deb6596fe7550ed84449838ee23b690 Jul 07 18:02:01.848960 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.848930 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:02:01.849032 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.848991 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:02:01.849032 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:01.849015 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:02:02.292155 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:02.292120 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" event={"ID":"c9df9e5f-786c-4b05-aa54-fda8193ee4fb","Type":"ContainerStarted","Data":"d1847524b51e2a52cc972e1c2cdf74d584e4c89c66772897f8746be9012b954c"} Jul 07 18:02:02.292355 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:02.292179 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" event={"ID":"c9df9e5f-786c-4b05-aa54-fda8193ee4fb","Type":"ContainerStarted","Data":"98184cd69a02a47bccfbdfc1a76e986f3deb6596fe7550ed84449838ee23b690"} Jul 07 18:02:02.312003 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:02.311927 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" podStartSLOduration=1.311899618 podStartE2EDuration="1.311899618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:02:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:02:02.309605434 +0000 UTC m=+1522.891612181" watchObservedRunningTime="2026-07-07 18:02:02.311899618 +0000 UTC m=+1522.893906364" Jul 07 18:02:02.715592 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:02.715555 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:02.720597 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:02.720575 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:03.298245 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:03.298219 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:03.299395 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:03.299372 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:07.853681 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:07.853644 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs"] Jul 07 18:02:07.854071 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:07.853852 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" podUID="c9df9e5f-786c-4b05-aa54-fda8193ee4fb" containerName="istio-proxy" containerID="cri-o://d1847524b51e2a52cc972e1c2cdf74d584e4c89c66772897f8746be9012b954c" gracePeriod=30 Jul 07 18:02:13.103376 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.103315 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:13.185775 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.185679 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-workload-certs\") pod \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " Jul 07 18:02:13.185775 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.185719 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istio-podinfo\") pod \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " Jul 07 18:02:13.185775 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.185751 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istio-data\") pod \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " Jul 07 18:02:13.185775 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.185771 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istiod-ca-cert\") pod \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " Jul 07 18:02:13.186070 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.185791 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnkqg\" (UniqueName: \"kubernetes.io/projected/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-kube-api-access-dnkqg\") pod \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " Jul 07 18:02:13.186070 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.185852 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istio-envoy\") pod \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " Jul 07 18:02:13.186070 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.185876 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istio-token\") pod \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " Jul 07 18:02:13.186070 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.185968 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-credential-socket\") pod \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " Jul 07 18:02:13.186070 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.185991 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c9df9e5f-786c-4b05-aa54-fda8193ee4fb" (UID: "c9df9e5f-786c-4b05-aa54-fda8193ee4fb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:02:13.186070 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.186021 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-workload-socket\") pod \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\" (UID: \"c9df9e5f-786c-4b05-aa54-fda8193ee4fb\") " Jul 07 18:02:13.186682 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.186158 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c9df9e5f-786c-4b05-aa54-fda8193ee4fb" (UID: "c9df9e5f-786c-4b05-aa54-fda8193ee4fb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:02:13.186682 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.186202 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c9df9e5f-786c-4b05-aa54-fda8193ee4fb" (UID: "c9df9e5f-786c-4b05-aa54-fda8193ee4fb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:02:13.186682 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.186329 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istiod-ca-cert\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:02:13.186682 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.186348 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-credential-socket\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:02:13.186682 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.186363 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-workload-certs\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:02:13.186682 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.186388 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c9df9e5f-786c-4b05-aa54-fda8193ee4fb" (UID: "c9df9e5f-786c-4b05-aa54-fda8193ee4fb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:02:13.186682 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.186665 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istio-data" (OuterVolumeSpecName: "istio-data") pod "c9df9e5f-786c-4b05-aa54-fda8193ee4fb" (UID: "c9df9e5f-786c-4b05-aa54-fda8193ee4fb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:02:13.188022 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.187991 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c9df9e5f-786c-4b05-aa54-fda8193ee4fb" (UID: "c9df9e5f-786c-4b05-aa54-fda8193ee4fb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 18:02:13.188159 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.188137 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-kube-api-access-dnkqg" (OuterVolumeSpecName: "kube-api-access-dnkqg") pod "c9df9e5f-786c-4b05-aa54-fda8193ee4fb" (UID: "c9df9e5f-786c-4b05-aa54-fda8193ee4fb"). InnerVolumeSpecName "kube-api-access-dnkqg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:02:13.188428 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.188408 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istio-token" (OuterVolumeSpecName: "istio-token") pod "c9df9e5f-786c-4b05-aa54-fda8193ee4fb" (UID: "c9df9e5f-786c-4b05-aa54-fda8193ee4fb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:02:13.188480 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.188420 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c9df9e5f-786c-4b05-aa54-fda8193ee4fb" (UID: "c9df9e5f-786c-4b05-aa54-fda8193ee4fb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:02:13.287829 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.287792 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istio-podinfo\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:02:13.287829 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.287823 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istio-data\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:02:13.287829 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.287832 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnkqg\" (UniqueName: \"kubernetes.io/projected/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-kube-api-access-dnkqg\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:02:13.287829 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.287843 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istio-envoy\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:02:13.288143 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.287853 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-istio-token\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:02:13.288143 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.287865 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9df9e5f-786c-4b05-aa54-fda8193ee4fb-workload-socket\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:02:13.365783 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.365745 2552 generic.go:356] "Generic (PLEG): container finished" podID="c9df9e5f-786c-4b05-aa54-fda8193ee4fb" containerID="d1847524b51e2a52cc972e1c2cdf74d584e4c89c66772897f8746be9012b954c" exitCode=0 Jul 07 18:02:13.365960 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.365792 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" event={"ID":"c9df9e5f-786c-4b05-aa54-fda8193ee4fb","Type":"ContainerDied","Data":"d1847524b51e2a52cc972e1c2cdf74d584e4c89c66772897f8746be9012b954c"} Jul 07 18:02:13.365960 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.365798 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" Jul 07 18:02:13.365960 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.365845 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs" event={"ID":"c9df9e5f-786c-4b05-aa54-fda8193ee4fb","Type":"ContainerDied","Data":"98184cd69a02a47bccfbdfc1a76e986f3deb6596fe7550ed84449838ee23b690"} Jul 07 18:02:13.365960 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.365875 2552 scope.go:117] "RemoveContainer" containerID="d1847524b51e2a52cc972e1c2cdf74d584e4c89c66772897f8746be9012b954c" Jul 07 18:02:13.378332 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.378290 2552 scope.go:117] "RemoveContainer" containerID="d1847524b51e2a52cc972e1c2cdf74d584e4c89c66772897f8746be9012b954c" Jul 07 18:02:13.378653 ip-10-0-131-96 kubenswrapper[2552]: E0707 18:02:13.378634 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1847524b51e2a52cc972e1c2cdf74d584e4c89c66772897f8746be9012b954c\": container with ID starting with d1847524b51e2a52cc972e1c2cdf74d584e4c89c66772897f8746be9012b954c not found: ID does not exist" containerID="d1847524b51e2a52cc972e1c2cdf74d584e4c89c66772897f8746be9012b954c" Jul 07 18:02:13.378718 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.378664 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1847524b51e2a52cc972e1c2cdf74d584e4c89c66772897f8746be9012b954c"} err="failed to get container status \"d1847524b51e2a52cc972e1c2cdf74d584e4c89c66772897f8746be9012b954c\": rpc error: code = NotFound desc = could not find container \"d1847524b51e2a52cc972e1c2cdf74d584e4c89c66772897f8746be9012b954c\": container with ID starting with d1847524b51e2a52cc972e1c2cdf74d584e4c89c66772897f8746be9012b954c not found: ID does not exist" Jul 07 18:02:13.389504 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.389475 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs"] Jul 07 18:02:13.392475 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.392448 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-494e9685-openshift-default-69b894bc75-b4pvs"] Jul 07 18:02:13.826106 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.826072 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d"] Jul 07 18:02:13.826668 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.826647 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9df9e5f-786c-4b05-aa54-fda8193ee4fb" containerName="istio-proxy" Jul 07 18:02:13.826734 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.826677 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9df9e5f-786c-4b05-aa54-fda8193ee4fb" containerName="istio-proxy" Jul 07 18:02:13.826807 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.826792 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9df9e5f-786c-4b05-aa54-fda8193ee4fb" containerName="istio-proxy" Jul 07 18:02:13.831508 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.831485 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:13.833834 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.833811 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b78dfc41-openshift-default-dockercfg-z28qr\"" Jul 07 18:02:13.841073 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.841051 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d"] Jul 07 18:02:13.891649 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.891616 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-workload-socket\") pod \"e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:13.891649 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.891653 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-credential-socket\") pod \"e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:13.891884 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.891673 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-workload-certs\") pod \"e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:13.891884 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.891754 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kd7p\" (UniqueName: \"kubernetes.io/projected/c488162e-54ba-45c6-bdce-429553bfb3b7-kube-api-access-9kd7p\") pod \"e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:13.891884 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.891808 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c488162e-54ba-45c6-bdce-429553bfb3b7-istiod-ca-cert\") pod \"e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:13.891884 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.891831 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-istio-envoy\") pod \"e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:13.891884 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.891850 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c488162e-54ba-45c6-bdce-429553bfb3b7-istio-token\") pod \"e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:13.892071 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.891930 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-istio-data\") pod \"e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:13.892071 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.891962 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c488162e-54ba-45c6-bdce-429553bfb3b7-istio-podinfo\") pod \"e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:13.973063 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.973029 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9df9e5f-786c-4b05-aa54-fda8193ee4fb" path="/var/lib/kubelet/pods/c9df9e5f-786c-4b05-aa54-fda8193ee4fb/volumes" Jul 07 18:02:13.992818 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.992787 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-credential-socket\") pod \"e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:13.992977 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.992822 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-workload-certs\") pod \"e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:13.992977 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.992851 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kd7p\" (UniqueName: \"kubernetes.io/projected/c488162e-54ba-45c6-bdce-429553bfb3b7-kube-api-access-9kd7p\") pod \"e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:13.992977 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.992879 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c488162e-54ba-45c6-bdce-429553bfb3b7-istiod-ca-cert\") pod \"e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:13.992977 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.992906 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-istio-envoy\") pod \"e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:13.992977 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.992933 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c488162e-54ba-45c6-bdce-429553bfb3b7-istio-token\") pod \"e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:13.993602 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.993001 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-istio-data\") pod \"e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:13.993602 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.993044 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c488162e-54ba-45c6-bdce-429553bfb3b7-istio-podinfo\") pod \"e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:13.993602 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.993103 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-workload-socket\") pod \"e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:13.993602 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.993270 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-workload-certs\") pod \"e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:13.993602 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.993324 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-credential-socket\") pod \"e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:13.993602 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.993452 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-istio-data\") pod \"e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:13.993602 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.993463 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-workload-socket\") pod \"e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:13.993826 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.993663 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c488162e-54ba-45c6-bdce-429553bfb3b7-istiod-ca-cert\") pod \"e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:13.995195 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.995174 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-istio-envoy\") pod \"e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:13.995430 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:13.995412 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c488162e-54ba-45c6-bdce-429553bfb3b7-istio-podinfo\") pod \"e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:14.000502 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:14.000479 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c488162e-54ba-45c6-bdce-429553bfb3b7-istio-token\") pod \"e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:14.000656 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:14.000636 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kd7p\" (UniqueName: \"kubernetes.io/projected/c488162e-54ba-45c6-bdce-429553bfb3b7-kube-api-access-9kd7p\") pod \"e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:14.142617 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:14.142578 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:14.280547 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:14.280519 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d"] Jul 07 18:02:14.281593 ip-10-0-131-96 kubenswrapper[2552]: W0707 18:02:14.281572 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc488162e_54ba_45c6_bdce_429553bfb3b7.slice/crio-07d3762b0e8cff01d30d37e04a87d0b9533e8f7d5cf035a753759bc62ffd9405 WatchSource:0}: Error finding container 07d3762b0e8cff01d30d37e04a87d0b9533e8f7d5cf035a753759bc62ffd9405: Status 404 returned error can't find the container with id 07d3762b0e8cff01d30d37e04a87d0b9533e8f7d5cf035a753759bc62ffd9405 Jul 07 18:02:14.283543 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:14.283506 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:02:14.283622 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:14.283566 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:02:14.283622 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:14.283593 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:02:14.373639 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:14.373604 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" event={"ID":"c488162e-54ba-45c6-bdce-429553bfb3b7","Type":"ContainerStarted","Data":"548d80bd4a72c116cc9be3a8babf82530c49a5e5dea9e6244f0819a1c2033427"} Jul 07 18:02:14.373811 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:14.373701 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" event={"ID":"c488162e-54ba-45c6-bdce-429553bfb3b7","Type":"ContainerStarted","Data":"07d3762b0e8cff01d30d37e04a87d0b9533e8f7d5cf035a753759bc62ffd9405"} Jul 07 18:02:14.396781 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:14.396686 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" podStartSLOduration=1.3966709480000001 podStartE2EDuration="1.396670948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:02:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:02:14.395272757 +0000 UTC m=+1534.977279502" watchObservedRunningTime="2026-07-07 18:02:14.396670948 +0000 UTC m=+1534.978677692" Jul 07 18:02:15.143278 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:15.143241 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:15.157357 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:15.157331 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:15.378972 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:15.378940 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:15.380078 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:15.380059 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:17.748549 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:17.748520 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:02:25.441374 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:25.441343 2552 generic.go:356] "Generic (PLEG): container finished" podID="c488162e-54ba-45c6-bdce-429553bfb3b7" containerID="548d80bd4a72c116cc9be3a8babf82530c49a5e5dea9e6244f0819a1c2033427" exitCode=0 Jul 07 18:02:25.441791 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:25.441419 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" event={"ID":"c488162e-54ba-45c6-bdce-429553bfb3b7","Type":"ContainerDied","Data":"548d80bd4a72c116cc9be3a8babf82530c49a5e5dea9e6244f0819a1c2033427"} Jul 07 18:02:25.441791 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:25.441782 2552 scope.go:117] "RemoveContainer" containerID="548d80bd4a72c116cc9be3a8babf82530c49a5e5dea9e6244f0819a1c2033427" Jul 07 18:02:25.442708 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:25.442682 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:02:25.442770 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:25.442747 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:02:25.442806 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:25.442777 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:02:26.186884 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:26.186848 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d"] Jul 07 18:02:26.455049 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:26.454943 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" event={"ID":"c488162e-54ba-45c6-bdce-429553bfb3b7","Type":"ContainerStarted","Data":"c1003510457c2f07ea9ed3406c5c73045ee983fa94e0d86a921c40dffd7bbac2"} Jul 07 18:02:26.455049 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:26.455009 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" podUID="c488162e-54ba-45c6-bdce-429553bfb3b7" containerName="istio-proxy" containerID="cri-o://c1003510457c2f07ea9ed3406c5c73045ee983fa94e0d86a921c40dffd7bbac2" gracePeriod=30 Jul 07 18:02:28.851635 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:28.851597 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:02:30.379521 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:30.379483 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:31.716562 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:31.716498 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:31.848861 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:31.848822 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c488162e-54ba-45c6-bdce-429553bfb3b7-istiod-ca-cert\") pod \"c488162e-54ba-45c6-bdce-429553bfb3b7\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " Jul 07 18:02:31.848861 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:31.848869 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-istio-envoy\") pod \"c488162e-54ba-45c6-bdce-429553bfb3b7\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " Jul 07 18:02:31.849111 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:31.848922 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-workload-socket\") pod \"c488162e-54ba-45c6-bdce-429553bfb3b7\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " Jul 07 18:02:31.849111 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:31.848938 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-credential-socket\") pod \"c488162e-54ba-45c6-bdce-429553bfb3b7\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " Jul 07 18:02:31.849111 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:31.848969 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c488162e-54ba-45c6-bdce-429553bfb3b7-istio-podinfo\") pod \"c488162e-54ba-45c6-bdce-429553bfb3b7\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " Jul 07 18:02:31.849111 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:31.849023 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-workload-certs\") pod \"c488162e-54ba-45c6-bdce-429553bfb3b7\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " Jul 07 18:02:31.849111 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:31.849063 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c488162e-54ba-45c6-bdce-429553bfb3b7-istio-token\") pod \"c488162e-54ba-45c6-bdce-429553bfb3b7\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " Jul 07 18:02:31.849378 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:31.849185 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-istio-data\") pod \"c488162e-54ba-45c6-bdce-429553bfb3b7\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " Jul 07 18:02:31.849378 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:31.849239 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kd7p\" (UniqueName: \"kubernetes.io/projected/c488162e-54ba-45c6-bdce-429553bfb3b7-kube-api-access-9kd7p\") pod \"c488162e-54ba-45c6-bdce-429553bfb3b7\" (UID: \"c488162e-54ba-45c6-bdce-429553bfb3b7\") " Jul 07 18:02:31.849378 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:31.849252 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c488162e-54ba-45c6-bdce-429553bfb3b7" (UID: "c488162e-54ba-45c6-bdce-429553bfb3b7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:02:31.849378 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:31.849259 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c488162e-54ba-45c6-bdce-429553bfb3b7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c488162e-54ba-45c6-bdce-429553bfb3b7" (UID: "c488162e-54ba-45c6-bdce-429553bfb3b7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:02:31.849378 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:31.849347 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c488162e-54ba-45c6-bdce-429553bfb3b7" (UID: "c488162e-54ba-45c6-bdce-429553bfb3b7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:02:31.849661 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:31.849391 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c488162e-54ba-45c6-bdce-429553bfb3b7" (UID: "c488162e-54ba-45c6-bdce-429553bfb3b7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:02:31.849661 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:31.849651 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-workload-certs\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:02:31.849770 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:31.849677 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c488162e-54ba-45c6-bdce-429553bfb3b7-istiod-ca-cert\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:02:31.849770 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:31.849690 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-workload-socket\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:02:31.849770 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:31.849702 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-credential-socket\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:02:31.850023 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:31.850002 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-istio-data" (OuterVolumeSpecName: "istio-data") pod "c488162e-54ba-45c6-bdce-429553bfb3b7" (UID: "c488162e-54ba-45c6-bdce-429553bfb3b7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:02:31.851346 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:31.851321 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c488162e-54ba-45c6-bdce-429553bfb3b7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c488162e-54ba-45c6-bdce-429553bfb3b7" (UID: "c488162e-54ba-45c6-bdce-429553bfb3b7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 18:02:31.851464 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:31.851408 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c488162e-54ba-45c6-bdce-429553bfb3b7-istio-token" (OuterVolumeSpecName: "istio-token") pod "c488162e-54ba-45c6-bdce-429553bfb3b7" (UID: "c488162e-54ba-45c6-bdce-429553bfb3b7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:02:31.851594 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:31.851577 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c488162e-54ba-45c6-bdce-429553bfb3b7-kube-api-access-9kd7p" (OuterVolumeSpecName: "kube-api-access-9kd7p") pod "c488162e-54ba-45c6-bdce-429553bfb3b7" (UID: "c488162e-54ba-45c6-bdce-429553bfb3b7"). InnerVolumeSpecName "kube-api-access-9kd7p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:02:31.851665 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:31.851648 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c488162e-54ba-45c6-bdce-429553bfb3b7" (UID: "c488162e-54ba-45c6-bdce-429553bfb3b7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:02:31.951165 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:31.951127 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-istio-envoy\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:02:31.951165 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:31.951158 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c488162e-54ba-45c6-bdce-429553bfb3b7-istio-podinfo\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:02:31.951165 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:31.951167 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c488162e-54ba-45c6-bdce-429553bfb3b7-istio-token\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:02:31.951165 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:31.951174 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c488162e-54ba-45c6-bdce-429553bfb3b7-istio-data\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:02:31.951472 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:31.951182 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kd7p\" (UniqueName: \"kubernetes.io/projected/c488162e-54ba-45c6-bdce-429553bfb3b7-kube-api-access-9kd7p\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:02:32.410210 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.410175 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj"] Jul 07 18:02:32.410720 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.410703 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c488162e-54ba-45c6-bdce-429553bfb3b7" containerName="istio-proxy" Jul 07 18:02:32.410775 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.410723 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="c488162e-54ba-45c6-bdce-429553bfb3b7" containerName="istio-proxy" Jul 07 18:02:32.410775 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.410743 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c488162e-54ba-45c6-bdce-429553bfb3b7" containerName="istio-proxy" Jul 07 18:02:32.410775 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.410751 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="c488162e-54ba-45c6-bdce-429553bfb3b7" containerName="istio-proxy" Jul 07 18:02:32.410879 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.410837 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="c488162e-54ba-45c6-bdce-429553bfb3b7" containerName="istio-proxy" Jul 07 18:02:32.410879 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.410847 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="c488162e-54ba-45c6-bdce-429553bfb3b7" containerName="istio-proxy" Jul 07 18:02:32.413090 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.413071 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:32.415187 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.415168 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-237040df-openshift-default-dockercfg-ntrs6\"" Jul 07 18:02:32.425452 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.425420 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj"] Jul 07 18:02:32.486550 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.486522 2552 generic.go:356] "Generic (PLEG): container finished" podID="c488162e-54ba-45c6-bdce-429553bfb3b7" containerID="c1003510457c2f07ea9ed3406c5c73045ee983fa94e0d86a921c40dffd7bbac2" exitCode=0 Jul 07 18:02:32.486726 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.486567 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" event={"ID":"c488162e-54ba-45c6-bdce-429553bfb3b7","Type":"ContainerDied","Data":"c1003510457c2f07ea9ed3406c5c73045ee983fa94e0d86a921c40dffd7bbac2"} Jul 07 18:02:32.486726 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.486592 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" Jul 07 18:02:32.486726 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.486617 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d" event={"ID":"c488162e-54ba-45c6-bdce-429553bfb3b7","Type":"ContainerDied","Data":"07d3762b0e8cff01d30d37e04a87d0b9533e8f7d5cf035a753759bc62ffd9405"} Jul 07 18:02:32.486726 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.486642 2552 scope.go:117] "RemoveContainer" containerID="c1003510457c2f07ea9ed3406c5c73045ee983fa94e0d86a921c40dffd7bbac2" Jul 07 18:02:32.495656 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.495636 2552 scope.go:117] "RemoveContainer" containerID="548d80bd4a72c116cc9be3a8babf82530c49a5e5dea9e6244f0819a1c2033427" Jul 07 18:02:32.503720 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.503589 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d"] Jul 07 18:02:32.505734 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.505719 2552 scope.go:117] "RemoveContainer" containerID="c1003510457c2f07ea9ed3406c5c73045ee983fa94e0d86a921c40dffd7bbac2" Jul 07 18:02:32.506012 ip-10-0-131-96 kubenswrapper[2552]: E0707 18:02:32.505987 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1003510457c2f07ea9ed3406c5c73045ee983fa94e0d86a921c40dffd7bbac2\": container with ID starting with c1003510457c2f07ea9ed3406c5c73045ee983fa94e0d86a921c40dffd7bbac2 not found: ID does not exist" containerID="c1003510457c2f07ea9ed3406c5c73045ee983fa94e0d86a921c40dffd7bbac2" Jul 07 18:02:32.506069 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.506023 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1003510457c2f07ea9ed3406c5c73045ee983fa94e0d86a921c40dffd7bbac2"} err="failed to get container status \"c1003510457c2f07ea9ed3406c5c73045ee983fa94e0d86a921c40dffd7bbac2\": rpc error: code = NotFound desc = could not find container \"c1003510457c2f07ea9ed3406c5c73045ee983fa94e0d86a921c40dffd7bbac2\": container with ID starting with c1003510457c2f07ea9ed3406c5c73045ee983fa94e0d86a921c40dffd7bbac2 not found: ID does not exist" Jul 07 18:02:32.506069 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.506046 2552 scope.go:117] "RemoveContainer" containerID="548d80bd4a72c116cc9be3a8babf82530c49a5e5dea9e6244f0819a1c2033427" Jul 07 18:02:32.506342 ip-10-0-131-96 kubenswrapper[2552]: E0707 18:02:32.506312 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"548d80bd4a72c116cc9be3a8babf82530c49a5e5dea9e6244f0819a1c2033427\": container with ID starting with 548d80bd4a72c116cc9be3a8babf82530c49a5e5dea9e6244f0819a1c2033427 not found: ID does not exist" containerID="548d80bd4a72c116cc9be3a8babf82530c49a5e5dea9e6244f0819a1c2033427" Jul 07 18:02:32.506448 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.506344 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"548d80bd4a72c116cc9be3a8babf82530c49a5e5dea9e6244f0819a1c2033427"} err="failed to get container status \"548d80bd4a72c116cc9be3a8babf82530c49a5e5dea9e6244f0819a1c2033427\": rpc error: code = NotFound desc = could not find container \"548d80bd4a72c116cc9be3a8babf82530c49a5e5dea9e6244f0819a1c2033427\": container with ID starting with 548d80bd4a72c116cc9be3a8babf82530c49a5e5dea9e6244f0819a1c2033427 not found: ID does not exist" Jul 07 18:02:32.506977 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.506960 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b78dfc41-openshift-default-5c5cbd587c-xsw4d"] Jul 07 18:02:32.556404 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.556368 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-workload-socket\") pod \"e2e-derive-237040df-openshift-default-6457cf7f9-mncfj\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:32.556567 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.556412 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-credential-socket\") pod \"e2e-derive-237040df-openshift-default-6457cf7f9-mncfj\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:32.556567 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.556437 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-istio-data\") pod \"e2e-derive-237040df-openshift-default-6457cf7f9-mncfj\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:32.556567 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.556481 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkkln\" (UniqueName: \"kubernetes.io/projected/f10e16de-f579-4251-89c9-0cab9b23d63e-kube-api-access-gkkln\") pod \"e2e-derive-237040df-openshift-default-6457cf7f9-mncfj\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:32.556696 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.556570 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f10e16de-f579-4251-89c9-0cab9b23d63e-istiod-ca-cert\") pod \"e2e-derive-237040df-openshift-default-6457cf7f9-mncfj\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:32.556696 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.556620 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f10e16de-f579-4251-89c9-0cab9b23d63e-istio-token\") pod \"e2e-derive-237040df-openshift-default-6457cf7f9-mncfj\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:32.556798 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.556702 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-istio-envoy\") pod \"e2e-derive-237040df-openshift-default-6457cf7f9-mncfj\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:32.556798 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.556734 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f10e16de-f579-4251-89c9-0cab9b23d63e-istio-podinfo\") pod \"e2e-derive-237040df-openshift-default-6457cf7f9-mncfj\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:32.556798 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.556769 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-workload-certs\") pod \"e2e-derive-237040df-openshift-default-6457cf7f9-mncfj\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:32.657731 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.657692 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f10e16de-f579-4251-89c9-0cab9b23d63e-istio-token\") pod \"e2e-derive-237040df-openshift-default-6457cf7f9-mncfj\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:32.657914 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.657773 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-istio-envoy\") pod \"e2e-derive-237040df-openshift-default-6457cf7f9-mncfj\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:32.657914 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.657799 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f10e16de-f579-4251-89c9-0cab9b23d63e-istio-podinfo\") pod \"e2e-derive-237040df-openshift-default-6457cf7f9-mncfj\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:32.657914 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.657827 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-workload-certs\") pod \"e2e-derive-237040df-openshift-default-6457cf7f9-mncfj\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:32.657914 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.657869 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-workload-socket\") pod \"e2e-derive-237040df-openshift-default-6457cf7f9-mncfj\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:32.657914 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.657895 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-credential-socket\") pod \"e2e-derive-237040df-openshift-default-6457cf7f9-mncfj\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:32.658181 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.657916 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-istio-data\") pod \"e2e-derive-237040df-openshift-default-6457cf7f9-mncfj\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:32.658181 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.657939 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkkln\" (UniqueName: \"kubernetes.io/projected/f10e16de-f579-4251-89c9-0cab9b23d63e-kube-api-access-gkkln\") pod \"e2e-derive-237040df-openshift-default-6457cf7f9-mncfj\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:32.658181 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.657974 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f10e16de-f579-4251-89c9-0cab9b23d63e-istiod-ca-cert\") pod \"e2e-derive-237040df-openshift-default-6457cf7f9-mncfj\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:32.658354 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.658291 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-workload-socket\") pod \"e2e-derive-237040df-openshift-default-6457cf7f9-mncfj\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:32.658354 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.658342 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-istio-data\") pod \"e2e-derive-237040df-openshift-default-6457cf7f9-mncfj\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:32.658460 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.658400 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-workload-certs\") pod \"e2e-derive-237040df-openshift-default-6457cf7f9-mncfj\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:32.658460 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.658420 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-credential-socket\") pod \"e2e-derive-237040df-openshift-default-6457cf7f9-mncfj\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:32.658740 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.658720 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f10e16de-f579-4251-89c9-0cab9b23d63e-istiod-ca-cert\") pod \"e2e-derive-237040df-openshift-default-6457cf7f9-mncfj\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:32.659885 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.659865 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-istio-envoy\") pod \"e2e-derive-237040df-openshift-default-6457cf7f9-mncfj\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:32.660474 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.660427 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f10e16de-f579-4251-89c9-0cab9b23d63e-istio-podinfo\") pod \"e2e-derive-237040df-openshift-default-6457cf7f9-mncfj\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:32.665417 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.665397 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f10e16de-f579-4251-89c9-0cab9b23d63e-istio-token\") pod \"e2e-derive-237040df-openshift-default-6457cf7f9-mncfj\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:32.665519 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.665460 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkkln\" (UniqueName: \"kubernetes.io/projected/f10e16de-f579-4251-89c9-0cab9b23d63e-kube-api-access-gkkln\") pod \"e2e-derive-237040df-openshift-default-6457cf7f9-mncfj\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:32.726057 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.726028 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:32.862961 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.862931 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj"] Jul 07 18:02:32.864416 ip-10-0-131-96 kubenswrapper[2552]: W0707 18:02:32.864394 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf10e16de_f579_4251_89c9_0cab9b23d63e.slice/crio-03ad8f447b8b4fb2910a159bda415db291fdb24e110e1997567560657636393e WatchSource:0}: Error finding container 03ad8f447b8b4fb2910a159bda415db291fdb24e110e1997567560657636393e: Status 404 returned error can't find the container with id 03ad8f447b8b4fb2910a159bda415db291fdb24e110e1997567560657636393e Jul 07 18:02:32.866530 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.866495 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:02:32.866612 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.866561 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:02:32.866612 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:32.866589 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:02:33.494805 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:33.494771 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" event={"ID":"f10e16de-f579-4251-89c9-0cab9b23d63e","Type":"ContainerStarted","Data":"fca7b1c06ca7aad078929e09b1165c3c2f9608d43b27526849e5f8d7f9bb4f37"} Jul 07 18:02:33.494982 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:33.494830 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" event={"ID":"f10e16de-f579-4251-89c9-0cab9b23d63e","Type":"ContainerStarted","Data":"03ad8f447b8b4fb2910a159bda415db291fdb24e110e1997567560657636393e"} Jul 07 18:02:33.520473 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:33.520424 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" podStartSLOduration=1.520407761 podStartE2EDuration="1.520407761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:02:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:02:33.51850272 +0000 UTC m=+1554.100509467" watchObservedRunningTime="2026-07-07 18:02:33.520407761 +0000 UTC m=+1554.102414509" Jul 07 18:02:33.726890 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:33.726847 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:33.734798 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:33.734770 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:33.972940 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:33.972905 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c488162e-54ba-45c6-bdce-429553bfb3b7" path="/var/lib/kubelet/pods/c488162e-54ba-45c6-bdce-429553bfb3b7/volumes" Jul 07 18:02:34.500413 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:34.500379 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:34.501658 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:34.501635 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:36.353534 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:36.353502 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:02:38.196679 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:38.196634 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj"] Jul 07 18:02:38.197166 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:38.196843 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" podUID="f10e16de-f579-4251-89c9-0cab9b23d63e" containerName="istio-proxy" containerID="cri-o://fca7b1c06ca7aad078929e09b1165c3c2f9608d43b27526849e5f8d7f9bb4f37" gracePeriod=30 Jul 07 18:02:43.957370 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:43.957344 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:44.087538 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.087439 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-workload-socket\") pod \"f10e16de-f579-4251-89c9-0cab9b23d63e\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " Jul 07 18:02:44.087538 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.087486 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-istio-envoy\") pod \"f10e16de-f579-4251-89c9-0cab9b23d63e\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " Jul 07 18:02:44.087538 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.087514 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f10e16de-f579-4251-89c9-0cab9b23d63e-istio-podinfo\") pod \"f10e16de-f579-4251-89c9-0cab9b23d63e\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " Jul 07 18:02:44.087538 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.087538 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-workload-certs\") pod \"f10e16de-f579-4251-89c9-0cab9b23d63e\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " Jul 07 18:02:44.087864 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.087573 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-istio-data\") pod \"f10e16de-f579-4251-89c9-0cab9b23d63e\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " Jul 07 18:02:44.087864 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.087620 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f10e16de-f579-4251-89c9-0cab9b23d63e-istiod-ca-cert\") pod \"f10e16de-f579-4251-89c9-0cab9b23d63e\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " Jul 07 18:02:44.087864 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.087649 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkkln\" (UniqueName: \"kubernetes.io/projected/f10e16de-f579-4251-89c9-0cab9b23d63e-kube-api-access-gkkln\") pod \"f10e16de-f579-4251-89c9-0cab9b23d63e\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " Jul 07 18:02:44.087864 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.087693 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-credential-socket\") pod \"f10e16de-f579-4251-89c9-0cab9b23d63e\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " Jul 07 18:02:44.087864 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.087732 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f10e16de-f579-4251-89c9-0cab9b23d63e-istio-token\") pod \"f10e16de-f579-4251-89c9-0cab9b23d63e\" (UID: \"f10e16de-f579-4251-89c9-0cab9b23d63e\") " Jul 07 18:02:44.087864 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.087783 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f10e16de-f579-4251-89c9-0cab9b23d63e" (UID: "f10e16de-f579-4251-89c9-0cab9b23d63e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:02:44.088191 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.087886 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f10e16de-f579-4251-89c9-0cab9b23d63e" (UID: "f10e16de-f579-4251-89c9-0cab9b23d63e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:02:44.088191 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.088060 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f10e16de-f579-4251-89c9-0cab9b23d63e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f10e16de-f579-4251-89c9-0cab9b23d63e" (UID: "f10e16de-f579-4251-89c9-0cab9b23d63e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:02:44.088191 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.088112 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-workload-certs\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:02:44.088191 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.088132 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-workload-socket\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:02:44.088445 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.088370 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f10e16de-f579-4251-89c9-0cab9b23d63e" (UID: "f10e16de-f579-4251-89c9-0cab9b23d63e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:02:44.088494 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.088466 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-istio-data" (OuterVolumeSpecName: "istio-data") pod "f10e16de-f579-4251-89c9-0cab9b23d63e" (UID: "f10e16de-f579-4251-89c9-0cab9b23d63e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:02:44.089845 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.089819 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f10e16de-f579-4251-89c9-0cab9b23d63e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f10e16de-f579-4251-89c9-0cab9b23d63e" (UID: "f10e16de-f579-4251-89c9-0cab9b23d63e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 18:02:44.089975 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.089918 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f10e16de-f579-4251-89c9-0cab9b23d63e" (UID: "f10e16de-f579-4251-89c9-0cab9b23d63e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:02:44.089975 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.089927 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f10e16de-f579-4251-89c9-0cab9b23d63e-kube-api-access-gkkln" (OuterVolumeSpecName: "kube-api-access-gkkln") pod "f10e16de-f579-4251-89c9-0cab9b23d63e" (UID: "f10e16de-f579-4251-89c9-0cab9b23d63e"). InnerVolumeSpecName "kube-api-access-gkkln". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:02:44.089975 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.089952 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f10e16de-f579-4251-89c9-0cab9b23d63e-istio-token" (OuterVolumeSpecName: "istio-token") pod "f10e16de-f579-4251-89c9-0cab9b23d63e" (UID: "f10e16de-f579-4251-89c9-0cab9b23d63e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:02:44.189136 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.189100 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f10e16de-f579-4251-89c9-0cab9b23d63e-istiod-ca-cert\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:02:44.189136 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.189129 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkkln\" (UniqueName: \"kubernetes.io/projected/f10e16de-f579-4251-89c9-0cab9b23d63e-kube-api-access-gkkln\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:02:44.189136 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.189138 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-credential-socket\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:02:44.189136 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.189146 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f10e16de-f579-4251-89c9-0cab9b23d63e-istio-token\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:02:44.189437 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.189155 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-istio-envoy\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:02:44.189437 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.189163 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f10e16de-f579-4251-89c9-0cab9b23d63e-istio-podinfo\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:02:44.189437 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.189171 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f10e16de-f579-4251-89c9-0cab9b23d63e-istio-data\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:02:44.569649 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.569608 2552 generic.go:356] "Generic (PLEG): container finished" podID="f10e16de-f579-4251-89c9-0cab9b23d63e" containerID="fca7b1c06ca7aad078929e09b1165c3c2f9608d43b27526849e5f8d7f9bb4f37" exitCode=0 Jul 07 18:02:44.569869 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.569672 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" Jul 07 18:02:44.569869 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.569693 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" event={"ID":"f10e16de-f579-4251-89c9-0cab9b23d63e","Type":"ContainerDied","Data":"fca7b1c06ca7aad078929e09b1165c3c2f9608d43b27526849e5f8d7f9bb4f37"} Jul 07 18:02:44.569869 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.569789 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj" event={"ID":"f10e16de-f579-4251-89c9-0cab9b23d63e","Type":"ContainerDied","Data":"03ad8f447b8b4fb2910a159bda415db291fdb24e110e1997567560657636393e"} Jul 07 18:02:44.569869 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.569812 2552 scope.go:117] "RemoveContainer" containerID="fca7b1c06ca7aad078929e09b1165c3c2f9608d43b27526849e5f8d7f9bb4f37" Jul 07 18:02:44.582711 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.582682 2552 scope.go:117] "RemoveContainer" containerID="fca7b1c06ca7aad078929e09b1165c3c2f9608d43b27526849e5f8d7f9bb4f37" Jul 07 18:02:44.583014 ip-10-0-131-96 kubenswrapper[2552]: E0707 18:02:44.582992 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fca7b1c06ca7aad078929e09b1165c3c2f9608d43b27526849e5f8d7f9bb4f37\": container with ID starting with fca7b1c06ca7aad078929e09b1165c3c2f9608d43b27526849e5f8d7f9bb4f37 not found: ID does not exist" containerID="fca7b1c06ca7aad078929e09b1165c3c2f9608d43b27526849e5f8d7f9bb4f37" Jul 07 18:02:44.583083 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.583027 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fca7b1c06ca7aad078929e09b1165c3c2f9608d43b27526849e5f8d7f9bb4f37"} err="failed to get container status \"fca7b1c06ca7aad078929e09b1165c3c2f9608d43b27526849e5f8d7f9bb4f37\": rpc error: code = NotFound desc = could not find container \"fca7b1c06ca7aad078929e09b1165c3c2f9608d43b27526849e5f8d7f9bb4f37\": container with ID starting with fca7b1c06ca7aad078929e09b1165c3c2f9608d43b27526849e5f8d7f9bb4f37 not found: ID does not exist" Jul 07 18:02:44.595221 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.595194 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj"] Jul 07 18:02:44.601462 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:44.601437 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-237040df-openshift-default-6457cf7f9-mncfj"] Jul 07 18:02:45.971435 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:45.971396 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f10e16de-f579-4251-89c9-0cab9b23d63e" path="/var/lib/kubelet/pods/f10e16de-f579-4251-89c9-0cab9b23d63e/volumes" Jul 07 18:02:48.258654 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:02:48.258620 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:04:06.151242 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:04:06.151209 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:04:13.656756 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:04:13.656721 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:04:20.855364 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:04:20.855329 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:04:28.154063 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:04:28.154032 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:04:39.048368 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:04:39.048331 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:05:09.857282 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:05:09.857200 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:05:20.255426 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:05:20.255388 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:05:39.258219 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:05:39.258182 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:05:52.758001 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:05:52.757963 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:06:32.453870 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:06:32.453799 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:06:39.950153 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:06:39.950125 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/ovn-acl-logging/0.log" Jul 07 18:06:39.965929 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:06:39.965905 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/ovn-acl-logging/0.log" Jul 07 18:06:41.357067 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:06:41.357033 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:06:53.657232 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:06:53.657196 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:07:38.673965 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.673925 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk"] Jul 07 18:07:38.674529 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.674461 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f10e16de-f579-4251-89c9-0cab9b23d63e" containerName="istio-proxy" Jul 07 18:07:38.674529 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.674483 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f10e16de-f579-4251-89c9-0cab9b23d63e" containerName="istio-proxy" Jul 07 18:07:38.674658 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.674575 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="f10e16de-f579-4251-89c9-0cab9b23d63e" containerName="istio-proxy" Jul 07 18:07:38.677678 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.677656 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:38.679705 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.679682 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-24f3c9-openshift-default-dockercfg-5rktc\"" Jul 07 18:07:38.691224 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.691193 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk"] Jul 07 18:07:38.802335 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.802283 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istio-data\") pod \"e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:38.802513 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.802348 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr4x5\" (UniqueName: \"kubernetes.io/projected/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-kube-api-access-nr4x5\") pod \"e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:38.802513 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.802418 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istio-podinfo\") pod \"e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:38.802513 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.802467 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-workload-certs\") pod \"e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:38.802640 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.802559 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-credential-socket\") pod \"e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:38.802640 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.802595 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istio-token\") pod \"e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:38.802713 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.802640 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-workload-socket\") pod \"e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:38.802713 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.802673 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istiod-ca-cert\") pod \"e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:38.802787 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.802715 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istio-envoy\") pod \"e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:38.903718 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.903661 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-workload-socket\") pod \"e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:38.903718 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.903723 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istiod-ca-cert\") pod \"e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:38.903976 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.903762 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istio-envoy\") pod \"e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:38.903976 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.903793 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istio-data\") pod \"e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:38.903976 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.903825 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr4x5\" (UniqueName: \"kubernetes.io/projected/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-kube-api-access-nr4x5\") pod \"e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:38.903976 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.903849 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istio-podinfo\") pod \"e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:38.903976 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.903878 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-workload-certs\") pod \"e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:38.904267 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.904209 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-workload-socket\") pod \"e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:38.904354 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.904260 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istio-data\") pod \"e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:38.904446 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.904415 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-workload-certs\") pod \"e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:38.904602 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.904579 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-credential-socket\") pod \"e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:38.904706 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.904632 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istio-token\") pod \"e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:38.904904 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.904877 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-credential-socket\") pod \"e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:38.904994 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.904942 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istiod-ca-cert\") pod \"e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:38.906613 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.906587 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istio-envoy\") pod \"e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:38.907237 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.907212 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istio-podinfo\") pod \"e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:38.914496 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.914467 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr4x5\" (UniqueName: \"kubernetes.io/projected/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-kube-api-access-nr4x5\") pod \"e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:38.914638 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.914524 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istio-token\") pod \"e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:38.988229 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:38.988134 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:39.139884 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:39.139857 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk"] Jul 07 18:07:39.142130 ip-10-0-131-96 kubenswrapper[2552]: W0707 18:07:39.142102 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce4c891f_4c4f_47c0_9e32_c4147e1b80ca.slice/crio-1ebabdb1d4f15a0554ae6ed85873ae48d71c0dff40d184a11e447f31680bb7a8 WatchSource:0}: Error finding container 1ebabdb1d4f15a0554ae6ed85873ae48d71c0dff40d184a11e447f31680bb7a8: Status 404 returned error can't find the container with id 1ebabdb1d4f15a0554ae6ed85873ae48d71c0dff40d184a11e447f31680bb7a8 Jul 07 18:07:39.144418 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:39.144381 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:07:39.144497 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:39.144458 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:07:39.144538 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:39.144492 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:07:39.760794 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:39.760761 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:07:40.086209 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:40.086104 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" event={"ID":"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca","Type":"ContainerStarted","Data":"96e12ec4ef2a127a2d1e4a983eb72ff94670c643c051bf5e8bf7fa3bbcbcdd5a"} Jul 07 18:07:40.086209 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:40.086170 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" event={"ID":"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca","Type":"ContainerStarted","Data":"1ebabdb1d4f15a0554ae6ed85873ae48d71c0dff40d184a11e447f31680bb7a8"} Jul 07 18:07:40.106464 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:40.106414 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" podStartSLOduration=2.106396473 podStartE2EDuration="2.106396473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:07:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:07:40.104452276 +0000 UTC m=+1860.686459024" watchObservedRunningTime="2026-07-07 18:07:40.106396473 +0000 UTC m=+1860.688403218" Jul 07 18:07:40.990317 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:40.990269 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:40.995661 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:40.995633 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:41.091376 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:41.091347 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:41.092433 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:41.092413 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:53.167357 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:53.167325 2552 generic.go:356] "Generic (PLEG): container finished" podID="ce4c891f-4c4f-47c0-9e32-c4147e1b80ca" containerID="96e12ec4ef2a127a2d1e4a983eb72ff94670c643c051bf5e8bf7fa3bbcbcdd5a" exitCode=0 Jul 07 18:07:53.167783 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:53.167379 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" event={"ID":"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca","Type":"ContainerDied","Data":"96e12ec4ef2a127a2d1e4a983eb72ff94670c643c051bf5e8bf7fa3bbcbcdd5a"} Jul 07 18:07:53.167783 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:53.167766 2552 scope.go:117] "RemoveContainer" containerID="96e12ec4ef2a127a2d1e4a983eb72ff94670c643c051bf5e8bf7fa3bbcbcdd5a" Jul 07 18:07:53.168820 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:53.168787 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:07:53.168936 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:53.168873 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:07:53.168936 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:53.168921 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:07:53.765728 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:53.765694 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:07:54.174577 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:54.174546 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" event={"ID":"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca","Type":"ContainerStarted","Data":"baa17a5f4e723ba7c4bd960b248085def16be5b65f1e4b9953313f57a7f65002"} Jul 07 18:07:54.988850 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:54.988807 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:54.990018 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:54.989988 2552 patch_prober.go:28] interesting pod/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 07 18:07:54.990135 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:54.990053 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" podUID="ce4c891f-4c4f-47c0-9e32-c4147e1b80ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 07 18:07:55.988670 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:55.988628 2552 patch_prober.go:28] interesting pod/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 07 18:07:55.989144 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:55.988690 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" podUID="ce4c891f-4c4f-47c0-9e32-c4147e1b80ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 07 18:07:56.091675 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:56.091633 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:56.989094 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:56.989054 2552 patch_prober.go:28] interesting pod/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 07 18:07:56.989546 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:56.989111 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" podUID="ce4c891f-4c4f-47c0-9e32-c4147e1b80ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 07 18:07:58.043928 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:58.043866 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:07:58.045155 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:07:58.045132 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:08:08.361976 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:08:08.361875 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:08:38.059093 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:08:38.058994 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:09:15.361029 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:09:15.360994 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:09:58.453782 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:09:58.453747 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:10:01.404498 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:01.404466 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk"] Jul 07 18:10:01.404945 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:01.404763 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" podUID="ce4c891f-4c4f-47c0-9e32-c4147e1b80ca" containerName="istio-proxy" containerID="cri-o://baa17a5f4e723ba7c4bd960b248085def16be5b65f1e4b9953313f57a7f65002" gracePeriod=30 Jul 07 18:10:02.302722 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.302686 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v"] Jul 07 18:10:02.306198 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.306178 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:02.308467 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.308445 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-b6a8e2-openshift-default-dockercfg-6tkgd\"" Jul 07 18:10:02.315671 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.315649 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v"] Jul 07 18:10:02.369942 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.369907 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4452dccb-8276-475b-a8d6-da000e90cee6-istiod-ca-cert\") pod \"e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:02.370114 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.369955 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-istio-envoy\") pod \"e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:02.370114 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.369971 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-istio-data\") pod \"e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:02.370114 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.370037 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-credential-socket\") pod \"e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:02.370114 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.370092 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-workload-socket\") pod \"e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:02.370256 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.370119 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4452dccb-8276-475b-a8d6-da000e90cee6-istio-token\") pod \"e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:02.370256 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.370158 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-workload-certs\") pod \"e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:02.370256 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.370179 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4452dccb-8276-475b-a8d6-da000e90cee6-istio-podinfo\") pod \"e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:02.370256 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.370237 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4xcb\" (UniqueName: \"kubernetes.io/projected/4452dccb-8276-475b-a8d6-da000e90cee6-kube-api-access-v4xcb\") pod \"e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:02.471279 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.471243 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-workload-certs\") pod \"e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:02.471279 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.471280 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4452dccb-8276-475b-a8d6-da000e90cee6-istio-podinfo\") pod \"e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:02.471773 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.471470 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4xcb\" (UniqueName: \"kubernetes.io/projected/4452dccb-8276-475b-a8d6-da000e90cee6-kube-api-access-v4xcb\") pod \"e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:02.471773 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.471526 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4452dccb-8276-475b-a8d6-da000e90cee6-istiod-ca-cert\") pod \"e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:02.471773 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.471590 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-istio-envoy\") pod \"e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:02.471773 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.471614 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-istio-data\") pod \"e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:02.471773 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.471651 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-credential-socket\") pod \"e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:02.471773 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.471692 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-workload-socket\") pod \"e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:02.471773 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.471722 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4452dccb-8276-475b-a8d6-da000e90cee6-istio-token\") pod \"e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:02.471773 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.471742 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-workload-certs\") pod \"e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:02.472224 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.472042 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-credential-socket\") pod \"e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:02.472224 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.472166 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-workload-socket\") pod \"e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:02.472350 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.472333 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4452dccb-8276-475b-a8d6-da000e90cee6-istiod-ca-cert\") pod \"e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:02.472395 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.472356 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-istio-data\") pod \"e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:02.473905 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.473872 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-istio-envoy\") pod \"e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:02.474056 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.474040 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4452dccb-8276-475b-a8d6-da000e90cee6-istio-podinfo\") pod \"e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:02.478847 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.478827 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4452dccb-8276-475b-a8d6-da000e90cee6-istio-token\") pod \"e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:02.479041 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.479022 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4xcb\" (UniqueName: \"kubernetes.io/projected/4452dccb-8276-475b-a8d6-da000e90cee6-kube-api-access-v4xcb\") pod \"e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:02.617428 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.617341 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:02.760491 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.760464 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v"] Jul 07 18:10:02.761896 ip-10-0-131-96 kubenswrapper[2552]: W0707 18:10:02.761870 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4452dccb_8276_475b_a8d6_da000e90cee6.slice/crio-bfa4a5a9e6b28a4aa9316519d365ad9eb5f9498ba97700bb91cca86c9cd31220 WatchSource:0}: Error finding container bfa4a5a9e6b28a4aa9316519d365ad9eb5f9498ba97700bb91cca86c9cd31220: Status 404 returned error can't find the container with id bfa4a5a9e6b28a4aa9316519d365ad9eb5f9498ba97700bb91cca86c9cd31220 Jul 07 18:10:02.764202 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.764164 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:10:02.764283 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.764247 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:10:02.764343 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.764286 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:10:02.862038 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.862005 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" event={"ID":"4452dccb-8276-475b-a8d6-da000e90cee6","Type":"ContainerStarted","Data":"8e1fab545a27c0742a54a88d009f3abdf56ffb1ba8df6352735658b15336ab56"} Jul 07 18:10:02.862211 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.862068 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" event={"ID":"4452dccb-8276-475b-a8d6-da000e90cee6","Type":"ContainerStarted","Data":"bfa4a5a9e6b28a4aa9316519d365ad9eb5f9498ba97700bb91cca86c9cd31220"} Jul 07 18:10:02.880379 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:02.880268 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" podStartSLOduration=0.880251386 podStartE2EDuration="880.251386ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:10:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:10:02.87916208 +0000 UTC m=+2003.461168848" watchObservedRunningTime="2026-07-07 18:10:02.880251386 +0000 UTC m=+2003.462258132" Jul 07 18:10:03.617816 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:03.617765 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:03.623005 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:03.622969 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:03.868365 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:03.868277 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:03.869369 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:03.869352 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:06.653391 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.653366 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:10:06.710704 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.710620 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-credential-socket\") pod \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " Jul 07 18:10:06.710704 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.710661 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istiod-ca-cert\") pod \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " Jul 07 18:10:06.710704 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.710678 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nr4x5\" (UniqueName: \"kubernetes.io/projected/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-kube-api-access-nr4x5\") pod \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " Jul 07 18:10:06.710704 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.710705 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istio-envoy\") pod \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " Jul 07 18:10:06.711039 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.710740 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-workload-socket\") pod \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " Jul 07 18:10:06.711039 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.710772 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istio-token\") pod \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " Jul 07 18:10:06.711039 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.710821 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istio-data\") pod \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " Jul 07 18:10:06.711039 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.710856 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istio-podinfo\") pod \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " Jul 07 18:10:06.711039 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.710882 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-workload-certs\") pod \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\" (UID: \"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca\") " Jul 07 18:10:06.711039 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.710987 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ce4c891f-4c4f-47c0-9e32-c4147e1b80ca" (UID: "ce4c891f-4c4f-47c0-9e32-c4147e1b80ca"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:10:06.711382 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.711196 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ce4c891f-4c4f-47c0-9e32-c4147e1b80ca" (UID: "ce4c891f-4c4f-47c0-9e32-c4147e1b80ca"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:10:06.711382 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.711228 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-credential-socket\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:10:06.711382 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.711327 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ce4c891f-4c4f-47c0-9e32-c4147e1b80ca" (UID: "ce4c891f-4c4f-47c0-9e32-c4147e1b80ca"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:10:06.711382 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.711374 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ce4c891f-4c4f-47c0-9e32-c4147e1b80ca" (UID: "ce4c891f-4c4f-47c0-9e32-c4147e1b80ca"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:10:06.711727 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.711706 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istio-data" (OuterVolumeSpecName: "istio-data") pod "ce4c891f-4c4f-47c0-9e32-c4147e1b80ca" (UID: "ce4c891f-4c4f-47c0-9e32-c4147e1b80ca"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:10:06.713092 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.713062 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istio-token" (OuterVolumeSpecName: "istio-token") pod "ce4c891f-4c4f-47c0-9e32-c4147e1b80ca" (UID: "ce4c891f-4c4f-47c0-9e32-c4147e1b80ca"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:10:06.713092 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.713079 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-kube-api-access-nr4x5" (OuterVolumeSpecName: "kube-api-access-nr4x5") pod "ce4c891f-4c4f-47c0-9e32-c4147e1b80ca" (UID: "ce4c891f-4c4f-47c0-9e32-c4147e1b80ca"). InnerVolumeSpecName "kube-api-access-nr4x5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:10:06.713474 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.713456 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ce4c891f-4c4f-47c0-9e32-c4147e1b80ca" (UID: "ce4c891f-4c4f-47c0-9e32-c4147e1b80ca"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 18:10:06.713576 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.713499 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ce4c891f-4c4f-47c0-9e32-c4147e1b80ca" (UID: "ce4c891f-4c4f-47c0-9e32-c4147e1b80ca"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:10:06.812463 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.812417 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istiod-ca-cert\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:10:06.812463 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.812464 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nr4x5\" (UniqueName: \"kubernetes.io/projected/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-kube-api-access-nr4x5\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:10:06.812689 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.812481 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istio-envoy\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:10:06.812689 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.812491 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-workload-socket\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:10:06.812689 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.812500 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istio-token\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:10:06.812689 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.812507 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istio-data\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:10:06.812689 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.812514 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-istio-podinfo\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:10:06.812689 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.812521 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca-workload-certs\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:10:06.886705 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.886671 2552 generic.go:356] "Generic (PLEG): container finished" podID="ce4c891f-4c4f-47c0-9e32-c4147e1b80ca" containerID="baa17a5f4e723ba7c4bd960b248085def16be5b65f1e4b9953313f57a7f65002" exitCode=0 Jul 07 18:10:06.886893 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.886719 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" Jul 07 18:10:06.886893 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.886761 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" event={"ID":"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca","Type":"ContainerDied","Data":"baa17a5f4e723ba7c4bd960b248085def16be5b65f1e4b9953313f57a7f65002"} Jul 07 18:10:06.886893 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.886819 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk" event={"ID":"ce4c891f-4c4f-47c0-9e32-c4147e1b80ca","Type":"ContainerDied","Data":"1ebabdb1d4f15a0554ae6ed85873ae48d71c0dff40d184a11e447f31680bb7a8"} Jul 07 18:10:06.886893 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.886844 2552 scope.go:117] "RemoveContainer" containerID="baa17a5f4e723ba7c4bd960b248085def16be5b65f1e4b9953313f57a7f65002" Jul 07 18:10:06.896977 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.896962 2552 scope.go:117] "RemoveContainer" containerID="96e12ec4ef2a127a2d1e4a983eb72ff94670c643c051bf5e8bf7fa3bbcbcdd5a" Jul 07 18:10:06.906604 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.906580 2552 scope.go:117] "RemoveContainer" containerID="baa17a5f4e723ba7c4bd960b248085def16be5b65f1e4b9953313f57a7f65002" Jul 07 18:10:06.906886 ip-10-0-131-96 kubenswrapper[2552]: E0707 18:10:06.906864 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"baa17a5f4e723ba7c4bd960b248085def16be5b65f1e4b9953313f57a7f65002\": container with ID starting with baa17a5f4e723ba7c4bd960b248085def16be5b65f1e4b9953313f57a7f65002 not found: ID does not exist" containerID="baa17a5f4e723ba7c4bd960b248085def16be5b65f1e4b9953313f57a7f65002" Jul 07 18:10:06.906970 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.906896 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baa17a5f4e723ba7c4bd960b248085def16be5b65f1e4b9953313f57a7f65002"} err="failed to get container status \"baa17a5f4e723ba7c4bd960b248085def16be5b65f1e4b9953313f57a7f65002\": rpc error: code = NotFound desc = could not find container \"baa17a5f4e723ba7c4bd960b248085def16be5b65f1e4b9953313f57a7f65002\": container with ID starting with baa17a5f4e723ba7c4bd960b248085def16be5b65f1e4b9953313f57a7f65002 not found: ID does not exist" Jul 07 18:10:06.906970 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.906914 2552 scope.go:117] "RemoveContainer" containerID="96e12ec4ef2a127a2d1e4a983eb72ff94670c643c051bf5e8bf7fa3bbcbcdd5a" Jul 07 18:10:06.907171 ip-10-0-131-96 kubenswrapper[2552]: E0707 18:10:06.907155 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96e12ec4ef2a127a2d1e4a983eb72ff94670c643c051bf5e8bf7fa3bbcbcdd5a\": container with ID starting with 96e12ec4ef2a127a2d1e4a983eb72ff94670c643c051bf5e8bf7fa3bbcbcdd5a not found: ID does not exist" containerID="96e12ec4ef2a127a2d1e4a983eb72ff94670c643c051bf5e8bf7fa3bbcbcdd5a" Jul 07 18:10:06.907213 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.907177 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96e12ec4ef2a127a2d1e4a983eb72ff94670c643c051bf5e8bf7fa3bbcbcdd5a"} err="failed to get container status \"96e12ec4ef2a127a2d1e4a983eb72ff94670c643c051bf5e8bf7fa3bbcbcdd5a\": rpc error: code = NotFound desc = could not find container \"96e12ec4ef2a127a2d1e4a983eb72ff94670c643c051bf5e8bf7fa3bbcbcdd5a\": container with ID starting with 96e12ec4ef2a127a2d1e4a983eb72ff94670c643c051bf5e8bf7fa3bbcbcdd5a not found: ID does not exist" Jul 07 18:10:06.907894 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.907877 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk"] Jul 07 18:10:06.911782 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:06.911752 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-24f3c9-openshift-default-67cdcfc497-bvclk"] Jul 07 18:10:07.971791 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:07.971751 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce4c891f-4c4f-47c0-9e32-c4147e1b80ca" path="/var/lib/kubelet/pods/ce4c891f-4c4f-47c0-9e32-c4147e1b80ca/volumes" Jul 07 18:10:12.754335 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:12.754286 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:10:19.909482 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:19.909444 2552 patch_prober.go:28] interesting pod/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 07 18:10:19.909886 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:19.909522 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" podUID="4452dccb-8276-475b-a8d6-da000e90cee6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 07 18:10:20.965966 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:20.965938 2552 generic.go:356] "Generic (PLEG): container finished" podID="4452dccb-8276-475b-a8d6-da000e90cee6" containerID="8e1fab545a27c0742a54a88d009f3abdf56ffb1ba8df6352735658b15336ab56" exitCode=0 Jul 07 18:10:20.966410 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:20.965986 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" event={"ID":"4452dccb-8276-475b-a8d6-da000e90cee6","Type":"ContainerDied","Data":"8e1fab545a27c0742a54a88d009f3abdf56ffb1ba8df6352735658b15336ab56"} Jul 07 18:10:20.966410 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:20.966277 2552 scope.go:117] "RemoveContainer" containerID="8e1fab545a27c0742a54a88d009f3abdf56ffb1ba8df6352735658b15336ab56" Jul 07 18:10:20.967202 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:20.967173 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:10:20.967323 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:20.967236 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:10:20.967323 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:20.967266 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:10:21.973672 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:21.973636 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" event={"ID":"4452dccb-8276-475b-a8d6-da000e90cee6","Type":"ContainerStarted","Data":"b58bee1778163b2e9c8ad12e499d2af99a2e966454a879640711ca8ae0cd76c8"} Jul 07 18:10:22.618327 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:22.618279 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:22.618663 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:22.618641 2552 patch_prober.go:28] interesting pod/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 07 18:10:22.618836 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:22.618811 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" podUID="4452dccb-8276-475b-a8d6-da000e90cee6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 07 18:10:23.617812 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:23.617765 2552 patch_prober.go:28] interesting pod/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 07 18:10:23.618359 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:23.617834 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" podUID="4452dccb-8276-475b-a8d6-da000e90cee6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 07 18:10:24.618673 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:24.618634 2552 patch_prober.go:28] interesting pod/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 07 18:10:24.619246 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:24.619216 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" podUID="4452dccb-8276-475b-a8d6-da000e90cee6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 07 18:10:25.618530 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:25.618493 2552 patch_prober.go:28] interesting pod/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 07 18:10:25.618870 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:25.618839 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" podUID="4452dccb-8276-475b-a8d6-da000e90cee6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 07 18:10:26.621572 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:26.621541 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:26.622008 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:26.621801 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:26.622455 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:26.622438 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:29.758827 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:29.758773 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:10:32.290856 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:32.290823 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v"] Jul 07 18:10:32.291359 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:32.291133 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" podUID="4452dccb-8276-475b-a8d6-da000e90cee6" containerName="istio-proxy" containerID="cri-o://b58bee1778163b2e9c8ad12e499d2af99a2e966454a879640711ca8ae0cd76c8" gracePeriod=30 Jul 07 18:10:37.570984 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:37.570961 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:37.697638 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:37.697606 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4xcb\" (UniqueName: \"kubernetes.io/projected/4452dccb-8276-475b-a8d6-da000e90cee6-kube-api-access-v4xcb\") pod \"4452dccb-8276-475b-a8d6-da000e90cee6\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " Jul 07 18:10:37.697829 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:37.697659 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-istio-envoy\") pod \"4452dccb-8276-475b-a8d6-da000e90cee6\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " Jul 07 18:10:37.697829 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:37.697676 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-workload-socket\") pod \"4452dccb-8276-475b-a8d6-da000e90cee6\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " Jul 07 18:10:37.697829 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:37.697703 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4452dccb-8276-475b-a8d6-da000e90cee6-istio-token\") pod \"4452dccb-8276-475b-a8d6-da000e90cee6\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " Jul 07 18:10:37.697829 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:37.697727 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4452dccb-8276-475b-a8d6-da000e90cee6-istiod-ca-cert\") pod \"4452dccb-8276-475b-a8d6-da000e90cee6\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " Jul 07 18:10:37.697829 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:37.697760 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-credential-socket\") pod \"4452dccb-8276-475b-a8d6-da000e90cee6\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " Jul 07 18:10:37.697829 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:37.697787 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-istio-data\") pod \"4452dccb-8276-475b-a8d6-da000e90cee6\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " Jul 07 18:10:37.698144 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:37.697834 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4452dccb-8276-475b-a8d6-da000e90cee6-istio-podinfo\") pod \"4452dccb-8276-475b-a8d6-da000e90cee6\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " Jul 07 18:10:37.698144 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:37.697872 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-workload-certs\") pod \"4452dccb-8276-475b-a8d6-da000e90cee6\" (UID: \"4452dccb-8276-475b-a8d6-da000e90cee6\") " Jul 07 18:10:37.698144 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:37.697962 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4452dccb-8276-475b-a8d6-da000e90cee6" (UID: "4452dccb-8276-475b-a8d6-da000e90cee6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:10:37.698295 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:37.698147 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4452dccb-8276-475b-a8d6-da000e90cee6" (UID: "4452dccb-8276-475b-a8d6-da000e90cee6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:10:37.698295 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:37.698155 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-workload-socket\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:10:37.698295 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:37.698190 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4452dccb-8276-475b-a8d6-da000e90cee6" (UID: "4452dccb-8276-475b-a8d6-da000e90cee6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:10:37.698744 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:37.698721 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4452dccb-8276-475b-a8d6-da000e90cee6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4452dccb-8276-475b-a8d6-da000e90cee6" (UID: "4452dccb-8276-475b-a8d6-da000e90cee6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:10:37.698869 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:37.698809 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-istio-data" (OuterVolumeSpecName: "istio-data") pod "4452dccb-8276-475b-a8d6-da000e90cee6" (UID: "4452dccb-8276-475b-a8d6-da000e90cee6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:10:37.700498 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:37.700467 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4452dccb-8276-475b-a8d6-da000e90cee6-istio-token" (OuterVolumeSpecName: "istio-token") pod "4452dccb-8276-475b-a8d6-da000e90cee6" (UID: "4452dccb-8276-475b-a8d6-da000e90cee6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:10:37.700605 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:37.700560 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4452dccb-8276-475b-a8d6-da000e90cee6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4452dccb-8276-475b-a8d6-da000e90cee6" (UID: "4452dccb-8276-475b-a8d6-da000e90cee6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 18:10:37.700605 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:37.700584 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4452dccb-8276-475b-a8d6-da000e90cee6-kube-api-access-v4xcb" (OuterVolumeSpecName: "kube-api-access-v4xcb") pod "4452dccb-8276-475b-a8d6-da000e90cee6" (UID: "4452dccb-8276-475b-a8d6-da000e90cee6"). InnerVolumeSpecName "kube-api-access-v4xcb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:10:37.700696 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:37.700586 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4452dccb-8276-475b-a8d6-da000e90cee6" (UID: "4452dccb-8276-475b-a8d6-da000e90cee6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:10:37.799280 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:37.799243 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4xcb\" (UniqueName: \"kubernetes.io/projected/4452dccb-8276-475b-a8d6-da000e90cee6-kube-api-access-v4xcb\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:10:37.799280 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:37.799281 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-istio-envoy\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:10:37.799487 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:37.799294 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4452dccb-8276-475b-a8d6-da000e90cee6-istio-token\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:10:37.799487 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:37.799339 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4452dccb-8276-475b-a8d6-da000e90cee6-istiod-ca-cert\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:10:37.799487 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:37.799353 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-credential-socket\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:10:37.799487 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:37.799365 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-istio-data\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:10:37.799487 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:37.799377 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4452dccb-8276-475b-a8d6-da000e90cee6-istio-podinfo\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:10:37.799487 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:37.799388 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4452dccb-8276-475b-a8d6-da000e90cee6-workload-certs\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:10:38.063616 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:38.063582 2552 generic.go:356] "Generic (PLEG): container finished" podID="4452dccb-8276-475b-a8d6-da000e90cee6" containerID="b58bee1778163b2e9c8ad12e499d2af99a2e966454a879640711ca8ae0cd76c8" exitCode=0 Jul 07 18:10:38.063787 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:38.063629 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" Jul 07 18:10:38.063787 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:38.063666 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" event={"ID":"4452dccb-8276-475b-a8d6-da000e90cee6","Type":"ContainerDied","Data":"b58bee1778163b2e9c8ad12e499d2af99a2e966454a879640711ca8ae0cd76c8"} Jul 07 18:10:38.063787 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:38.063722 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v" event={"ID":"4452dccb-8276-475b-a8d6-da000e90cee6","Type":"ContainerDied","Data":"bfa4a5a9e6b28a4aa9316519d365ad9eb5f9498ba97700bb91cca86c9cd31220"} Jul 07 18:10:38.063787 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:38.063751 2552 scope.go:117] "RemoveContainer" containerID="b58bee1778163b2e9c8ad12e499d2af99a2e966454a879640711ca8ae0cd76c8" Jul 07 18:10:38.072673 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:38.072654 2552 scope.go:117] "RemoveContainer" containerID="8e1fab545a27c0742a54a88d009f3abdf56ffb1ba8df6352735658b15336ab56" Jul 07 18:10:38.080181 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:38.080159 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v"] Jul 07 18:10:38.081447 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:38.081420 2552 scope.go:117] "RemoveContainer" containerID="b58bee1778163b2e9c8ad12e499d2af99a2e966454a879640711ca8ae0cd76c8" Jul 07 18:10:38.081712 ip-10-0-131-96 kubenswrapper[2552]: E0707 18:10:38.081695 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b58bee1778163b2e9c8ad12e499d2af99a2e966454a879640711ca8ae0cd76c8\": container with ID starting with b58bee1778163b2e9c8ad12e499d2af99a2e966454a879640711ca8ae0cd76c8 not found: ID does not exist" containerID="b58bee1778163b2e9c8ad12e499d2af99a2e966454a879640711ca8ae0cd76c8" Jul 07 18:10:38.081759 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:38.081721 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b58bee1778163b2e9c8ad12e499d2af99a2e966454a879640711ca8ae0cd76c8"} err="failed to get container status \"b58bee1778163b2e9c8ad12e499d2af99a2e966454a879640711ca8ae0cd76c8\": rpc error: code = NotFound desc = could not find container \"b58bee1778163b2e9c8ad12e499d2af99a2e966454a879640711ca8ae0cd76c8\": container with ID starting with b58bee1778163b2e9c8ad12e499d2af99a2e966454a879640711ca8ae0cd76c8 not found: ID does not exist" Jul 07 18:10:38.081759 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:38.081740 2552 scope.go:117] "RemoveContainer" containerID="8e1fab545a27c0742a54a88d009f3abdf56ffb1ba8df6352735658b15336ab56" Jul 07 18:10:38.081986 ip-10-0-131-96 kubenswrapper[2552]: E0707 18:10:38.081968 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e1fab545a27c0742a54a88d009f3abdf56ffb1ba8df6352735658b15336ab56\": container with ID starting with 8e1fab545a27c0742a54a88d009f3abdf56ffb1ba8df6352735658b15336ab56 not found: ID does not exist" containerID="8e1fab545a27c0742a54a88d009f3abdf56ffb1ba8df6352735658b15336ab56" Jul 07 18:10:38.082036 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:38.081992 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e1fab545a27c0742a54a88d009f3abdf56ffb1ba8df6352735658b15336ab56"} err="failed to get container status \"8e1fab545a27c0742a54a88d009f3abdf56ffb1ba8df6352735658b15336ab56\": rpc error: code = NotFound desc = could not find container \"8e1fab545a27c0742a54a88d009f3abdf56ffb1ba8df6352735658b15336ab56\": container with ID starting with 8e1fab545a27c0742a54a88d009f3abdf56ffb1ba8df6352735658b15336ab56 not found: ID does not exist" Jul 07 18:10:38.087501 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:38.087473 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-b6a8e2-openshift-default-9d65456ff-pkq8v"] Jul 07 18:10:39.973871 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:39.973840 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4452dccb-8276-475b-a8d6-da000e90cee6" path="/var/lib/kubelet/pods/4452dccb-8276-475b-a8d6-da000e90cee6/volumes" Jul 07 18:10:40.078674 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.078644 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj"] Jul 07 18:10:40.079326 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.079279 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4452dccb-8276-475b-a8d6-da000e90cee6" containerName="istio-proxy" Jul 07 18:10:40.079326 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.079326 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4452dccb-8276-475b-a8d6-da000e90cee6" containerName="istio-proxy" Jul 07 18:10:40.079517 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.079343 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4452dccb-8276-475b-a8d6-da000e90cee6" containerName="istio-proxy" Jul 07 18:10:40.079517 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.079351 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4452dccb-8276-475b-a8d6-da000e90cee6" containerName="istio-proxy" Jul 07 18:10:40.079517 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.079385 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce4c891f-4c4f-47c0-9e32-c4147e1b80ca" containerName="istio-proxy" Jul 07 18:10:40.079517 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.079393 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce4c891f-4c4f-47c0-9e32-c4147e1b80ca" containerName="istio-proxy" Jul 07 18:10:40.079517 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.079406 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce4c891f-4c4f-47c0-9e32-c4147e1b80ca" containerName="istio-proxy" Jul 07 18:10:40.079517 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.079414 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce4c891f-4c4f-47c0-9e32-c4147e1b80ca" containerName="istio-proxy" Jul 07 18:10:40.079517 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.079505 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce4c891f-4c4f-47c0-9e32-c4147e1b80ca" containerName="istio-proxy" Jul 07 18:10:40.079517 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.079519 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="4452dccb-8276-475b-a8d6-da000e90cee6" containerName="istio-proxy" Jul 07 18:10:40.079908 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.079527 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="4452dccb-8276-475b-a8d6-da000e90cee6" containerName="istio-proxy" Jul 07 18:10:40.079908 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.079536 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce4c891f-4c4f-47c0-9e32-c4147e1b80ca" containerName="istio-proxy" Jul 07 18:10:40.082027 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.082009 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:40.084138 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.084117 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-f78287-openshift-default-dockercfg-9cmvv\"" Jul 07 18:10:40.092887 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.092859 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj"] Jul 07 18:10:40.219189 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.219158 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c243a2cb-9f8d-4188-9dac-693f844822a6-istiod-ca-cert\") pod \"e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:40.219410 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.219199 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-workload-certs\") pod \"e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:40.219410 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.219232 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg77r\" (UniqueName: \"kubernetes.io/projected/c243a2cb-9f8d-4188-9dac-693f844822a6-kube-api-access-pg77r\") pod \"e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:40.219410 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.219276 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-workload-socket\") pod \"e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:40.219410 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.219367 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-istio-envoy\") pod \"e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:40.219647 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.219427 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-istio-data\") pod \"e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:40.219647 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.219457 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c243a2cb-9f8d-4188-9dac-693f844822a6-istio-token\") pod \"e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:40.219647 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.219478 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c243a2cb-9f8d-4188-9dac-693f844822a6-istio-podinfo\") pod \"e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:40.219647 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.219568 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-credential-socket\") pod \"e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:40.320781 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.320694 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg77r\" (UniqueName: \"kubernetes.io/projected/c243a2cb-9f8d-4188-9dac-693f844822a6-kube-api-access-pg77r\") pod \"e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:40.320781 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.320740 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-workload-socket\") pod \"e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:40.320781 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.320762 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-istio-envoy\") pod \"e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:40.321032 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.320892 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-istio-data\") pod \"e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:40.321032 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.320961 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c243a2cb-9f8d-4188-9dac-693f844822a6-istio-token\") pod \"e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:40.321032 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.320986 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c243a2cb-9f8d-4188-9dac-693f844822a6-istio-podinfo\") pod \"e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:40.321175 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.321045 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-credential-socket\") pod \"e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:40.321175 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.321093 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c243a2cb-9f8d-4188-9dac-693f844822a6-istiod-ca-cert\") pod \"e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:40.321175 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.321128 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-workload-certs\") pod \"e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:40.321343 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.321207 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-workload-socket\") pod \"e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:40.321343 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.321255 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-istio-data\") pod \"e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:40.321445 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.321419 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-workload-certs\") pod \"e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:40.321664 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.321637 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-credential-socket\") pod \"e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:40.321789 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.321770 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c243a2cb-9f8d-4188-9dac-693f844822a6-istiod-ca-cert\") pod \"e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:40.322998 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.322969 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-istio-envoy\") pod \"e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:40.323250 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.323233 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c243a2cb-9f8d-4188-9dac-693f844822a6-istio-podinfo\") pod \"e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:40.327642 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.327615 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c243a2cb-9f8d-4188-9dac-693f844822a6-istio-token\") pod \"e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:40.327947 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.327748 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg77r\" (UniqueName: \"kubernetes.io/projected/c243a2cb-9f8d-4188-9dac-693f844822a6-kube-api-access-pg77r\") pod \"e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:40.394256 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.394230 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:40.529857 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.529827 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj"] Jul 07 18:10:40.532326 ip-10-0-131-96 kubenswrapper[2552]: W0707 18:10:40.532277 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc243a2cb_9f8d_4188_9dac_693f844822a6.slice/crio-41b82e30887503807a96abaff44c0f03b73967a7b0979d49b2e580f515e42730 WatchSource:0}: Error finding container 41b82e30887503807a96abaff44c0f03b73967a7b0979d49b2e580f515e42730: Status 404 returned error can't find the container with id 41b82e30887503807a96abaff44c0f03b73967a7b0979d49b2e580f515e42730 Jul 07 18:10:40.534349 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.534316 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:10:40.534406 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.534392 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:10:40.534447 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:40.534424 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:10:41.085104 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:41.085072 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" event={"ID":"c243a2cb-9f8d-4188-9dac-693f844822a6","Type":"ContainerStarted","Data":"aef3fc42b174f1d2bfcbcd6de72d018168ddd516ef7b85a119b7eec34396412b"} Jul 07 18:10:41.085546 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:41.085123 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" event={"ID":"c243a2cb-9f8d-4188-9dac-693f844822a6","Type":"ContainerStarted","Data":"41b82e30887503807a96abaff44c0f03b73967a7b0979d49b2e580f515e42730"} Jul 07 18:10:41.106268 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:41.106212 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" podStartSLOduration=1.106191055 podStartE2EDuration="1.106191055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:10:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:10:41.104250104 +0000 UTC m=+2041.686256881" watchObservedRunningTime="2026-07-07 18:10:41.106191055 +0000 UTC m=+2041.688197800" Jul 07 18:10:41.394833 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:41.394807 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:41.399815 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:41.399791 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:41.760037 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:41.759951 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:10:42.090348 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:42.090249 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:42.091251 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:42.091234 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:48.086631 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.086596 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk"] Jul 07 18:10:48.090557 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.090536 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:48.092641 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.092621 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-5c379c-openshift-default-dockercfg-6l4lz\"" Jul 07 18:10:48.100112 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.099470 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk"] Jul 07 18:10:48.186682 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.186643 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-workload-certs\") pod \"e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:48.186864 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.186745 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xts6d\" (UniqueName: \"kubernetes.io/projected/6f0a0e04-83b8-46a3-9277-1e208b87854c-kube-api-access-xts6d\") pod \"e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:48.186864 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.186774 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-credential-socket\") pod \"e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:48.186864 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.186831 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-istio-envoy\") pod \"e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:48.187051 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.186867 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-istio-data\") pod \"e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:48.187051 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.186933 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f0a0e04-83b8-46a3-9277-1e208b87854c-istio-podinfo\") pod \"e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:48.187051 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.186991 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f0a0e04-83b8-46a3-9277-1e208b87854c-istio-token\") pod \"e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:48.187051 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.187015 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f0a0e04-83b8-46a3-9277-1e208b87854c-istiod-ca-cert\") pod \"e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:48.187199 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.187114 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-workload-socket\") pod \"e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:48.287647 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.287614 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-workload-certs\") pod \"e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:48.287855 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.287669 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xts6d\" (UniqueName: \"kubernetes.io/projected/6f0a0e04-83b8-46a3-9277-1e208b87854c-kube-api-access-xts6d\") pod \"e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:48.287855 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.287776 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-credential-socket\") pod \"e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:48.287855 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.287816 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-istio-envoy\") pod \"e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:48.288051 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.287941 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-istio-data\") pod \"e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:48.288051 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.287981 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f0a0e04-83b8-46a3-9277-1e208b87854c-istio-podinfo\") pod \"e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:48.288051 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.288001 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f0a0e04-83b8-46a3-9277-1e208b87854c-istio-token\") pod \"e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:48.288051 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.288024 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f0a0e04-83b8-46a3-9277-1e208b87854c-istiod-ca-cert\") pod \"e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:48.288257 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.288063 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-workload-socket\") pod \"e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:48.288257 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.288093 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-workload-certs\") pod \"e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:48.288257 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.288182 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-credential-socket\") pod \"e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:48.288451 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.288266 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-istio-data\") pod \"e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:48.288511 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.288466 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-workload-socket\") pod \"e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:48.288806 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.288783 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f0a0e04-83b8-46a3-9277-1e208b87854c-istiod-ca-cert\") pod \"e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:48.290028 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.289997 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-istio-envoy\") pod \"e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:48.290342 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.290327 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f0a0e04-83b8-46a3-9277-1e208b87854c-istio-podinfo\") pod \"e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:48.295696 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.295669 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f0a0e04-83b8-46a3-9277-1e208b87854c-istio-token\") pod \"e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:48.295789 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.295761 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xts6d\" (UniqueName: \"kubernetes.io/projected/6f0a0e04-83b8-46a3-9277-1e208b87854c-kube-api-access-xts6d\") pod \"e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:48.404384 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.404351 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:48.544731 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.544691 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk"] Jul 07 18:10:48.548048 ip-10-0-131-96 kubenswrapper[2552]: W0707 18:10:48.548020 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f0a0e04_83b8_46a3_9277_1e208b87854c.slice/crio-f682feefa3fe61ad5bbb9483d001dbb6e82dd80a41b82402e616d41aaeea238b WatchSource:0}: Error finding container f682feefa3fe61ad5bbb9483d001dbb6e82dd80a41b82402e616d41aaeea238b: Status 404 returned error can't find the container with id f682feefa3fe61ad5bbb9483d001dbb6e82dd80a41b82402e616d41aaeea238b Jul 07 18:10:48.550454 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.550422 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:10:48.550560 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.550490 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:10:48.550560 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:48.550539 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:10:49.130838 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:49.130799 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" event={"ID":"6f0a0e04-83b8-46a3-9277-1e208b87854c","Type":"ContainerStarted","Data":"9abe067b28e26b70b873aa47c3e1b95985fba3db1d58e62c50ee454058d654da"} Jul 07 18:10:49.131256 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:49.130863 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" event={"ID":"6f0a0e04-83b8-46a3-9277-1e208b87854c","Type":"ContainerStarted","Data":"f682feefa3fe61ad5bbb9483d001dbb6e82dd80a41b82402e616d41aaeea238b"} Jul 07 18:10:49.150852 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:49.150806 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" podStartSLOduration=1.150790598 podStartE2EDuration="1.150790598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:10:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:10:49.148857511 +0000 UTC m=+2049.730864270" watchObservedRunningTime="2026-07-07 18:10:49.150790598 +0000 UTC m=+2049.732797343" Jul 07 18:10:49.407399 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:49.407351 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:49.416899 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:49.416856 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:50.136846 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:50.136817 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:50.137887 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:50.137870 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:10:54.256165 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:54.256127 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:10:56.170545 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:56.170511 2552 generic.go:356] "Generic (PLEG): container finished" podID="c243a2cb-9f8d-4188-9dac-693f844822a6" containerID="aef3fc42b174f1d2bfcbcd6de72d018168ddd516ef7b85a119b7eec34396412b" exitCode=0 Jul 07 18:10:56.171088 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:56.170566 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" event={"ID":"c243a2cb-9f8d-4188-9dac-693f844822a6","Type":"ContainerDied","Data":"aef3fc42b174f1d2bfcbcd6de72d018168ddd516ef7b85a119b7eec34396412b"} Jul 07 18:10:56.171088 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:56.171035 2552 scope.go:117] "RemoveContainer" containerID="aef3fc42b174f1d2bfcbcd6de72d018168ddd516ef7b85a119b7eec34396412b" Jul 07 18:10:56.172080 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:56.172047 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:10:56.172191 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:56.172126 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:10:56.172191 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:56.172168 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:10:57.091178 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:57.091146 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:57.178234 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:57.178200 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" event={"ID":"c243a2cb-9f8d-4188-9dac-693f844822a6","Type":"ContainerStarted","Data":"38a35c5d33b3d9ee07ef04becc1cc7b83dddf609bfff1924892d36c102e5cd72"} Jul 07 18:10:57.394906 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:57.394872 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:10:57.396057 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:57.396033 2552 patch_prober.go:28] interesting pod/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 07 18:10:57.396184 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:57.396093 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" podUID="c243a2cb-9f8d-4188-9dac-693f844822a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 07 18:10:58.395398 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:58.395358 2552 patch_prober.go:28] interesting pod/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 07 18:10:58.395813 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:58.395417 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" podUID="c243a2cb-9f8d-4188-9dac-693f844822a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 07 18:10:59.395568 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:59.395538 2552 patch_prober.go:28] interesting pod/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 07 18:10:59.395917 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:10:59.395588 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" podUID="c243a2cb-9f8d-4188-9dac-693f844822a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 07 18:11:00.394671 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:11:00.394641 2552 patch_prober.go:28] interesting pod/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 07 18:11:00.395012 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:11:00.394694 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" podUID="c243a2cb-9f8d-4188-9dac-693f844822a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 07 18:11:01.398441 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:11:01.398358 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:11:01.398847 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:11:01.398776 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:11:01.399565 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:11:01.399545 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:11:03.211191 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:11:03.211161 2552 generic.go:356] "Generic (PLEG): container finished" podID="6f0a0e04-83b8-46a3-9277-1e208b87854c" containerID="9abe067b28e26b70b873aa47c3e1b95985fba3db1d58e62c50ee454058d654da" exitCode=0 Jul 07 18:11:03.211632 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:11:03.211242 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" event={"ID":"6f0a0e04-83b8-46a3-9277-1e208b87854c","Type":"ContainerDied","Data":"9abe067b28e26b70b873aa47c3e1b95985fba3db1d58e62c50ee454058d654da"} Jul 07 18:11:03.211836 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:11:03.211820 2552 scope.go:117] "RemoveContainer" containerID="9abe067b28e26b70b873aa47c3e1b95985fba3db1d58e62c50ee454058d654da" Jul 07 18:11:03.212847 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:11:03.212818 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:11:03.212918 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:11:03.212901 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:11:03.212956 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:11:03.212944 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 18:11:04.219085 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:11:04.219056 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" event={"ID":"6f0a0e04-83b8-46a3-9277-1e208b87854c","Type":"ContainerStarted","Data":"8848930333ea49021b9cf2342db94a2f42a8fb9587bd70535822c4fb413dce09"} Jul 07 18:11:04.405664 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:11:04.405625 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:11:04.406856 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:11:04.406821 2552 patch_prober.go:28] interesting pod/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 07 18:11:04.406981 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:11:04.406902 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" podUID="6f0a0e04-83b8-46a3-9277-1e208b87854c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 07 18:11:05.137332 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:11:05.137288 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:11:05.404956 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:11:05.404855 2552 patch_prober.go:28] interesting pod/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 07 18:11:05.405553 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:11:05.405517 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" podUID="6f0a0e04-83b8-46a3-9277-1e208b87854c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 07 18:11:06.405319 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:11:06.405263 2552 patch_prober.go:28] interesting pod/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 07 18:11:06.406856 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:11:06.406825 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" podUID="6f0a0e04-83b8-46a3-9277-1e208b87854c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 07 18:11:07.405066 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:11:07.405028 2552 patch_prober.go:28] interesting pod/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 07 18:11:07.405286 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:11:07.405125 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" podUID="6f0a0e04-83b8-46a3-9277-1e208b87854c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 07 18:11:08.409411 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:11:08.409386 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:11:08.410609 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:11:08.410590 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:11:15.853736 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:11:15.853701 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:11:39.988286 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:11:39.988259 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/ovn-acl-logging/0.log" Jul 07 18:11:40.004595 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:11:40.004572 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/ovn-acl-logging/0.log" Jul 07 18:11:58.158361 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:11:58.158332 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:12:15.256778 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:12:15.256742 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:12:29.559810 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:12:29.559769 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:12:44.252259 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:12:44.252226 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:13:01.259358 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:13:01.259313 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:13:18.248315 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:13:18.248276 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:13:34.353234 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:13:34.353202 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:13:49.649239 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:13:49.649205 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:14:02.859608 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:14:02.859528 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:14:21.655825 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:14:21.655791 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:14:35.662265 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:14:35.662229 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:14:53.858478 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:14:53.858444 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:15:10.755551 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:15:10.755517 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:15:37.155833 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:15:37.155741 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:16:04.154871 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:16:04.154837 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:16:16.850147 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:16:16.850110 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:16:29.460455 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:16:29.460420 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:16:40.024615 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:16:40.024588 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/ovn-acl-logging/0.log" Jul 07 18:16:40.042854 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:16:40.042828 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/ovn-acl-logging/0.log" Jul 07 18:17:08.243365 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:08.243247 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj"] Jul 07 18:17:08.243951 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:08.243542 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" podUID="c243a2cb-9f8d-4188-9dac-693f844822a6" containerName="istio-proxy" containerID="cri-o://38a35c5d33b3d9ee07ef04becc1cc7b83dddf609bfff1924892d36c102e5cd72" gracePeriod=30 Jul 07 18:17:11.251497 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:11.251460 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z79ww"] Jul 07 18:17:13.490168 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:13.490149 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:17:13.542560 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:13.542477 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-istio-envoy\") pod \"c243a2cb-9f8d-4188-9dac-693f844822a6\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " Jul 07 18:17:13.542560 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:13.542520 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-credential-socket\") pod \"c243a2cb-9f8d-4188-9dac-693f844822a6\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " Jul 07 18:17:13.542560 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:13.542546 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-workload-certs\") pod \"c243a2cb-9f8d-4188-9dac-693f844822a6\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " Jul 07 18:17:13.542804 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:13.542567 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c243a2cb-9f8d-4188-9dac-693f844822a6-istio-podinfo\") pod \"c243a2cb-9f8d-4188-9dac-693f844822a6\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " Jul 07 18:17:13.542804 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:13.542588 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c243a2cb-9f8d-4188-9dac-693f844822a6-istiod-ca-cert\") pod \"c243a2cb-9f8d-4188-9dac-693f844822a6\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " Jul 07 18:17:13.542804 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:13.542635 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pg77r\" (UniqueName: \"kubernetes.io/projected/c243a2cb-9f8d-4188-9dac-693f844822a6-kube-api-access-pg77r\") pod \"c243a2cb-9f8d-4188-9dac-693f844822a6\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " Jul 07 18:17:13.542804 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:13.542666 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-workload-socket\") pod \"c243a2cb-9f8d-4188-9dac-693f844822a6\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " Jul 07 18:17:13.542804 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:13.542694 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-istio-data\") pod \"c243a2cb-9f8d-4188-9dac-693f844822a6\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " Jul 07 18:17:13.542804 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:13.542726 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c243a2cb-9f8d-4188-9dac-693f844822a6-istio-token\") pod \"c243a2cb-9f8d-4188-9dac-693f844822a6\" (UID: \"c243a2cb-9f8d-4188-9dac-693f844822a6\") " Jul 07 18:17:13.543108 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:13.542849 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c243a2cb-9f8d-4188-9dac-693f844822a6" (UID: "c243a2cb-9f8d-4188-9dac-693f844822a6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:17:13.543108 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:13.542937 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c243a2cb-9f8d-4188-9dac-693f844822a6" (UID: "c243a2cb-9f8d-4188-9dac-693f844822a6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:17:13.543108 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:13.543045 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-credential-socket\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:17:13.543108 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:13.543062 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-workload-certs\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:17:13.543349 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:13.543115 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c243a2cb-9f8d-4188-9dac-693f844822a6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c243a2cb-9f8d-4188-9dac-693f844822a6" (UID: "c243a2cb-9f8d-4188-9dac-693f844822a6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:17:13.543409 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:13.543339 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c243a2cb-9f8d-4188-9dac-693f844822a6" (UID: "c243a2cb-9f8d-4188-9dac-693f844822a6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:17:13.543973 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:13.543947 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-istio-data" (OuterVolumeSpecName: "istio-data") pod "c243a2cb-9f8d-4188-9dac-693f844822a6" (UID: "c243a2cb-9f8d-4188-9dac-693f844822a6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:17:13.544946 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:13.544919 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c243a2cb-9f8d-4188-9dac-693f844822a6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c243a2cb-9f8d-4188-9dac-693f844822a6" (UID: "c243a2cb-9f8d-4188-9dac-693f844822a6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 18:17:13.545096 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:13.545072 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c243a2cb-9f8d-4188-9dac-693f844822a6-kube-api-access-pg77r" (OuterVolumeSpecName: "kube-api-access-pg77r") pod "c243a2cb-9f8d-4188-9dac-693f844822a6" (UID: "c243a2cb-9f8d-4188-9dac-693f844822a6"). InnerVolumeSpecName "kube-api-access-pg77r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:17:13.545140 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:13.545120 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c243a2cb-9f8d-4188-9dac-693f844822a6" (UID: "c243a2cb-9f8d-4188-9dac-693f844822a6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:17:13.545360 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:13.545338 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c243a2cb-9f8d-4188-9dac-693f844822a6-istio-token" (OuterVolumeSpecName: "istio-token") pod "c243a2cb-9f8d-4188-9dac-693f844822a6" (UID: "c243a2cb-9f8d-4188-9dac-693f844822a6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:17:13.643519 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:13.643482 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pg77r\" (UniqueName: \"kubernetes.io/projected/c243a2cb-9f8d-4188-9dac-693f844822a6-kube-api-access-pg77r\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:17:13.643519 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:13.643514 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-workload-socket\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:17:13.643519 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:13.643528 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-istio-data\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:17:13.643771 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:13.643539 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c243a2cb-9f8d-4188-9dac-693f844822a6-istio-token\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:17:13.643771 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:13.643550 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c243a2cb-9f8d-4188-9dac-693f844822a6-istio-envoy\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:17:13.643771 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:13.643561 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c243a2cb-9f8d-4188-9dac-693f844822a6-istio-podinfo\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:17:13.643771 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:13.643571 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c243a2cb-9f8d-4188-9dac-693f844822a6-istiod-ca-cert\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:17:14.218065 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:14.218027 2552 generic.go:356] "Generic (PLEG): container finished" podID="c243a2cb-9f8d-4188-9dac-693f844822a6" containerID="38a35c5d33b3d9ee07ef04becc1cc7b83dddf609bfff1924892d36c102e5cd72" exitCode=0 Jul 07 18:17:14.218255 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:14.218094 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" Jul 07 18:17:14.218255 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:14.218109 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" event={"ID":"c243a2cb-9f8d-4188-9dac-693f844822a6","Type":"ContainerDied","Data":"38a35c5d33b3d9ee07ef04becc1cc7b83dddf609bfff1924892d36c102e5cd72"} Jul 07 18:17:14.218255 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:14.218164 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj" event={"ID":"c243a2cb-9f8d-4188-9dac-693f844822a6","Type":"ContainerDied","Data":"41b82e30887503807a96abaff44c0f03b73967a7b0979d49b2e580f515e42730"} Jul 07 18:17:14.218255 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:14.218188 2552 scope.go:117] "RemoveContainer" containerID="38a35c5d33b3d9ee07ef04becc1cc7b83dddf609bfff1924892d36c102e5cd72" Jul 07 18:17:14.227731 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:14.227716 2552 scope.go:117] "RemoveContainer" containerID="aef3fc42b174f1d2bfcbcd6de72d018168ddd516ef7b85a119b7eec34396412b" Jul 07 18:17:14.235762 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:14.235705 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj"] Jul 07 18:17:14.236117 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:14.236108 2552 scope.go:117] "RemoveContainer" containerID="38a35c5d33b3d9ee07ef04becc1cc7b83dddf609bfff1924892d36c102e5cd72" Jul 07 18:17:14.236776 ip-10-0-131-96 kubenswrapper[2552]: E0707 18:17:14.236416 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38a35c5d33b3d9ee07ef04becc1cc7b83dddf609bfff1924892d36c102e5cd72\": container with ID starting with 38a35c5d33b3d9ee07ef04becc1cc7b83dddf609bfff1924892d36c102e5cd72 not found: ID does not exist" containerID="38a35c5d33b3d9ee07ef04becc1cc7b83dddf609bfff1924892d36c102e5cd72" Jul 07 18:17:14.236776 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:14.236453 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38a35c5d33b3d9ee07ef04becc1cc7b83dddf609bfff1924892d36c102e5cd72"} err="failed to get container status \"38a35c5d33b3d9ee07ef04becc1cc7b83dddf609bfff1924892d36c102e5cd72\": rpc error: code = NotFound desc = could not find container \"38a35c5d33b3d9ee07ef04becc1cc7b83dddf609bfff1924892d36c102e5cd72\": container with ID starting with 38a35c5d33b3d9ee07ef04becc1cc7b83dddf609bfff1924892d36c102e5cd72 not found: ID does not exist" Jul 07 18:17:14.236776 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:14.236484 2552 scope.go:117] "RemoveContainer" containerID="aef3fc42b174f1d2bfcbcd6de72d018168ddd516ef7b85a119b7eec34396412b" Jul 07 18:17:14.237006 ip-10-0-131-96 kubenswrapper[2552]: E0707 18:17:14.236848 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aef3fc42b174f1d2bfcbcd6de72d018168ddd516ef7b85a119b7eec34396412b\": container with ID starting with aef3fc42b174f1d2bfcbcd6de72d018168ddd516ef7b85a119b7eec34396412b not found: ID does not exist" containerID="aef3fc42b174f1d2bfcbcd6de72d018168ddd516ef7b85a119b7eec34396412b" Jul 07 18:17:14.237006 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:14.236878 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aef3fc42b174f1d2bfcbcd6de72d018168ddd516ef7b85a119b7eec34396412b"} err="failed to get container status \"aef3fc42b174f1d2bfcbcd6de72d018168ddd516ef7b85a119b7eec34396412b\": rpc error: code = NotFound desc = could not find container \"aef3fc42b174f1d2bfcbcd6de72d018168ddd516ef7b85a119b7eec34396412b\": container with ID starting with aef3fc42b174f1d2bfcbcd6de72d018168ddd516ef7b85a119b7eec34396412b not found: ID does not exist" Jul 07 18:17:14.238787 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:14.238768 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-f78287-openshift-default-9fcccc5c9-5wzlj"] Jul 07 18:17:15.259354 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:15.259322 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk"] Jul 07 18:17:15.259768 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:15.259586 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" podUID="6f0a0e04-83b8-46a3-9277-1e208b87854c" containerName="istio-proxy" containerID="cri-o://8848930333ea49021b9cf2342db94a2f42a8fb9587bd70535822c4fb413dce09" gracePeriod=30 Jul 07 18:17:15.971459 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:15.971429 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c243a2cb-9f8d-4188-9dac-693f844822a6" path="/var/lib/kubelet/pods/c243a2cb-9f8d-4188-9dac-693f844822a6/volumes" Jul 07 18:17:20.514499 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:20.514475 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:17:20.605927 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:20.605850 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f0a0e04-83b8-46a3-9277-1e208b87854c-istio-podinfo\") pod \"6f0a0e04-83b8-46a3-9277-1e208b87854c\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " Jul 07 18:17:20.605927 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:20.605903 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-istio-envoy\") pod \"6f0a0e04-83b8-46a3-9277-1e208b87854c\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " Jul 07 18:17:20.606177 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:20.605947 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f0a0e04-83b8-46a3-9277-1e208b87854c-istio-token\") pod \"6f0a0e04-83b8-46a3-9277-1e208b87854c\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " Jul 07 18:17:20.606177 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:20.605980 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-workload-socket\") pod \"6f0a0e04-83b8-46a3-9277-1e208b87854c\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " Jul 07 18:17:20.606177 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:20.606011 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-istio-data\") pod \"6f0a0e04-83b8-46a3-9277-1e208b87854c\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " Jul 07 18:17:20.606177 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:20.606037 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xts6d\" (UniqueName: \"kubernetes.io/projected/6f0a0e04-83b8-46a3-9277-1e208b87854c-kube-api-access-xts6d\") pod \"6f0a0e04-83b8-46a3-9277-1e208b87854c\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " Jul 07 18:17:20.606177 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:20.606075 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-credential-socket\") pod \"6f0a0e04-83b8-46a3-9277-1e208b87854c\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " Jul 07 18:17:20.606177 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:20.606096 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f0a0e04-83b8-46a3-9277-1e208b87854c-istiod-ca-cert\") pod \"6f0a0e04-83b8-46a3-9277-1e208b87854c\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " Jul 07 18:17:20.606177 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:20.606171 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-workload-certs\") pod \"6f0a0e04-83b8-46a3-9277-1e208b87854c\" (UID: \"6f0a0e04-83b8-46a3-9277-1e208b87854c\") " Jul 07 18:17:20.606537 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:20.606481 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6f0a0e04-83b8-46a3-9277-1e208b87854c" (UID: "6f0a0e04-83b8-46a3-9277-1e208b87854c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:17:20.606797 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:20.606612 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6f0a0e04-83b8-46a3-9277-1e208b87854c" (UID: "6f0a0e04-83b8-46a3-9277-1e208b87854c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:17:20.606797 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:20.606629 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6f0a0e04-83b8-46a3-9277-1e208b87854c" (UID: "6f0a0e04-83b8-46a3-9277-1e208b87854c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:17:20.606985 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:20.606891 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f0a0e04-83b8-46a3-9277-1e208b87854c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6f0a0e04-83b8-46a3-9277-1e208b87854c" (UID: "6f0a0e04-83b8-46a3-9277-1e208b87854c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:17:20.607102 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:20.606995 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-istio-data" (OuterVolumeSpecName: "istio-data") pod "6f0a0e04-83b8-46a3-9277-1e208b87854c" (UID: "6f0a0e04-83b8-46a3-9277-1e208b87854c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:17:20.608217 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:20.608194 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6f0a0e04-83b8-46a3-9277-1e208b87854c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6f0a0e04-83b8-46a3-9277-1e208b87854c" (UID: "6f0a0e04-83b8-46a3-9277-1e208b87854c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 18:17:20.608372 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:20.608350 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f0a0e04-83b8-46a3-9277-1e208b87854c-kube-api-access-xts6d" (OuterVolumeSpecName: "kube-api-access-xts6d") pod "6f0a0e04-83b8-46a3-9277-1e208b87854c" (UID: "6f0a0e04-83b8-46a3-9277-1e208b87854c"). InnerVolumeSpecName "kube-api-access-xts6d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:17:20.608534 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:20.608514 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f0a0e04-83b8-46a3-9277-1e208b87854c-istio-token" (OuterVolumeSpecName: "istio-token") pod "6f0a0e04-83b8-46a3-9277-1e208b87854c" (UID: "6f0a0e04-83b8-46a3-9277-1e208b87854c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:17:20.608847 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:20.608822 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6f0a0e04-83b8-46a3-9277-1e208b87854c" (UID: "6f0a0e04-83b8-46a3-9277-1e208b87854c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:17:20.707134 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:20.707099 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-workload-certs\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:17:20.707134 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:20.707128 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f0a0e04-83b8-46a3-9277-1e208b87854c-istio-podinfo\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:17:20.707134 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:20.707141 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-istio-envoy\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:17:20.707392 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:20.707151 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f0a0e04-83b8-46a3-9277-1e208b87854c-istio-token\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:17:20.707392 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:20.707162 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-workload-socket\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:17:20.707392 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:20.707173 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-istio-data\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:17:20.707392 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:20.707185 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xts6d\" (UniqueName: \"kubernetes.io/projected/6f0a0e04-83b8-46a3-9277-1e208b87854c-kube-api-access-xts6d\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:17:20.707392 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:20.707197 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f0a0e04-83b8-46a3-9277-1e208b87854c-credential-socket\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:17:20.707392 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:20.707210 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f0a0e04-83b8-46a3-9277-1e208b87854c-istiod-ca-cert\") on node \"ip-10-0-131-96.ec2.internal\" DevicePath \"\"" Jul 07 18:17:21.258702 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:21.258667 2552 generic.go:356] "Generic (PLEG): container finished" podID="6f0a0e04-83b8-46a3-9277-1e208b87854c" containerID="8848930333ea49021b9cf2342db94a2f42a8fb9587bd70535822c4fb413dce09" exitCode=0 Jul 07 18:17:21.258880 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:21.258716 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" Jul 07 18:17:21.258880 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:21.258728 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" event={"ID":"6f0a0e04-83b8-46a3-9277-1e208b87854c","Type":"ContainerDied","Data":"8848930333ea49021b9cf2342db94a2f42a8fb9587bd70535822c4fb413dce09"} Jul 07 18:17:21.258880 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:21.258784 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk" event={"ID":"6f0a0e04-83b8-46a3-9277-1e208b87854c","Type":"ContainerDied","Data":"f682feefa3fe61ad5bbb9483d001dbb6e82dd80a41b82402e616d41aaeea238b"} Jul 07 18:17:21.258880 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:21.258806 2552 scope.go:117] "RemoveContainer" containerID="8848930333ea49021b9cf2342db94a2f42a8fb9587bd70535822c4fb413dce09" Jul 07 18:17:21.271487 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:21.271460 2552 scope.go:117] "RemoveContainer" containerID="9abe067b28e26b70b873aa47c3e1b95985fba3db1d58e62c50ee454058d654da" Jul 07 18:17:21.280217 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:21.280198 2552 scope.go:117] "RemoveContainer" containerID="8848930333ea49021b9cf2342db94a2f42a8fb9587bd70535822c4fb413dce09" Jul 07 18:17:21.280559 ip-10-0-131-96 kubenswrapper[2552]: E0707 18:17:21.280535 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8848930333ea49021b9cf2342db94a2f42a8fb9587bd70535822c4fb413dce09\": container with ID starting with 8848930333ea49021b9cf2342db94a2f42a8fb9587bd70535822c4fb413dce09 not found: ID does not exist" containerID="8848930333ea49021b9cf2342db94a2f42a8fb9587bd70535822c4fb413dce09" Jul 07 18:17:21.280650 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:21.280566 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8848930333ea49021b9cf2342db94a2f42a8fb9587bd70535822c4fb413dce09"} err="failed to get container status \"8848930333ea49021b9cf2342db94a2f42a8fb9587bd70535822c4fb413dce09\": rpc error: code = NotFound desc = could not find container \"8848930333ea49021b9cf2342db94a2f42a8fb9587bd70535822c4fb413dce09\": container with ID starting with 8848930333ea49021b9cf2342db94a2f42a8fb9587bd70535822c4fb413dce09 not found: ID does not exist" Jul 07 18:17:21.280650 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:21.280585 2552 scope.go:117] "RemoveContainer" containerID="9abe067b28e26b70b873aa47c3e1b95985fba3db1d58e62c50ee454058d654da" Jul 07 18:17:21.280880 ip-10-0-131-96 kubenswrapper[2552]: E0707 18:17:21.280862 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9abe067b28e26b70b873aa47c3e1b95985fba3db1d58e62c50ee454058d654da\": container with ID starting with 9abe067b28e26b70b873aa47c3e1b95985fba3db1d58e62c50ee454058d654da not found: ID does not exist" containerID="9abe067b28e26b70b873aa47c3e1b95985fba3db1d58e62c50ee454058d654da" Jul 07 18:17:21.280940 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:21.280889 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9abe067b28e26b70b873aa47c3e1b95985fba3db1d58e62c50ee454058d654da"} err="failed to get container status \"9abe067b28e26b70b873aa47c3e1b95985fba3db1d58e62c50ee454058d654da\": rpc error: code = NotFound desc = could not find container \"9abe067b28e26b70b873aa47c3e1b95985fba3db1d58e62c50ee454058d654da\": container with ID starting with 9abe067b28e26b70b873aa47c3e1b95985fba3db1d58e62c50ee454058d654da not found: ID does not exist" Jul 07 18:17:21.281147 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:21.281135 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk"] Jul 07 18:17:21.283058 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:21.283031 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-5c379c-openshift-default-8479dbd655-ms9wk"] Jul 07 18:17:21.971583 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:21.971549 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f0a0e04-83b8-46a3-9277-1e208b87854c" path="/var/lib/kubelet/pods/6f0a0e04-83b8-46a3-9277-1e208b87854c/volumes" Jul 07 18:17:22.448623 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:22.448601 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-vfmtk_d21b6c50-9a23-4856-8b9c-7d3a7eba9c8b/manager/0.log" Jul 07 18:17:22.585201 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:22.585156 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-4fscl_f342dce6-1de6-44e1-97f5-e44303edb74e/manager/0.log" Jul 07 18:17:23.593453 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:23.593425 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-777cf5fb6f-b7zxw_570c00ab-1625-472a-a3df-e8ff8e744b08/copy-manifests/0.log" Jul 07 18:17:23.606022 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:23.606000 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-777cf5fb6f-b7zxw_570c00ab-1625-472a-a3df-e8ff8e744b08/manager/0.log" Jul 07 18:17:23.851708 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:23.851632 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-542hq_149beda9-6d40-46f3-9ec1-04c9053173cb/postgres/0.log" Jul 07 18:17:24.714427 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:24.714398 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk_25a55bb8-f39a-45fe-912f-ab2af4e3f70b/util/0.log" Jul 07 18:17:24.720380 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:24.720353 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk_25a55bb8-f39a-45fe-912f-ab2af4e3f70b/pull/0.log" Jul 07 18:17:24.725892 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:24.725876 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk_25a55bb8-f39a-45fe-912f-ab2af4e3f70b/extract/0.log" Jul 07 18:17:24.846551 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:24.846519 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s_dddfc486-07b5-4eaa-bebc-e988b0526d84/util/0.log" Jul 07 18:17:24.852588 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:24.852564 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s_dddfc486-07b5-4eaa-bebc-e988b0526d84/pull/0.log" Jul 07 18:17:24.858719 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:24.858699 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s_dddfc486-07b5-4eaa-bebc-e988b0526d84/extract/0.log" Jul 07 18:17:24.978657 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:24.978592 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg_a0b2bb73-ec63-48ee-ad76-2e57118c09d9/util/0.log" Jul 07 18:17:24.984713 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:24.984698 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg_a0b2bb73-ec63-48ee-ad76-2e57118c09d9/pull/0.log" Jul 07 18:17:24.990729 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:24.990713 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg_a0b2bb73-ec63-48ee-ad76-2e57118c09d9/extract/0.log" Jul 07 18:17:25.112419 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:25.112398 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw_35922e00-8322-4597-96a5-27eeba5c7ebf/util/0.log" Jul 07 18:17:25.118129 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:25.118112 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw_35922e00-8322-4597-96a5-27eeba5c7ebf/pull/0.log" Jul 07 18:17:25.123744 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:25.123732 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw_35922e00-8322-4597-96a5-27eeba5c7ebf/extract/0.log" Jul 07 18:17:25.376836 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:25.376757 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-7rzfw_6b72a839-4b63-49f3-bfdb-127b9fb67581/manager/0.log" Jul 07 18:17:25.495030 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:25.494999 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-57bzf_af91963c-c39b-46ff-a6b1-303c6750a224/manager/0.log" Jul 07 18:17:25.616033 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:25.616007 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-jbmpj_e934b6ee-aa8a-4e21-9d85-7a9c85330ee8/kuadrant-console-plugin/0.log" Jul 07 18:17:25.743575 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:25.743550 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-72qvr_0bc6548a-d35d-4f9e-8a20-9eda3c4a193e/registry-server/0.log" Jul 07 18:17:25.876505 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:25.876472 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-9pn6m_9b0fa7ef-835b-430b-a0e6-285e4f5f28a8/manager/0.log" Jul 07 18:17:26.010716 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:26.010645 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-z79ww_1df336c1-3b59-46b4-88f3-2a7fc066cc76/limitador/0.log" Jul 07 18:17:26.134904 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:26.134879 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-fts2n_61af0df5-7e27-44f1-8bdc-b0289e186ea7/manager/0.log" Jul 07 18:17:26.901381 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:26.901357 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-99f6fd64d-qmmsf_6f5ec344-7722-4a65-9c4a-12a3c25b20dd/kube-auth-proxy/0.log" Jul 07 18:17:27.026379 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:27.026347 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-hscv4_6595f65c-fac9-40d6-b133-7a78ea5c225b/istio-proxy/1.log" Jul 07 18:17:27.893619 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:27.893584 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-jntcs_ca1b8e4f-6cc0-41d8-ab72-f69665a164f0/main/0.log" Jul 07 18:17:32.864693 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:32.864663 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4gck5/must-gather-4h76m"] Jul 07 18:17:32.865209 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:32.865190 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c243a2cb-9f8d-4188-9dac-693f844822a6" containerName="istio-proxy" Jul 07 18:17:32.865287 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:32.865212 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="c243a2cb-9f8d-4188-9dac-693f844822a6" containerName="istio-proxy" Jul 07 18:17:32.865287 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:32.865239 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f0a0e04-83b8-46a3-9277-1e208b87854c" containerName="istio-proxy" Jul 07 18:17:32.865287 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:32.865248 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f0a0e04-83b8-46a3-9277-1e208b87854c" containerName="istio-proxy" Jul 07 18:17:32.865287 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:32.865258 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c243a2cb-9f8d-4188-9dac-693f844822a6" containerName="istio-proxy" Jul 07 18:17:32.865287 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:32.865267 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="c243a2cb-9f8d-4188-9dac-693f844822a6" containerName="istio-proxy" Jul 07 18:17:32.865287 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:32.865277 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f0a0e04-83b8-46a3-9277-1e208b87854c" containerName="istio-proxy" Jul 07 18:17:32.865287 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:32.865285 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f0a0e04-83b8-46a3-9277-1e208b87854c" containerName="istio-proxy" Jul 07 18:17:32.865931 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:32.865401 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f0a0e04-83b8-46a3-9277-1e208b87854c" containerName="istio-proxy" Jul 07 18:17:32.865931 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:32.865416 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f0a0e04-83b8-46a3-9277-1e208b87854c" containerName="istio-proxy" Jul 07 18:17:32.865931 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:32.865426 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="c243a2cb-9f8d-4188-9dac-693f844822a6" containerName="istio-proxy" Jul 07 18:17:32.865931 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:32.865436 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="c243a2cb-9f8d-4188-9dac-693f844822a6" containerName="istio-proxy" Jul 07 18:17:32.868817 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:32.868795 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4gck5/must-gather-4h76m" Jul 07 18:17:32.870821 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:32.870787 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4gck5\"/\"openshift-service-ca.crt\"" Jul 07 18:17:32.870931 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:32.870817 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4gck5\"/\"default-dockercfg-4gjgh\"" Jul 07 18:17:32.871572 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:32.871558 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4gck5\"/\"kube-root-ca.crt\"" Jul 07 18:17:32.874642 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:32.874624 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4gck5/must-gather-4h76m"] Jul 07 18:17:33.014009 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:33.013976 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ee2f42be-429b-4b55-92c8-451550de2686-must-gather-output\") pod \"must-gather-4h76m\" (UID: \"ee2f42be-429b-4b55-92c8-451550de2686\") " pod="openshift-must-gather-4gck5/must-gather-4h76m" Jul 07 18:17:33.014197 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:33.014028 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc9jw\" (UniqueName: \"kubernetes.io/projected/ee2f42be-429b-4b55-92c8-451550de2686-kube-api-access-jc9jw\") pod \"must-gather-4h76m\" (UID: \"ee2f42be-429b-4b55-92c8-451550de2686\") " pod="openshift-must-gather-4gck5/must-gather-4h76m" Jul 07 18:17:33.115145 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:33.115057 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ee2f42be-429b-4b55-92c8-451550de2686-must-gather-output\") pod \"must-gather-4h76m\" (UID: \"ee2f42be-429b-4b55-92c8-451550de2686\") " pod="openshift-must-gather-4gck5/must-gather-4h76m" Jul 07 18:17:33.115145 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:33.115091 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc9jw\" (UniqueName: \"kubernetes.io/projected/ee2f42be-429b-4b55-92c8-451550de2686-kube-api-access-jc9jw\") pod \"must-gather-4h76m\" (UID: \"ee2f42be-429b-4b55-92c8-451550de2686\") " pod="openshift-must-gather-4gck5/must-gather-4h76m" Jul 07 18:17:33.115495 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:33.115479 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ee2f42be-429b-4b55-92c8-451550de2686-must-gather-output\") pod \"must-gather-4h76m\" (UID: \"ee2f42be-429b-4b55-92c8-451550de2686\") " pod="openshift-must-gather-4gck5/must-gather-4h76m" Jul 07 18:17:33.122577 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:33.122552 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc9jw\" (UniqueName: \"kubernetes.io/projected/ee2f42be-429b-4b55-92c8-451550de2686-kube-api-access-jc9jw\") pod \"must-gather-4h76m\" (UID: \"ee2f42be-429b-4b55-92c8-451550de2686\") " pod="openshift-must-gather-4gck5/must-gather-4h76m" Jul 07 18:17:33.179142 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:33.179116 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4gck5/must-gather-4h76m" Jul 07 18:17:33.304593 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:33.304568 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4gck5/must-gather-4h76m"] Jul 07 18:17:33.306107 ip-10-0-131-96 kubenswrapper[2552]: W0707 18:17:33.306083 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee2f42be_429b_4b55_92c8_451550de2686.slice/crio-2f66d7bd9c0987e84efd2795a909af950f5e0032bd7465f1b19ecdf9820dc776 WatchSource:0}: Error finding container 2f66d7bd9c0987e84efd2795a909af950f5e0032bd7465f1b19ecdf9820dc776: Status 404 returned error can't find the container with id 2f66d7bd9c0987e84efd2795a909af950f5e0032bd7465f1b19ecdf9820dc776 Jul 07 18:17:33.308442 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:33.308423 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 18:17:33.321608 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:33.321585 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4gck5/must-gather-4h76m" event={"ID":"ee2f42be-429b-4b55-92c8-451550de2686","Type":"ContainerStarted","Data":"2f66d7bd9c0987e84efd2795a909af950f5e0032bd7465f1b19ecdf9820dc776"} Jul 07 18:17:34.332011 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:34.331967 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4gck5/must-gather-4h76m" event={"ID":"ee2f42be-429b-4b55-92c8-451550de2686","Type":"ContainerStarted","Data":"f190e57bc7c4a45f3db920a5ff221e8aa7748e7f3535db968e9f3d085540520e"} Jul 07 18:17:35.341366 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:35.341324 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4gck5/must-gather-4h76m" event={"ID":"ee2f42be-429b-4b55-92c8-451550de2686","Type":"ContainerStarted","Data":"8e6d9d92ded9ea866368f8802f7a76c62fc0aa6677f7babadc2d01e3de88045d"} Jul 07 18:17:35.365128 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:35.365066 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4gck5/must-gather-4h76m" podStartSLOduration=2.505925569 podStartE2EDuration="3.365045367s" totalImagesPullingTime="859.119798ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:17:35.3551083 +0000 UTC m=+2455.937115046" watchObservedRunningTime="2026-07-07 18:17:35.365045367 +0000 UTC m=+2455.947052115" Jul 07 18:17:35.733649 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:35.733614 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mxgbv_ee071d67-b30e-43c6-bc8b-6ef2cd711a52/global-pull-secret-syncer/0.log" Jul 07 18:17:35.849194 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:35.849163 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bwgg5_93fb588c-7c14-4b9d-b465-fe362d2c3512/konnectivity-agent/0.log" Jul 07 18:17:35.897464 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:35.897435 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-96.ec2.internal_9d6829a6c860a19c0346cab9c77c0d29/haproxy/0.log" Jul 07 18:17:41.493677 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:41.493645 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk_25a55bb8-f39a-45fe-912f-ab2af4e3f70b/extract/0.log" Jul 07 18:17:41.515826 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:41.515797 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk_25a55bb8-f39a-45fe-912f-ab2af4e3f70b/util/0.log" Jul 07 18:17:41.537233 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:41.537210 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sgdfk_25a55bb8-f39a-45fe-912f-ab2af4e3f70b/pull/0.log" Jul 07 18:17:41.563826 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:41.563797 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s_dddfc486-07b5-4eaa-bebc-e988b0526d84/extract/0.log" Jul 07 18:17:41.584427 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:41.584400 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s_dddfc486-07b5-4eaa-bebc-e988b0526d84/util/0.log" Jul 07 18:17:41.610954 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:41.610921 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e046q7s_dddfc486-07b5-4eaa-bebc-e988b0526d84/pull/0.log" Jul 07 18:17:41.648897 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:41.648871 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg_a0b2bb73-ec63-48ee-ad76-2e57118c09d9/extract/0.log" Jul 07 18:17:41.666283 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:41.666254 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg_a0b2bb73-ec63-48ee-ad76-2e57118c09d9/util/0.log" Jul 07 18:17:41.689269 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:41.689238 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xgfhg_a0b2bb73-ec63-48ee-ad76-2e57118c09d9/pull/0.log" Jul 07 18:17:41.717178 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:41.717130 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw_35922e00-8322-4597-96a5-27eeba5c7ebf/extract/0.log" Jul 07 18:17:41.740489 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:41.740446 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw_35922e00-8322-4597-96a5-27eeba5c7ebf/util/0.log" Jul 07 18:17:41.762160 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:41.762073 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12xnfw_35922e00-8322-4597-96a5-27eeba5c7ebf/pull/0.log" Jul 07 18:17:42.063172 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:42.063082 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-7rzfw_6b72a839-4b63-49f3-bfdb-127b9fb67581/manager/0.log" Jul 07 18:17:42.088996 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:42.088973 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-57bzf_af91963c-c39b-46ff-a6b1-303c6750a224/manager/0.log" Jul 07 18:17:42.114335 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:42.114293 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-jbmpj_e934b6ee-aa8a-4e21-9d85-7a9c85330ee8/kuadrant-console-plugin/0.log" Jul 07 18:17:42.162067 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:42.161948 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-72qvr_0bc6548a-d35d-4f9e-8a20-9eda3c4a193e/registry-server/0.log" Jul 07 18:17:42.299325 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:42.299205 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-9pn6m_9b0fa7ef-835b-430b-a0e6-285e4f5f28a8/manager/0.log" Jul 07 18:17:42.349051 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:42.348941 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-z79ww_1df336c1-3b59-46b4-88f3-2a7fc066cc76/limitador/0.log" Jul 07 18:17:42.433378 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:42.433278 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-fts2n_61af0df5-7e27-44f1-8bdc-b0289e186ea7/manager/0.log" Jul 07 18:17:44.285910 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:44.285880 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-kgw97_5a1510f8-addf-440c-b143-a96e531fac41/cluster-monitoring-operator/0.log" Jul 07 18:17:44.404750 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:44.404724 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-xxh9h_aaac0ae5-7785-4b7f-a698-b0aad2eca91a/monitoring-plugin/0.log" Jul 07 18:17:44.610273 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:44.610178 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wk2lv_72ba517f-9d8b-473d-a9fc-4407455632e0/node-exporter/0.log" Jul 07 18:17:44.630451 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:44.630426 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wk2lv_72ba517f-9d8b-473d-a9fc-4407455632e0/kube-rbac-proxy/0.log" Jul 07 18:17:44.652352 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:44.652291 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wk2lv_72ba517f-9d8b-473d-a9fc-4407455632e0/init-textfile/0.log" Jul 07 18:17:46.614050 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:46.614011 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4gck5/perf-node-gather-daemonset-pr84p"] Jul 07 18:17:46.620583 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:46.620557 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-pr84p" Jul 07 18:17:46.627622 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:46.627597 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4gck5/perf-node-gather-daemonset-pr84p"] Jul 07 18:17:46.758583 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:46.758542 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7242720f-d669-4566-9242-f2f003a13819-proc\") pod \"perf-node-gather-daemonset-pr84p\" (UID: \"7242720f-d669-4566-9242-f2f003a13819\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-pr84p" Jul 07 18:17:46.758781 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:46.758596 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5748\" (UniqueName: \"kubernetes.io/projected/7242720f-d669-4566-9242-f2f003a13819-kube-api-access-b5748\") pod \"perf-node-gather-daemonset-pr84p\" (UID: \"7242720f-d669-4566-9242-f2f003a13819\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-pr84p" Jul 07 18:17:46.758781 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:46.758665 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7242720f-d669-4566-9242-f2f003a13819-podres\") pod \"perf-node-gather-daemonset-pr84p\" (UID: \"7242720f-d669-4566-9242-f2f003a13819\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-pr84p" Jul 07 18:17:46.758781 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:46.758711 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7242720f-d669-4566-9242-f2f003a13819-sys\") pod \"perf-node-gather-daemonset-pr84p\" (UID: \"7242720f-d669-4566-9242-f2f003a13819\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-pr84p" Jul 07 18:17:46.758781 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:46.758754 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7242720f-d669-4566-9242-f2f003a13819-lib-modules\") pod \"perf-node-gather-daemonset-pr84p\" (UID: \"7242720f-d669-4566-9242-f2f003a13819\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-pr84p" Jul 07 18:17:46.859624 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:46.859592 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7242720f-d669-4566-9242-f2f003a13819-proc\") pod \"perf-node-gather-daemonset-pr84p\" (UID: \"7242720f-d669-4566-9242-f2f003a13819\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-pr84p" Jul 07 18:17:46.859624 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:46.859631 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5748\" (UniqueName: \"kubernetes.io/projected/7242720f-d669-4566-9242-f2f003a13819-kube-api-access-b5748\") pod \"perf-node-gather-daemonset-pr84p\" (UID: \"7242720f-d669-4566-9242-f2f003a13819\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-pr84p" Jul 07 18:17:46.859873 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:46.859688 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7242720f-d669-4566-9242-f2f003a13819-podres\") pod \"perf-node-gather-daemonset-pr84p\" (UID: \"7242720f-d669-4566-9242-f2f003a13819\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-pr84p" Jul 07 18:17:46.859873 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:46.859713 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7242720f-d669-4566-9242-f2f003a13819-sys\") pod \"perf-node-gather-daemonset-pr84p\" (UID: \"7242720f-d669-4566-9242-f2f003a13819\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-pr84p" Jul 07 18:17:46.859873 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:46.859724 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7242720f-d669-4566-9242-f2f003a13819-proc\") pod \"perf-node-gather-daemonset-pr84p\" (UID: \"7242720f-d669-4566-9242-f2f003a13819\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-pr84p" Jul 07 18:17:46.859873 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:46.859751 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7242720f-d669-4566-9242-f2f003a13819-lib-modules\") pod \"perf-node-gather-daemonset-pr84p\" (UID: \"7242720f-d669-4566-9242-f2f003a13819\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-pr84p" Jul 07 18:17:46.860043 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:46.859827 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7242720f-d669-4566-9242-f2f003a13819-sys\") pod \"perf-node-gather-daemonset-pr84p\" (UID: \"7242720f-d669-4566-9242-f2f003a13819\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-pr84p" Jul 07 18:17:46.860043 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:46.859842 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7242720f-d669-4566-9242-f2f003a13819-podres\") pod \"perf-node-gather-daemonset-pr84p\" (UID: \"7242720f-d669-4566-9242-f2f003a13819\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-pr84p" Jul 07 18:17:46.860043 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:46.859882 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7242720f-d669-4566-9242-f2f003a13819-lib-modules\") pod \"perf-node-gather-daemonset-pr84p\" (UID: \"7242720f-d669-4566-9242-f2f003a13819\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-pr84p" Jul 07 18:17:46.871657 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:46.871550 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5748\" (UniqueName: \"kubernetes.io/projected/7242720f-d669-4566-9242-f2f003a13819-kube-api-access-b5748\") pod \"perf-node-gather-daemonset-pr84p\" (UID: \"7242720f-d669-4566-9242-f2f003a13819\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-pr84p" Jul 07 18:17:46.937424 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:46.937376 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-pr84p" Jul 07 18:17:47.113350 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:47.113316 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4gck5/perf-node-gather-daemonset-pr84p"] Jul 07 18:17:47.114095 ip-10-0-131-96 kubenswrapper[2552]: W0707 18:17:47.114069 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7242720f_d669_4566_9242_f2f003a13819.slice/crio-7c0a5a4c3e0b55347c5d80ed75761aa3af919e3d51a3ab4096dae70172852826 WatchSource:0}: Error finding container 7c0a5a4c3e0b55347c5d80ed75761aa3af919e3d51a3ab4096dae70172852826: Status 404 returned error can't find the container with id 7c0a5a4c3e0b55347c5d80ed75761aa3af919e3d51a3ab4096dae70172852826 Jul 07 18:17:47.468492 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:47.468445 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-pr84p" event={"ID":"7242720f-d669-4566-9242-f2f003a13819","Type":"ContainerStarted","Data":"1c7c0ee4d46809a245c101ae8923b4502e1f72f5462c0a11b6942aed554bf1a0"} Jul 07 18:17:47.468671 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:47.468521 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-pr84p" event={"ID":"7242720f-d669-4566-9242-f2f003a13819","Type":"ContainerStarted","Data":"7c0a5a4c3e0b55347c5d80ed75761aa3af919e3d51a3ab4096dae70172852826"} Jul 07 18:17:47.469158 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:47.468792 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-pr84p" Jul 07 18:17:47.935548 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:47.935509 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-k9ml9_69257408-0117-4007-bb96-b96de8037f99/volume-data-source-validator/0.log" Jul 07 18:17:48.967051 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:48.967014 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-txqgg_b4a92b0f-9630-4124-be07-9e5abbffe853/dns/0.log" Jul 07 18:17:48.987184 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:48.987157 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-txqgg_b4a92b0f-9630-4124-be07-9e5abbffe853/kube-rbac-proxy/0.log" Jul 07 18:17:49.059439 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:49.059410 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ng458_2a75a377-7143-4174-94c5-4c50edb05db7/dns-node-resolver/0.log" Jul 07 18:17:49.583453 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:49.583420 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5bd9q_0ff7ea17-d539-44d4-8c47-b9f1f6a145b6/node-ca/0.log" Jul 07 18:17:50.691173 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:50.691143 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-99f6fd64d-qmmsf_6f5ec344-7722-4a65-9c4a-12a3c25b20dd/kube-auth-proxy/0.log" Jul 07 18:17:50.717734 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:50.717383 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-hscv4_6595f65c-fac9-40d6-b133-7a78ea5c225b/istio-proxy/0.log" Jul 07 18:17:50.753845 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:50.753811 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-hscv4_6595f65c-fac9-40d6-b133-7a78ea5c225b/istio-proxy/1.log" Jul 07 18:17:51.535265 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:51.535239 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vrvvv_85eb217f-d46a-4dec-ac32-73b5d41f96d2/serve-healthcheck-canary/0.log" Jul 07 18:17:51.976931 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:51.976901 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-fn9zf_a58d9422-ad7b-4281-b918-bbe01ccff305/insights-operator/0.log" Jul 07 18:17:51.977579 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:51.977559 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-fn9zf_a58d9422-ad7b-4281-b918-bbe01ccff305/insights-operator/1.log" Jul 07 18:17:52.126640 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:52.126608 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xkszl_ad924563-218f-4c56-b3b8-06f813e48573/kube-rbac-proxy/0.log" Jul 07 18:17:52.148414 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:52.148387 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xkszl_ad924563-218f-4c56-b3b8-06f813e48573/exporter/0.log" Jul 07 18:17:52.167236 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:52.167212 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xkszl_ad924563-218f-4c56-b3b8-06f813e48573/extractor/0.log" Jul 07 18:17:53.488738 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:53.488707 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-pr84p" Jul 07 18:17:53.506590 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:53.506528 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-pr84p" podStartSLOduration=7.506506142 podStartE2EDuration="7.506506142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:17:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:17:47.488498847 +0000 UTC m=+2468.070505592" watchObservedRunningTime="2026-07-07 18:17:53.506506142 +0000 UTC m=+2474.088512897" Jul 07 18:17:54.183125 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:54.183098 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-vfmtk_d21b6c50-9a23-4856-8b9c-7d3a7eba9c8b/manager/0.log" Jul 07 18:17:54.349450 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:54.349413 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-4fscl_f342dce6-1de6-44e1-97f5-e44303edb74e/manager/0.log" Jul 07 18:17:54.730070 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:54.730029 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-777cf5fb6f-b7zxw_570c00ab-1625-472a-a3df-e8ff8e744b08/manager/0.log" Jul 07 18:17:54.747375 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:54.747341 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-777cf5fb6f-b7zxw_570c00ab-1625-472a-a3df-e8ff8e744b08/copy-manifests/0.log" Jul 07 18:17:54.819531 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:54.819507 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-542hq_149beda9-6d40-46f3-9ec1-04c9053173cb/postgres/0.log" Jul 07 18:17:57.395114 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:57.395082 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-99f6fd64d-qmmsf_6f5ec344-7722-4a65-9c4a-12a3c25b20dd/kube-auth-proxy/0.log" Jul 07 18:17:57.414613 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:57.414586 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-hscv4_6595f65c-fac9-40d6-b133-7a78ea5c225b/istio-proxy/0.log" Jul 07 18:17:57.452497 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:57.452459 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-hscv4_6595f65c-fac9-40d6-b133-7a78ea5c225b/istio-proxy/1.log" Jul 07 18:17:58.788150 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:58.788121 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-99f6fd64d-qmmsf_6f5ec344-7722-4a65-9c4a-12a3c25b20dd/kube-auth-proxy/0.log" Jul 07 18:17:58.811730 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:58.811664 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-hscv4_6595f65c-fac9-40d6-b133-7a78ea5c225b/istio-proxy/0.log" Jul 07 18:17:58.854353 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:17:58.854237 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-hscv4_6595f65c-fac9-40d6-b133-7a78ea5c225b/istio-proxy/1.log" Jul 07 18:18:02.553991 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:18:02.553963 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7zgc6_e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de/kube-multus-additional-cni-plugins/0.log" Jul 07 18:18:02.572614 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:18:02.572588 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7zgc6_e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de/egress-router-binary-copy/0.log" Jul 07 18:18:02.591702 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:18:02.591682 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7zgc6_e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de/cni-plugins/0.log" Jul 07 18:18:02.611189 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:18:02.611169 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7zgc6_e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de/bond-cni-plugin/0.log" Jul 07 18:18:02.629927 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:18:02.629908 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7zgc6_e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de/routeoverride-cni/0.log" Jul 07 18:18:02.648782 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:18:02.648761 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7zgc6_e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de/whereabouts-cni-bincopy/0.log" Jul 07 18:18:02.667908 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:18:02.667890 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7zgc6_e3b2fad9-1356-4ebf-89c3-5a4e2a35c1de/whereabouts-cni/0.log" Jul 07 18:18:02.986253 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:18:02.986229 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qhctz_34658460-c105-4bd3-ac91-331037e66aba/kube-multus/0.log" Jul 07 18:18:03.090465 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:18:03.090431 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nrwlq_169258da-bb2c-4e58-8e93-447b39ef7da2/network-metrics-daemon/0.log" Jul 07 18:18:03.108060 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:18:03.108038 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nrwlq_169258da-bb2c-4e58-8e93-447b39ef7da2/kube-rbac-proxy/0.log" Jul 07 18:18:04.298158 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:18:04.298135 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/ovn-controller/0.log" Jul 07 18:18:04.313883 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:18:04.313861 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/ovn-acl-logging/1.log" Jul 07 18:18:04.314139 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:18:04.314123 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/ovn-acl-logging/0.log" Jul 07 18:18:04.331294 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:18:04.331276 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/kube-rbac-proxy-node/0.log" Jul 07 18:18:04.350862 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:18:04.350829 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/kube-rbac-proxy-ovn-metrics/0.log" Jul 07 18:18:04.368700 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:18:04.368681 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/northd/0.log" Jul 07 18:18:04.389187 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:18:04.389170 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/nbdb/0.log" Jul 07 18:18:04.414995 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:18:04.414976 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/sbdb/0.log" Jul 07 18:18:04.481060 ip-10-0-131-96 kubenswrapper[2552]: I0707 18:18:04.481032 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x765g_058bbf81-9eba-48d5-8d6f-119c027acd4c/ovnkube-controller/0.log"