Jul 13 14:50:46.776132 ip-10-0-134-237 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 13 14:50:46.776144 ip-10-0-134-237 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 13 14:50:46.776154 ip-10-0-134-237 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 13 14:50:46.776470 ip-10-0-134-237 systemd[1]: Failed to start Kubernetes Kubelet. Jul 13 14:50:58.108028 ip-10-0-134-237 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 13 14:50:58.108050 ip-10-0-134-237 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot af625714e7874d03b5516abf41060dca -- Jul 13 14:52:55.813064 ip-10-0-134-237 systemd[1]: Starting Kubernetes Kubelet... Jul 13 14:52:56.409212 ip-10-0-134-237 systemd[1]: Started Kubernetes Kubelet. Jul 13 14:52:56.423829 ip-10-0-134-237 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 14:52:56.423829 ip-10-0-134-237 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 13 14:52:56.423829 ip-10-0-134-237 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 14:52:56.423829 ip-10-0-134-237 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 13 14:52:56.423829 ip-10-0-134-237 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 14:52:56.423829 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.333569 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 13 14:52:56.423829 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339046 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 14:52:56.423829 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339061 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 14:52:56.423829 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339067 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 14:52:56.423829 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339070 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 14:52:56.423829 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339075 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 14:52:56.423829 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339079 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 14:52:56.423829 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339082 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 14:52:56.425221 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339085 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 14:52:56.425221 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339088 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 14:52:56.425221 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339097 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 14:52:56.425221 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339101 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 14:52:56.425221 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339103 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 14:52:56.425221 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339106 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 14:52:56.425221 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339109 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 14:52:56.425221 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339111 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 14:52:56.425221 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339114 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 14:52:56.425221 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339117 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 14:52:56.425221 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339119 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 14:52:56.425221 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339122 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 14:52:56.425221 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339125 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 14:52:56.425221 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339128 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 14:52:56.425221 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339130 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 14:52:56.425221 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339133 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 14:52:56.425221 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339137 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 14:52:56.425221 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339141 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 14:52:56.425221 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339143 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 14:52:56.426061 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339146 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 14:52:56.426061 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339149 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 14:52:56.426061 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339152 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 14:52:56.426061 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339154 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 14:52:56.426061 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339157 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 14:52:56.426061 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339159 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 14:52:56.426061 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339162 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 14:52:56.426061 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339164 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 14:52:56.426061 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339167 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 14:52:56.426061 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339169 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 14:52:56.426061 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339172 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 14:52:56.426061 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339174 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 14:52:56.426061 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339177 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 14:52:56.426061 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339179 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 14:52:56.426061 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339181 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 14:52:56.426061 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339184 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 14:52:56.426061 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339187 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 14:52:56.426061 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339189 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 14:52:56.426061 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339192 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 14:52:56.426061 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339195 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 14:52:56.426700 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339197 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 14:52:56.426700 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339200 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 14:52:56.426700 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339203 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 14:52:56.426700 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339205 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 14:52:56.426700 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339208 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 14:52:56.426700 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339211 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 14:52:56.426700 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339213 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 14:52:56.426700 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339216 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 14:52:56.426700 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339218 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 14:52:56.426700 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339221 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 14:52:56.426700 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339223 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 14:52:56.426700 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339226 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 14:52:56.426700 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339228 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 14:52:56.426700 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339231 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 14:52:56.426700 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339233 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 14:52:56.426700 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339236 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 14:52:56.426700 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339238 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 14:52:56.426700 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339241 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 14:52:56.426700 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339243 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 14:52:56.426700 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339245 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 14:52:56.427293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339247 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 13 14:52:56.427293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339250 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 14:52:56.427293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339252 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 14:52:56.427293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339256 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 14:52:56.427293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339258 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 14:52:56.427293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339260 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 14:52:56.427293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339263 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 14:52:56.427293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339266 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 14:52:56.427293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339268 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 14:52:56.427293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339272 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 14:52:56.427293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339274 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 14:52:56.427293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339277 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 14:52:56.427293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339279 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 14:52:56.427293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339282 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 14:52:56.427293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339284 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 14:52:56.427293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339287 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 14:52:56.427293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339290 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 14:52:56.427293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339292 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 14:52:56.427293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339295 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 14:52:56.427293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339297 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 14:52:56.427867 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339299 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 14:52:56.427867 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339302 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 14:52:56.427867 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339305 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 14:52:56.427867 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339307 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 14:52:56.427867 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339310 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 14:52:56.427867 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339312 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 14:52:56.427867 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339315 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 14:52:56.427867 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339317 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 14:52:56.427867 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339321 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 14:52:56.427867 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339323 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 14:52:56.427867 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339326 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 14:52:56.427867 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339329 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 14:52:56.427867 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.339332 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 14:52:56.427867 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340101 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 14:52:56.427867 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340109 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 14:52:56.427867 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340112 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 14:52:56.427867 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340115 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 14:52:56.427867 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340117 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 14:52:56.427867 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340120 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 14:52:56.427867 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340124 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 14:52:56.428478 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340126 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 14:52:56.428478 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340129 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 14:52:56.428478 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340137 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 14:52:56.428478 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340141 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 14:52:56.428478 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340145 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 14:52:56.428478 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340148 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 14:52:56.428478 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340151 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 14:52:56.428478 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340156 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 14:52:56.428478 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340158 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 14:52:56.428478 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340161 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 14:52:56.428478 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340164 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 14:52:56.428478 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340167 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 14:52:56.428478 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340169 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 14:52:56.428478 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340172 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 14:52:56.428478 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340174 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 14:52:56.428478 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340177 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 14:52:56.428478 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340179 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 14:52:56.428478 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340182 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 14:52:56.428478 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340184 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 14:52:56.429122 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340187 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 14:52:56.429122 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340190 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 14:52:56.429122 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340192 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 14:52:56.429122 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340194 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 14:52:56.429122 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340197 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 14:52:56.429122 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340199 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 14:52:56.429122 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340202 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 14:52:56.429122 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340207 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 14:52:56.429122 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340211 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 14:52:56.429122 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340214 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 14:52:56.429122 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340216 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 14:52:56.429122 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340219 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 14:52:56.429122 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340222 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 14:52:56.429122 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340224 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 14:52:56.429122 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340227 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 14:52:56.429122 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340230 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 14:52:56.429122 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340239 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 14:52:56.429122 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340243 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 14:52:56.429122 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340245 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 14:52:56.431475 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340247 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 14:52:56.431475 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340250 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 14:52:56.431475 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340252 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 14:52:56.431475 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340255 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 14:52:56.431475 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340257 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 14:52:56.431475 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340259 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 14:52:56.431475 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340262 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 14:52:56.431475 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340264 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 14:52:56.431475 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340266 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 14:52:56.431475 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340269 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 14:52:56.431475 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340271 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 14:52:56.431475 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340274 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 14:52:56.431475 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340276 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 14:52:56.431475 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340279 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 14:52:56.431475 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340281 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 14:52:56.431475 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340285 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 14:52:56.431475 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340289 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 14:52:56.431475 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340292 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 14:52:56.431475 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340295 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 14:52:56.431475 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340297 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 14:52:56.432103 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340300 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 14:52:56.432103 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340303 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 14:52:56.432103 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340306 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 14:52:56.432103 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340309 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 13 14:52:56.432103 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340312 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 14:52:56.432103 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340314 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 14:52:56.432103 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340317 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 14:52:56.432103 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340319 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 14:52:56.432103 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340322 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 14:52:56.432103 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340325 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 14:52:56.432103 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340333 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 14:52:56.432103 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340336 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 14:52:56.432103 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340338 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 14:52:56.432103 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340341 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 14:52:56.432103 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340344 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 14:52:56.432103 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340349 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 14:52:56.432103 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340352 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 14:52:56.432103 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340355 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 14:52:56.432103 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340357 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 14:52:56.432103 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340360 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 14:52:56.433145 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340363 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 14:52:56.433145 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340365 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 14:52:56.433145 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340368 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 14:52:56.433145 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340370 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 14:52:56.433145 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340373 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 14:52:56.433145 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340375 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 14:52:56.433145 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340378 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 14:52:56.433145 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340380 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 14:52:56.433145 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340383 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 14:52:56.433145 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340385 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 14:52:56.433145 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340388 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 14:52:56.433145 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340390 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 14:52:56.433145 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340394 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 14:52:56.433145 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340396 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 14:52:56.433145 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340864 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 14:52:56.433145 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340869 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 14:52:56.433145 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340872 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 14:52:56.433145 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340875 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 14:52:56.433145 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340878 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 14:52:56.433145 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340880 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 14:52:56.433803 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340883 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 14:52:56.433803 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340885 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 14:52:56.433803 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340893 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 14:52:56.433803 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340896 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 14:52:56.433803 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340898 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 14:52:56.433803 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340901 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 14:52:56.433803 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340903 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 14:52:56.433803 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340908 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 14:52:56.433803 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340910 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 14:52:56.433803 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340913 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 14:52:56.433803 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340915 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 14:52:56.433803 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340918 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 14:52:56.433803 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340920 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 14:52:56.433803 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340922 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 14:52:56.433803 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340925 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 14:52:56.433803 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340927 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 14:52:56.433803 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340930 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 14:52:56.433803 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340932 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 14:52:56.433803 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340934 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 14:52:56.433803 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340937 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 14:52:56.434834 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340939 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 13 14:52:56.434834 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340942 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 14:52:56.434834 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340945 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 14:52:56.434834 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340947 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 14:52:56.434834 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340951 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 14:52:56.434834 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340953 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 14:52:56.434834 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340956 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 14:52:56.434834 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340960 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 14:52:56.434834 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340963 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 14:52:56.434834 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340966 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 14:52:56.434834 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340969 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 14:52:56.434834 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340972 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 14:52:56.434834 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340974 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 14:52:56.434834 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340977 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 14:52:56.434834 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340980 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 14:52:56.434834 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340988 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 14:52:56.434834 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340991 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 14:52:56.434834 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340994 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 14:52:56.434834 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.340996 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 14:52:56.434834 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341000 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 14:52:56.435621 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341003 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 14:52:56.435621 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341005 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 14:52:56.435621 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341008 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 14:52:56.435621 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341013 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 14:52:56.435621 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341016 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 14:52:56.435621 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341019 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 14:52:56.435621 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341021 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 14:52:56.435621 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341024 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 14:52:56.435621 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341027 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 14:52:56.435621 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341030 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 14:52:56.435621 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341032 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 14:52:56.435621 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341035 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 14:52:56.435621 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341037 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 14:52:56.435621 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341040 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 14:52:56.435621 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341042 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 14:52:56.435621 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341052 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 14:52:56.435621 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341054 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 14:52:56.435621 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341057 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 14:52:56.435621 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341059 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 14:52:56.504974 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341062 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 14:52:56.504974 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341064 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 14:52:56.504974 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341068 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 14:52:56.504974 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341071 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 14:52:56.504974 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341074 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 14:52:56.504974 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341077 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 14:52:56.504974 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341080 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 14:52:56.504974 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341082 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 14:52:56.504974 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341085 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 14:52:56.504974 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341093 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 14:52:56.504974 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341095 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 14:52:56.504974 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341098 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 14:52:56.504974 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341102 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 14:52:56.504974 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341105 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 14:52:56.504974 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341107 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 14:52:56.504974 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341109 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 14:52:56.504974 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341112 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 14:52:56.504974 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341114 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 14:52:56.504974 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341119 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 14:52:56.505666 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341122 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 14:52:56.505666 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341124 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 14:52:56.505666 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341126 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 14:52:56.505666 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341129 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 14:52:56.505666 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341131 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 14:52:56.505666 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341134 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 14:52:56.505666 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341136 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 14:52:56.505666 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341139 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 14:52:56.505666 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341141 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 14:52:56.505666 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341144 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 14:52:56.505666 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341146 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 14:52:56.505666 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341149 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 14:52:56.505666 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341151 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 14:52:56.505666 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341154 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 14:52:56.505666 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.341156 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 14:52:56.505666 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341232 2577 flags.go:64] FLAG: --address="0.0.0.0" Jul 13 14:52:56.505666 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341242 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 13 14:52:56.505666 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341256 2577 flags.go:64] FLAG: --anonymous-auth="true" Jul 13 14:52:56.505666 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341263 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 13 14:52:56.505666 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341269 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 13 14:52:56.505666 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341273 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 13 14:52:56.506916 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341279 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 13 14:52:56.506916 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341286 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 13 14:52:56.506916 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341296 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 13 14:52:56.506916 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341299 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 13 14:52:56.506916 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341304 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 13 14:52:56.506916 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341307 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 13 14:52:56.506916 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341310 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 13 14:52:56.506916 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341313 2577 flags.go:64] FLAG: --cgroup-root="" Jul 13 14:52:56.506916 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341316 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 13 14:52:56.506916 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341319 2577 flags.go:64] FLAG: --client-ca-file="" Jul 13 14:52:56.506916 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341323 2577 flags.go:64] FLAG: --cloud-provider="external" Jul 13 14:52:56.506916 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341326 2577 flags.go:64] FLAG: --cluster-dns="[]" Jul 13 14:52:56.506916 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341333 2577 flags.go:64] FLAG: --cluster-domain="" Jul 13 14:52:56.506916 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341336 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 13 14:52:56.506916 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341339 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 13 14:52:56.506916 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341342 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 13 14:52:56.506916 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341345 2577 flags.go:64] FLAG: --container-log-max-files="5" Jul 13 14:52:56.506916 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341349 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 13 14:52:56.506916 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341352 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 13 14:52:56.506916 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341355 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 13 14:52:56.506916 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341358 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 13 14:52:56.506916 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341361 2577 flags.go:64] FLAG: --contention-profiling="false" Jul 13 14:52:56.506916 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341364 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 13 14:52:56.506916 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341367 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 13 14:52:56.507713 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341370 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 13 14:52:56.507713 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341373 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 13 14:52:56.507713 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341377 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 13 14:52:56.507713 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341380 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 13 14:52:56.507713 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341382 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 13 14:52:56.507713 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341385 2577 flags.go:64] FLAG: --enable-load-reader="false" Jul 13 14:52:56.507713 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341388 2577 flags.go:64] FLAG: --enable-server="true" Jul 13 14:52:56.507713 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341391 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 13 14:52:56.507713 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341397 2577 flags.go:64] FLAG: --event-burst="100" Jul 13 14:52:56.507713 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341400 2577 flags.go:64] FLAG: --event-qps="50" Jul 13 14:52:56.507713 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341403 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 13 14:52:56.507713 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341418 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 13 14:52:56.507713 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341425 2577 flags.go:64] FLAG: --eviction-hard="" Jul 13 14:52:56.507713 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341431 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 13 14:52:56.507713 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341434 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 13 14:52:56.507713 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341439 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 13 14:52:56.507713 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341443 2577 flags.go:64] FLAG: --eviction-soft="" Jul 13 14:52:56.507713 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341447 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 13 14:52:56.507713 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341470 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 13 14:52:56.507713 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341475 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 13 14:52:56.507713 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341479 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jul 13 14:52:56.507713 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341483 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 13 14:52:56.507713 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341486 2577 flags.go:64] FLAG: --fail-swap-on="true" Jul 13 14:52:56.507713 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341489 2577 flags.go:64] FLAG: --feature-gates="" Jul 13 14:52:56.507713 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341493 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jul 13 14:52:56.509118 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341496 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 13 14:52:56.509118 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341499 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 13 14:52:56.509118 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341504 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 13 14:52:56.509118 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341508 2577 flags.go:64] FLAG: --healthz-port="10248" Jul 13 14:52:56.509118 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341513 2577 flags.go:64] FLAG: --help="false" Jul 13 14:52:56.509118 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341517 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-134-237.ec2.internal" Jul 13 14:52:56.509118 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341521 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 13 14:52:56.509118 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341526 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jul 13 14:52:56.509118 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341530 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 13 14:52:56.509118 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341537 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 13 14:52:56.509118 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341543 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 13 14:52:56.509118 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341547 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 13 14:52:56.509118 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341551 2577 flags.go:64] FLAG: --image-service-endpoint="" Jul 13 14:52:56.509118 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341556 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 13 14:52:56.509118 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341560 2577 flags.go:64] FLAG: --kube-api-burst="100" Jul 13 14:52:56.509118 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341564 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 13 14:52:56.509118 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341569 2577 flags.go:64] FLAG: --kube-api-qps="50" Jul 13 14:52:56.509118 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341574 2577 flags.go:64] FLAG: --kube-reserved="" Jul 13 14:52:56.509118 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341578 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 13 14:52:56.509118 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341591 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 13 14:52:56.509118 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341596 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jul 13 14:52:56.509118 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341600 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 13 14:52:56.509118 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341604 2577 flags.go:64] FLAG: --lock-file="" Jul 13 14:52:56.509118 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341608 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 13 14:52:56.513499 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341612 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 13 14:52:56.513499 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341619 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 13 14:52:56.513499 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341627 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jul 13 14:52:56.513499 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341631 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 13 14:52:56.513499 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341636 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jul 13 14:52:56.513499 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341640 2577 flags.go:64] FLAG: --logging-format="text" Jul 13 14:52:56.513499 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341644 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 13 14:52:56.513499 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341649 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 13 14:52:56.513499 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341653 2577 flags.go:64] FLAG: --manifest-url="" Jul 13 14:52:56.513499 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341657 2577 flags.go:64] FLAG: --manifest-url-header="" Jul 13 14:52:56.513499 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341664 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 13 14:52:56.513499 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341668 2577 flags.go:64] FLAG: --max-open-files="1000000" Jul 13 14:52:56.513499 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341674 2577 flags.go:64] FLAG: --max-pods="110" Jul 13 14:52:56.513499 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341678 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 13 14:52:56.513499 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341687 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 13 14:52:56.513499 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341691 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jul 13 14:52:56.513499 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341695 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 13 14:52:56.513499 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341700 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 13 14:52:56.513499 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341704 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 13 14:52:56.513499 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341709 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 13 14:52:56.513499 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341719 2577 flags.go:64] FLAG: --node-status-max-images="50" Jul 13 14:52:56.513499 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341722 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 13 14:52:56.513499 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341725 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jul 13 14:52:56.513499 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341730 2577 flags.go:64] FLAG: --pod-cidr="" Jul 13 14:52:56.514183 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341734 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 13 14:52:56.514183 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341741 2577 flags.go:64] FLAG: --pod-manifest-path="" Jul 13 14:52:56.514183 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341745 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jul 13 14:52:56.514183 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341750 2577 flags.go:64] FLAG: --pods-per-core="0" Jul 13 14:52:56.514183 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341765 2577 flags.go:64] FLAG: --port="10250" Jul 13 14:52:56.514183 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341770 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 13 14:52:56.514183 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341789 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02095b6de5d64ccec" Jul 13 14:52:56.514183 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341794 2577 flags.go:64] FLAG: --qos-reserved="" Jul 13 14:52:56.514183 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341799 2577 flags.go:64] FLAG: --read-only-port="10255" Jul 13 14:52:56.514183 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341805 2577 flags.go:64] FLAG: --register-node="true" Jul 13 14:52:56.514183 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341809 2577 flags.go:64] FLAG: --register-with-taints="" Jul 13 14:52:56.514183 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341814 2577 flags.go:64] FLAG: --registry-burst="10" Jul 13 14:52:56.514183 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341819 2577 flags.go:64] FLAG: --registry-qps="5" Jul 13 14:52:56.514183 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341823 2577 flags.go:64] FLAG: --reserved-cpus="" Jul 13 14:52:56.514183 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341827 2577 flags.go:64] FLAG: --reserved-memory="" Jul 13 14:52:56.514183 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341833 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 13 14:52:56.514183 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341838 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 13 14:52:56.514183 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341842 2577 flags.go:64] FLAG: --rotate-certificates="false" Jul 13 14:52:56.514183 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341847 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 13 14:52:56.514183 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341851 2577 flags.go:64] FLAG: --runonce="false" Jul 13 14:52:56.514183 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341856 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 13 14:52:56.514183 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341860 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 13 14:52:56.514183 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341865 2577 flags.go:64] FLAG: --seccomp-default="false" Jul 13 14:52:56.514183 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341869 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 13 14:52:56.514183 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341873 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 13 14:52:56.514882 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341877 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 13 14:52:56.514882 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341881 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 13 14:52:56.514882 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341886 2577 flags.go:64] FLAG: --storage-driver-password="root" Jul 13 14:52:56.514882 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341890 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jul 13 14:52:56.514882 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341894 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jul 13 14:52:56.514882 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341898 2577 flags.go:64] FLAG: --storage-driver-user="root" Jul 13 14:52:56.514882 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341902 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 13 14:52:56.514882 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341906 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 13 14:52:56.514882 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341910 2577 flags.go:64] FLAG: --system-cgroups="" Jul 13 14:52:56.514882 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341915 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 13 14:52:56.514882 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341923 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 13 14:52:56.514882 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341928 2577 flags.go:64] FLAG: --tls-cert-file="" Jul 13 14:52:56.514882 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341938 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 13 14:52:56.514882 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341947 2577 flags.go:64] FLAG: --tls-min-version="" Jul 13 14:52:56.514882 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341951 2577 flags.go:64] FLAG: --tls-private-key-file="" Jul 13 14:52:56.514882 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341955 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jul 13 14:52:56.514882 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341961 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 13 14:52:56.514882 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341965 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jul 13 14:52:56.514882 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341970 2577 flags.go:64] FLAG: --v="2" Jul 13 14:52:56.514882 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341976 2577 flags.go:64] FLAG: --version="false" Jul 13 14:52:56.514882 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341982 2577 flags.go:64] FLAG: --vmodule="" Jul 13 14:52:56.514882 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341987 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 13 14:52:56.514882 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.341992 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 13 14:52:56.514882 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342231 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 14:52:56.514882 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342238 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 14:52:56.516480 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342242 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 14:52:56.516480 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342245 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 14:52:56.516480 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342249 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 14:52:56.516480 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342253 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 14:52:56.516480 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342257 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 14:52:56.516480 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342260 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 14:52:56.516480 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342264 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 14:52:56.516480 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342268 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 14:52:56.516480 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342272 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 14:52:56.516480 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342276 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 14:52:56.516480 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342280 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 14:52:56.516480 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342284 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 14:52:56.516480 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342287 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 14:52:56.516480 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342292 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 14:52:56.516480 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342295 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 14:52:56.516480 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342300 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 14:52:56.516480 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342304 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 14:52:56.516480 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342307 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 14:52:56.516480 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342313 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 14:52:56.517155 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342317 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 14:52:56.517155 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342328 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 14:52:56.517155 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342332 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 14:52:56.517155 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342335 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 14:52:56.517155 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342341 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 14:52:56.517155 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342345 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 14:52:56.517155 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342349 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 14:52:56.517155 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342353 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 14:52:56.517155 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342356 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 14:52:56.517155 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342360 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 14:52:56.517155 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342363 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 14:52:56.517155 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342365 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 14:52:56.517155 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342369 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 14:52:56.517155 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342374 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 14:52:56.517155 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342380 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 14:52:56.517155 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342385 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 14:52:56.517155 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342388 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 14:52:56.517155 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342392 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 14:52:56.517155 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342396 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 14:52:56.517155 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342400 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 14:52:56.518106 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342404 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 14:52:56.518106 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342408 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 14:52:56.518106 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342411 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 14:52:56.518106 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342415 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 14:52:56.518106 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342419 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 14:52:56.518106 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342423 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 14:52:56.518106 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342426 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 14:52:56.518106 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342430 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 13 14:52:56.518106 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342434 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 14:52:56.518106 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342437 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 14:52:56.518106 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342441 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 14:52:56.518106 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342446 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 14:52:56.518106 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342450 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 14:52:56.518106 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342454 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 14:52:56.518106 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342459 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 14:52:56.518106 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342463 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 14:52:56.518106 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342468 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 14:52:56.518106 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342472 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 14:52:56.518106 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342476 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 14:52:56.518106 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342480 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 14:52:56.520512 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342484 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 14:52:56.520512 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342487 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 14:52:56.520512 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342491 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 14:52:56.520512 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342495 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 14:52:56.520512 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342498 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 14:52:56.520512 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342502 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 14:52:56.520512 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342506 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 14:52:56.520512 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342512 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 14:52:56.520512 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342516 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 14:52:56.520512 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342520 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 14:52:56.520512 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342525 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 14:52:56.520512 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342530 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 14:52:56.520512 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342534 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 14:52:56.520512 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342538 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 14:52:56.520512 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342542 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 14:52:56.520512 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342547 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 14:52:56.520512 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342551 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 14:52:56.520512 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342554 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 14:52:56.520512 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342558 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 14:52:56.520512 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342562 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 14:52:56.521278 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342565 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 14:52:56.521278 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342569 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 14:52:56.521278 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342572 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 14:52:56.521278 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342576 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 14:52:56.521278 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342580 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 14:52:56.521278 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342584 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 14:52:56.521278 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342588 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 14:52:56.521278 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342592 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 14:52:56.521278 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342600 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 14:52:56.521278 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342604 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 14:52:56.521278 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342610 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 14:52:56.521278 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342614 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 14:52:56.521278 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342619 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 14:52:56.521278 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342623 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 14:52:56.521278 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342627 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 14:52:56.521278 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342631 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 14:52:56.521278 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342634 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 14:52:56.521278 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.342638 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 14:52:56.523293 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.343566 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 14:52:56.523293 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.350264 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 13 14:52:56.523293 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.350281 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 13 14:52:56.523293 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.350296 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 13 14:52:56.523293 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.350306 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 13 14:52:56.523293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350363 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 14:52:56.523293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350369 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 14:52:56.523293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350372 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 14:52:56.523293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350376 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 14:52:56.523293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350380 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 14:52:56.523293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350384 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 14:52:56.523293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350388 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 14:52:56.523293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350391 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 14:52:56.523293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350394 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 14:52:56.523293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350397 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 14:52:56.523782 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350399 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 14:52:56.523782 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350402 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 14:52:56.523782 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350405 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 14:52:56.523782 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350408 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 14:52:56.523782 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350411 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 14:52:56.523782 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350414 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 14:52:56.523782 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350417 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 14:52:56.523782 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350419 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 14:52:56.523782 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350422 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 14:52:56.523782 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350425 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 14:52:56.523782 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350427 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 14:52:56.523782 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350430 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 14:52:56.523782 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350433 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 14:52:56.523782 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350435 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 14:52:56.523782 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350438 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 14:52:56.523782 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350441 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 14:52:56.523782 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350444 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 14:52:56.523782 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350447 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 14:52:56.523782 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350450 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 14:52:56.523782 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350453 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 14:52:56.525269 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350456 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 14:52:56.525269 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350459 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 14:52:56.525269 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350463 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 14:52:56.525269 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350466 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 14:52:56.525269 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350469 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 14:52:56.525269 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350472 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 14:52:56.525269 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350475 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 14:52:56.525269 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350478 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 14:52:56.525269 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350481 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 14:52:56.525269 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350484 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 14:52:56.525269 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350487 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 14:52:56.525269 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350490 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 14:52:56.525269 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350493 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 14:52:56.525269 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350497 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 14:52:56.525269 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350500 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 14:52:56.525269 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350503 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 14:52:56.525269 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350505 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 14:52:56.525269 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350508 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 14:52:56.526011 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350511 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 14:52:56.526011 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350514 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 14:52:56.526011 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350516 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 14:52:56.526011 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350519 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 14:52:56.526011 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350522 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 14:52:56.526011 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350524 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 14:52:56.526011 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350527 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 14:52:56.526011 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350529 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 14:52:56.526011 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350532 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 14:52:56.526011 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350540 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 14:52:56.526011 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350542 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 14:52:56.526011 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350545 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 14:52:56.526011 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350548 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 14:52:56.526011 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350551 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 14:52:56.526011 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350554 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 14:52:56.526011 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350557 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 14:52:56.526011 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350560 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 14:52:56.526011 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350562 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 14:52:56.526011 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350565 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 14:52:56.526011 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350568 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 14:52:56.526768 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350570 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 14:52:56.526768 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350573 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 14:52:56.526768 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350575 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 14:52:56.526768 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350578 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 14:52:56.526768 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350580 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 14:52:56.526768 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350583 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 14:52:56.526768 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350585 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 14:52:56.526768 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350588 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 14:52:56.526768 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350590 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 14:52:56.526768 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350593 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 14:52:56.526768 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350595 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 14:52:56.526768 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350598 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 14:52:56.526768 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350600 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 14:52:56.526768 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350603 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 14:52:56.526768 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350605 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 14:52:56.526768 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350608 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 14:52:56.526768 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350610 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 14:52:56.526768 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350613 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 14:52:56.526768 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350615 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 14:52:56.526768 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350618 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 14:52:56.527519 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350620 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 14:52:56.527519 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350624 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 14:52:56.527519 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350627 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 14:52:56.527519 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350630 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 14:52:56.527519 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350632 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 13 14:52:56.527519 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350635 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 14:52:56.527519 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350638 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 14:52:56.527519 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350642 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 14:52:56.527519 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350645 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 14:52:56.527519 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350647 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 14:52:56.527519 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350650 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 14:52:56.527519 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.350668 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 14:52:56.527519 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350801 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 14:52:56.527519 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350808 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 14:52:56.527519 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350811 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 14:52:56.528023 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350814 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 14:52:56.528023 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350817 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 14:52:56.528023 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350819 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 14:52:56.528023 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350822 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 14:52:56.528023 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350825 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 14:52:56.528023 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350827 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 14:52:56.528023 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350830 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 14:52:56.528023 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350832 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 14:52:56.528023 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350835 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 14:52:56.528023 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350837 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 14:52:56.528023 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350841 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 14:52:56.528023 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350843 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 14:52:56.528023 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350846 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 14:52:56.528023 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350848 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 14:52:56.528023 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350851 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 14:52:56.528023 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350853 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 14:52:56.528023 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350856 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 14:52:56.528023 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350858 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 14:52:56.528023 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350863 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 14:52:56.528023 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350865 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 14:52:56.528752 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350868 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 14:52:56.528752 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350870 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 14:52:56.528752 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350876 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 14:52:56.528752 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350878 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 14:52:56.528752 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350880 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 14:52:56.528752 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350884 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 14:52:56.528752 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350886 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 14:52:56.528752 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350888 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 14:52:56.528752 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350891 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 14:52:56.528752 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350893 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 14:52:56.528752 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350897 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 14:52:56.528752 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350900 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 14:52:56.528752 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350902 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 14:52:56.528752 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350904 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 14:52:56.528752 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350907 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 14:52:56.528752 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350909 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 13 14:52:56.528752 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350912 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 14:52:56.528752 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350914 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 14:52:56.528752 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350916 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 14:52:56.529490 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350919 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 14:52:56.529490 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350921 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 14:52:56.529490 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350923 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 14:52:56.529490 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350926 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 14:52:56.529490 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350928 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 14:52:56.529490 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350930 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 14:52:56.529490 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350933 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 14:52:56.529490 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350935 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 14:52:56.529490 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350939 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 14:52:56.529490 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350942 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 14:52:56.529490 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350945 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 14:52:56.529490 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350948 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 14:52:56.529490 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350951 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 14:52:56.529490 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350954 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 14:52:56.529490 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350956 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 14:52:56.529490 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350960 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 14:52:56.529490 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350963 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 14:52:56.529490 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350965 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 14:52:56.529490 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350968 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 14:52:56.529490 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350971 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 14:52:56.530219 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350973 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 14:52:56.530219 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350976 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 14:52:56.530219 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350979 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 14:52:56.530219 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350981 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 14:52:56.530219 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350983 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 14:52:56.530219 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350986 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 14:52:56.530219 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350988 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 14:52:56.530219 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350991 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 14:52:56.530219 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350994 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 14:52:56.530219 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350996 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 14:52:56.530219 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.350998 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 14:52:56.530219 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.351001 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 14:52:56.530219 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.351005 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 14:52:56.530219 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.351008 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 14:52:56.530219 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.351010 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 14:52:56.530219 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.351013 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 14:52:56.530219 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.351016 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 14:52:56.530219 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.351018 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 14:52:56.530219 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.351021 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 14:52:56.530219 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.351024 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 14:52:56.531244 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.351026 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 14:52:56.531244 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.351029 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 14:52:56.531244 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.351031 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 14:52:56.531244 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.351035 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 14:52:56.531244 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.351038 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 14:52:56.531244 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.351040 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 14:52:56.531244 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.351042 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 14:52:56.531244 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.351046 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 14:52:56.531244 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.351049 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 14:52:56.531244 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.351051 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 14:52:56.531244 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.351054 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 14:52:56.531244 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.351056 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 14:52:56.531244 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.351060 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 14:52:56.531244 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.351063 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 14:52:56.531244 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.351066 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 14:52:56.531244 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.351069 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 14:52:56.531244 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:56.351072 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 14:52:56.532006 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.351077 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 14:52:56.532006 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.351193 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jul 13 14:52:56.532006 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.354066 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 13 14:52:56.532006 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.355529 2577 server.go:1019] "Starting client certificate rotation" Jul 13 14:52:56.532006 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.355627 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 14:52:56.532006 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.355667 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 14:52:56.532006 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.359593 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 14:52:56.532006 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.367429 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 14:52:56.532006 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.375446 2577 log.go:25] "Validated CRI v1 runtime API" Jul 13 14:52:56.532006 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.377837 2577 log.go:25] "Validated CRI v1 image API" Jul 13 14:52:56.532006 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.378697 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 13 14:52:56.532006 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.383291 2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a38e42bc-cda3-4cdf-b0c5-8a5b98091bf5:/dev/nvme0n1p3 ec2b5872-e909-43f0-8623-75f892a2ffa0:/dev/nvme0n1p4] Jul 13 14:52:56.532497 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.383311 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 13 14:52:56.532497 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.385583 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 14:52:56.593337 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.387458 2577 manager.go:216] Machine: {Timestamp:2026-07-13 14:52:56.387003548 +0000 UTC m=+0.453576004 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3177189 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2361006c2f28cfbb2bee03f48f38c1 SystemUUID:ec236100-6c2f-28cf-bb2b-ee03f48f38c1 BootID:af625714-e787-4d03-b551-6abf41060dca Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:77:98:a7:8a:67 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:77:98:a7:8a:67 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:17:1e:2f:ce:0a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 13 14:52:56.593337 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.387557 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 13 14:52:56.593337 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.387631 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 13 14:52:56.593337 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.388940 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 13 14:52:56.593337 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.388963 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-237.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 13 14:52:56.593337 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.390237 2577 topology_manager.go:138] "Creating topology manager with none policy" Jul 13 14:52:56.593337 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.390248 2577 container_manager_linux.go:309] "Creating device plugin manager" Jul 13 14:52:56.593337 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.390256 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 14:52:56.593337 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.390794 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 14:52:56.593337 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.392218 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 13 14:52:56.593337 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.395318 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 13 14:52:56.593337 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.395435 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 13 14:52:56.593337 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.395466 2577 kubelet.go:486] "Attempting to sync node with API server" Jul 13 14:52:56.593337 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.395482 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 13 14:52:56.593337 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.395500 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 13 14:52:56.593337 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.395510 2577 kubelet.go:398] "Adding apiserver pod source" Jul 13 14:52:56.593337 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.395518 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 13 14:52:56.593337 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.395946 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.395966 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.400907 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.403164 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.403192 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.403324 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.403336 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.403343 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.403351 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.403362 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.403371 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.403814 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.403821 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.403828 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.403833 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.403842 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.403851 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.404649 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.404655 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.407899 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-237.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:56.408038 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:56.408099 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-237.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.408256 2577 server.go:1268] "Started kubelet" Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.408289 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.408546 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.408649 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.411107 2577 server.go:310] "Adding debug handlers to kubelet server" Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.414319 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:56.416203 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:56.415798 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-237.ec2.internal.18c1e10db54efc39 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-237.ec2.internal,UID:ip-10-0-134-237.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-237.ec2.internal,},FirstTimestamp:2026-07-13 14:52:56.408103993 +0000 UTC m=+0.474676449,LastTimestamp:2026-07-13 14:52:56.408103993 +0000 UTC m=+0.474676449,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-237.ec2.internal,}" Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.419278 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.419297 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:56.419386 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-237.ec2.internal\" not found" Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.420345 2577 factory.go:55] Registering systemd factory Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.420360 2577 factory.go:223] Registration of the systemd container factory successfully Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.420575 2577 factory.go:153] Registering CRI-O factory Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.420592 2577 factory.go:223] Registration of the crio container factory successfully Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.420649 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.420669 2577 factory.go:103] Registering Raw factory Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.420686 2577 manager.go:1196] Started watching for new ooms in manager Jul 13 14:52:56.594066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.421069 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 13 14:52:56.596522 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.421069 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 13 14:52:56.596522 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.421102 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 13 14:52:56.596522 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.421321 2577 manager.go:349] Starting recovery of all containers Jul 13 14:52:56.596522 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.421422 2577 reconstruct.go:97] "Volume reconstruction finished" Jul 13 14:52:56.596522 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.421434 2577 reconciler.go:29] "Reconciler: start to sync state" Jul 13 14:52:56.596522 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.434625 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dtxjf" Jul 13 14:52:56.596522 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.434643 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dtxjf" Jul 13 14:52:56.596522 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.440270 2577 manager.go:354] Recovery completed Jul 13 14:52:56.596522 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.443054 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 14:52:56.596522 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.445122 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 14:52:56.596522 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:56.446571 2577 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-237.ec2.internal\" not found" node="ip-10-0-134-237.ec2.internal" Jul 13 14:52:56.596522 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.446790 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-237.ec2.internal" event="NodeHasSufficientMemory" Jul 13 14:52:56.596522 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.446825 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-237.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 14:52:56.596522 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.446838 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-237.ec2.internal" event="NodeHasSufficientPID" Jul 13 14:52:56.596522 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.448342 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 13 14:52:56.596522 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.448348 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 14:52:56.596522 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.448351 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 13 14:52:56.596522 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.448366 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 13 14:52:56.596522 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.449207 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-237.ec2.internal" event="NodeHasSufficientMemory" Jul 13 14:52:56.596522 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.449236 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-237.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 14:52:56.596522 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.449250 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-237.ec2.internal" event="NodeHasSufficientPID" Jul 13 14:52:57.050573 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.449438 2577 policy_none.go:49] "None policy: Start" Jul 13 14:52:57.050573 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.997891 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 13 14:52:57.050573 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.997916 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 13 14:52:57.050573 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:56.520453 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-237.ec2.internal\" not found" Jul 13 14:52:57.050573 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:56.999466 2577 policy_none.go:47] "Start" Jul 13 14:52:57.144396 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:57.144371 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-237.ec2.internal\" not found" Jul 13 14:52:57.175437 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.175421 2577 manager.go:337] "Starting Device Plugin manager" Jul 13 14:52:57.175502 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:57.175455 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 13 14:52:57.175502 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.175464 2577 server.go:87] "Starting device plugin registration server" Jul 13 14:52:57.175695 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.175682 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 13 14:52:57.175752 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.175697 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 13 14:52:57.176022 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.175810 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 13 14:52:57.176130 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.176082 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 13 14:52:57.176130 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.176097 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 13 14:52:57.176494 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:57.176474 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 13 14:52:57.176556 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:57.176532 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-237.ec2.internal\" not found" Jul 13 14:52:57.275302 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.275280 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 14:52:57.276819 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.276389 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 14:52:57.277306 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.277291 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-237.ec2.internal" event="NodeHasSufficientMemory" Jul 13 14:52:57.277369 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.277319 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-237.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 14:52:57.277369 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.277331 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-237.ec2.internal" event="NodeHasSufficientPID" Jul 13 14:52:57.277369 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.277354 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-237.ec2.internal" Jul 13 14:52:57.286336 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.286317 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-237.ec2.internal" Jul 13 14:52:57.337867 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.337836 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 13 14:52:57.339071 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.339049 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 13 14:52:57.339146 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.339085 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 13 14:52:57.339146 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.339114 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jul 13 14:52:57.339146 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:57.339144 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 13 14:52:57.343883 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.343846 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 14:52:57.355368 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.355354 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 13 14:52:57.355521 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.355499 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 14:52:57.355577 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.355508 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 14:52:57.396894 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.396851 2577 apiserver.go:52] "Watching apiserver" Jul 13 14:52:57.407525 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.407507 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 13 14:52:57.415874 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.415839 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 14:52:57.420326 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.420310 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 13 14:52:57.438101 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.438070 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 14:47:56 +0000 UTC" deadline="2028-01-13 21:29:43.000018832 +0000 UTC" Jul 13 14:52:57.438101 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.438095 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13182h36m45.561927444s" Jul 13 14:52:57.440019 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.439983 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-237.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-237.ec2.internal"] Jul 13 14:52:57.441573 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.441557 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-237.ec2.internal" Jul 13 14:52:57.442763 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.442747 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-bnrgl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wclwd","openshift-dns/node-resolver-cw5zb","openshift-multus/multus-additional-cni-plugins-m6xbq","openshift-network-diagnostics/network-check-target-gvdvc","openshift-ovn-kubernetes/ovnkube-node-hq8bg"] Jul 13 14:52:57.442898 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.442884 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-237.ec2.internal" Jul 13 14:52:57.444165 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.444150 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bnrgl" Jul 13 14:52:57.445410 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.445392 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wclwd" Jul 13 14:52:57.446582 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.446562 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cw5zb" Jul 13 14:52:57.447257 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.447238 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 13 14:52:57.447373 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.447356 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 13 14:52:57.447618 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.447435 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 14:52:57.448330 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.448310 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m6xbq" Jul 13 14:52:57.449576 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.449556 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:52:57.449673 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:57.449626 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvdvc" podUID="ecfa98f6-7abe-43a4-956d-b613d7e1d854" Jul 13 14:52:57.449762 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.449733 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tc4l2\"" Jul 13 14:52:57.450766 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.450749 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 13 14:52:57.450991 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.450971 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 13 14:52:57.450991 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.450981 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 13 14:52:57.451141 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.451004 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 13 14:52:57.451141 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.451021 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 13 14:52:57.451141 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.450982 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 13 14:52:57.451141 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.451099 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 13 14:52:57.451141 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.451104 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-xvxmb"] Jul 13 14:52:57.451328 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.451195 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 13 14:52:57.451368 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.451338 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.451512 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.451496 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jwlfp\"" Jul 13 14:52:57.451580 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.451564 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hj5cd\"" Jul 13 14:52:57.451987 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.451972 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 13 14:52:57.452036 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.451976 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 13 14:52:57.452036 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.452003 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5zfbr\"" Jul 13 14:52:57.452777 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.452763 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-6cfq7"] Jul 13 14:52:57.453710 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.453157 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xvxmb" Jul 13 14:52:57.455284 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.455264 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 13 14:52:57.455496 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.455478 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 13 14:52:57.455585 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.455529 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 13 14:52:57.455747 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.455724 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 13 14:52:57.455887 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.455868 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 13 14:52:57.455967 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.455892 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 13 14:52:57.455967 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.455899 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 13 14:52:57.456124 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.456108 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4cfp4\"" Jul 13 14:52:57.456188 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.456156 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sxjpg\"" Jul 13 14:52:57.456239 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.456187 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 13 14:52:57.456613 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.456597 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-4tv96"] Jul 13 14:52:57.456713 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.456696 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 13 14:52:57.456805 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.456696 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6cfq7" Jul 13 14:52:57.458183 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.458166 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-p5sxk"] Jul 13 14:52:57.458275 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.458261 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.459293 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.459277 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 13 14:52:57.459764 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.459751 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 13 14:52:57.459961 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.459948 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 13 14:52:57.460023 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.459960 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.460189 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.460175 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sb2kk\"" Jul 13 14:52:57.460339 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.460326 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 13 14:52:57.460401 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.460388 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gq9qr\"" Jul 13 14:52:57.463242 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.463227 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 13 14:52:57.463306 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.463269 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 13 14:52:57.463944 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.463931 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-237.ec2.internal" Jul 13 14:52:57.464037 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.463930 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tr8cz\"" Jul 13 14:52:57.470197 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.470183 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-237.ec2.internal" Jul 13 14:52:57.470301 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.470284 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bkcth" Jul 13 14:52:57.471019 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.471002 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-8gcng"] Jul 13 14:52:57.472771 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.472753 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:52:57.472872 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:57.472819 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gcng" podUID="40866c5d-2992-4d53-b839-e3dc5740b96d" Jul 13 14:52:57.481907 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.481889 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bkcth" Jul 13 14:52:57.481984 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.481958 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 14:52:57.482135 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.482120 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-237.ec2.internal"] Jul 13 14:52:57.485133 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.485115 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-237.ec2.internal"] Jul 13 14:52:57.485185 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.485139 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 14:52:57.499936 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.499920 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-vrbdc"] Jul 13 14:52:57.501592 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.501578 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:52:57.501653 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:57.501638 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrbdc" podUID="b4113ffd-a496-4d76-9f75-942100b26c23" Jul 13 14:52:57.521911 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.521897 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 13 14:52:57.527044 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527025 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-host-var-lib-kubelet\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.527162 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527050 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-host-run-netns\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.527162 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527119 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmpkv\" (UniqueName: \"kubernetes.io/projected/47635ebe-4411-4f30-bd50-d642f911219b-kube-api-access-kmpkv\") pod \"node-resolver-cw5zb\" (UID: \"47635ebe-4411-4f30-bd50-d642f911219b\") " pod="openshift-dns/node-resolver-cw5zb" Jul 13 14:52:57.527162 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527138 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6494a281-bde1-4cb8-a6db-1a319f3cfa4d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wclwd\" (UID: \"6494a281-bde1-4cb8-a6db-1a319f3cfa4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wclwd" Jul 13 14:52:57.527162 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527153 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-cnibin\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.527294 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527177 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4ccx\" (UniqueName: \"kubernetes.io/projected/40866c5d-2992-4d53-b839-e3dc5740b96d-kube-api-access-g4ccx\") pod \"network-metrics-daemon-8gcng\" (UID: \"40866c5d-2992-4d53-b839-e3dc5740b96d\") " pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:52:57.527294 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527219 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f105bdfa-cff6-4b9f-b5ac-7b386e2a9542-konnectivity-ca\") pod \"konnectivity-agent-bnrgl\" (UID: \"f105bdfa-cff6-4b9f-b5ac-7b386e2a9542\") " pod="kube-system/konnectivity-agent-bnrgl" Jul 13 14:52:57.527294 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527256 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6494a281-bde1-4cb8-a6db-1a319f3cfa4d-device-dir\") pod \"aws-ebs-csi-driver-node-wclwd\" (UID: \"6494a281-bde1-4cb8-a6db-1a319f3cfa4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wclwd" Jul 13 14:52:57.527294 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527281 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c96d9a00-a5ee-468a-ab1e-57fc28bda457-os-release\") pod \"multus-additional-cni-plugins-m6xbq\" (UID: \"c96d9a00-a5ee-468a-ab1e-57fc28bda457\") " pod="openshift-multus/multus-additional-cni-plugins-m6xbq" Jul 13 14:52:57.527485 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527339 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-run-ovn\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.527485 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527373 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-node-log\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.527485 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527411 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6494a281-bde1-4cb8-a6db-1a319f3cfa4d-socket-dir\") pod \"aws-ebs-csi-driver-node-wclwd\" (UID: \"6494a281-bde1-4cb8-a6db-1a319f3cfa4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wclwd" Jul 13 14:52:57.527485 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527438 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l7md\" (UniqueName: \"kubernetes.io/projected/d56a4953-1969-4be8-840e-ef390c117114-kube-api-access-9l7md\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.527485 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527473 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b9zw\" (UniqueName: \"kubernetes.io/projected/ecfa98f6-7abe-43a4-956d-b613d7e1d854-kube-api-access-9b9zw\") pod \"network-check-target-gvdvc\" (UID: \"ecfa98f6-7abe-43a4-956d-b613d7e1d854\") " pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:52:57.527671 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527500 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-host-var-lib-cni-bin\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.527671 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527517 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-host-var-lib-cni-multus\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.527671 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527543 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-multus-conf-dir\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.527671 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527560 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c96d9a00-a5ee-468a-ab1e-57fc28bda457-system-cni-dir\") pod \"multus-additional-cni-plugins-m6xbq\" (UID: \"c96d9a00-a5ee-468a-ab1e-57fc28bda457\") " pod="openshift-multus/multus-additional-cni-plugins-m6xbq" Jul 13 14:52:57.527671 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527575 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c96d9a00-a5ee-468a-ab1e-57fc28bda457-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m6xbq\" (UID: \"c96d9a00-a5ee-468a-ab1e-57fc28bda457\") " pod="openshift-multus/multus-additional-cni-plugins-m6xbq" Jul 13 14:52:57.527671 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527596 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-etc-kubernetes\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.527671 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527611 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-etc-sysctl-conf\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.527671 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527652 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-var-lib-kubelet\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.527671 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527668 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47635ebe-4411-4f30-bd50-d642f911219b-tmp-dir\") pod \"node-resolver-cw5zb\" (UID: \"47635ebe-4411-4f30-bd50-d642f911219b\") " pod="openshift-dns/node-resolver-cw5zb" Jul 13 14:52:57.528011 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527688 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c96d9a00-a5ee-468a-ab1e-57fc28bda457-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m6xbq\" (UID: \"c96d9a00-a5ee-468a-ab1e-57fc28bda457\") " pod="openshift-multus/multus-additional-cni-plugins-m6xbq" Jul 13 14:52:57.528011 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527715 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.528011 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527747 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/12195aca-5c5b-45a7-ba39-87ac34323f89-ovn-node-metrics-cert\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.528011 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527771 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9m84\" (UniqueName: \"kubernetes.io/projected/fa07f3f6-9861-4c60-9782-15bafe3f72d1-kube-api-access-j9m84\") pod \"iptables-alerter-xvxmb\" (UID: \"fa07f3f6-9861-4c60-9782-15bafe3f72d1\") " pod="openshift-network-operator/iptables-alerter-xvxmb" Jul 13 14:52:57.528011 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527789 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-run\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.528011 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527825 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-systemd-units\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.528011 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527840 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/127d8c73-93c5-4fd9-8ab5-9276bcee81be-serviceca\") pod \"node-ca-6cfq7\" (UID: \"127d8c73-93c5-4fd9-8ab5-9276bcee81be\") " pod="openshift-image-registry/node-ca-6cfq7" Jul 13 14:52:57.528011 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527854 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-host-cni-netd\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.528011 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527888 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa07f3f6-9861-4c60-9782-15bafe3f72d1-host-slash\") pod \"iptables-alerter-xvxmb\" (UID: \"fa07f3f6-9861-4c60-9782-15bafe3f72d1\") " pod="openshift-network-operator/iptables-alerter-xvxmb" Jul 13 14:52:57.528011 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527907 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-multus-socket-dir-parent\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.528011 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527922 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-host-run-netns\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.528011 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527955 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f105bdfa-cff6-4b9f-b5ac-7b386e2a9542-agent-certs\") pod \"konnectivity-agent-bnrgl\" (UID: \"f105bdfa-cff6-4b9f-b5ac-7b386e2a9542\") " pod="kube-system/konnectivity-agent-bnrgl" Jul 13 14:52:57.528011 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527979 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-log-socket\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.528011 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.527994 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-etc-modprobe-d\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.528011 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528012 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-etc-sysctl-d\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.528532 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528026 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/706ce44660952d0aec5f85bd24b8e4aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-237.ec2.internal\" (UID: \"706ce44660952d0aec5f85bd24b8e4aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-237.ec2.internal" Jul 13 14:52:57.528532 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528065 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/21e47eec-3d15-47fd-9cf8-dcaf27954260-multus-daemon-config\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.528532 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528087 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/04d9ec37c251ad9524965495843a7e0c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-237.ec2.internal\" (UID: \"04d9ec37c251ad9524965495843a7e0c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-237.ec2.internal" Jul 13 14:52:57.528532 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528120 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6494a281-bde1-4cb8-a6db-1a319f3cfa4d-registration-dir\") pod \"aws-ebs-csi-driver-node-wclwd\" (UID: \"6494a281-bde1-4cb8-a6db-1a319f3cfa4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wclwd" Jul 13 14:52:57.528532 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528142 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdckm\" (UniqueName: \"kubernetes.io/projected/6494a281-bde1-4cb8-a6db-1a319f3cfa4d-kube-api-access-cdckm\") pod \"aws-ebs-csi-driver-node-wclwd\" (UID: \"6494a281-bde1-4cb8-a6db-1a319f3cfa4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wclwd" Jul 13 14:52:57.528532 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528159 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/47635ebe-4411-4f30-bd50-d642f911219b-hosts-file\") pod \"node-resolver-cw5zb\" (UID: \"47635ebe-4411-4f30-bd50-d642f911219b\") " pod="openshift-dns/node-resolver-cw5zb" Jul 13 14:52:57.528532 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528174 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-lib-modules\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.528532 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528188 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c96d9a00-a5ee-468a-ab1e-57fc28bda457-cnibin\") pod \"multus-additional-cni-plugins-m6xbq\" (UID: \"c96d9a00-a5ee-468a-ab1e-57fc28bda457\") " pod="openshift-multus/multus-additional-cni-plugins-m6xbq" Jul 13 14:52:57.528532 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528215 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/12195aca-5c5b-45a7-ba39-87ac34323f89-ovnkube-config\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.528532 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528244 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-host\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.528532 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528264 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/706ce44660952d0aec5f85bd24b8e4aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-237.ec2.internal\" (UID: \"706ce44660952d0aec5f85bd24b8e4aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-237.ec2.internal" Jul 13 14:52:57.528532 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528287 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-system-cni-dir\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.528532 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528306 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4113ffd-a496-4d76-9f75-942100b26c23-original-pull-secret\") pod \"global-pull-secret-syncer-vrbdc\" (UID: \"b4113ffd-a496-4d76-9f75-942100b26c23\") " pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:52:57.528532 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528321 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-run-openvswitch\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.528532 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528350 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/127d8c73-93c5-4fd9-8ab5-9276bcee81be-host\") pod \"node-ca-6cfq7\" (UID: \"127d8c73-93c5-4fd9-8ab5-9276bcee81be\") " pod="openshift-image-registry/node-ca-6cfq7" Jul 13 14:52:57.528532 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528366 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ftzp\" (UniqueName: \"kubernetes.io/projected/127d8c73-93c5-4fd9-8ab5-9276bcee81be-kube-api-access-2ftzp\") pod \"node-ca-6cfq7\" (UID: \"127d8c73-93c5-4fd9-8ab5-9276bcee81be\") " pod="openshift-image-registry/node-ca-6cfq7" Jul 13 14:52:57.529268 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528381 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-var-lib-openvswitch\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.529268 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528395 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-etc-systemd\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.529268 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528409 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21e47eec-3d15-47fd-9cf8-dcaf27954260-cni-binary-copy\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.529268 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528422 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-hostroot\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.529268 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528436 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-host-run-multus-certs\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.529268 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528465 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b4113ffd-a496-4d76-9f75-942100b26c23-kubelet-config\") pod \"global-pull-secret-syncer-vrbdc\" (UID: \"b4113ffd-a496-4d76-9f75-942100b26c23\") " pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:52:57.529268 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528494 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-host-slash\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.529268 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528511 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-run-systemd\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.529268 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528551 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6494a281-bde1-4cb8-a6db-1a319f3cfa4d-sys-fs\") pod \"aws-ebs-csi-driver-node-wclwd\" (UID: \"6494a281-bde1-4cb8-a6db-1a319f3cfa4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wclwd" Jul 13 14:52:57.529268 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528591 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c96d9a00-a5ee-468a-ab1e-57fc28bda457-cni-binary-copy\") pod \"multus-additional-cni-plugins-m6xbq\" (UID: \"c96d9a00-a5ee-468a-ab1e-57fc28bda457\") " pod="openshift-multus/multus-additional-cni-plugins-m6xbq" Jul 13 14:52:57.529268 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528616 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-os-release\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.529268 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528641 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdktq\" (UniqueName: \"kubernetes.io/projected/21e47eec-3d15-47fd-9cf8-dcaf27954260-kube-api-access-mdktq\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.529268 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528675 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-host-kubelet\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.529268 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528700 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-host-run-ovn-kubernetes\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.529268 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528724 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/12195aca-5c5b-45a7-ba39-87ac34323f89-ovnkube-script-lib\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.529268 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528747 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92j9w\" (UniqueName: \"kubernetes.io/projected/12195aca-5c5b-45a7-ba39-87ac34323f89-kube-api-access-92j9w\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.529711 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528785 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-etc-sysconfig\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.529711 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528832 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-etc-kubernetes\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.529711 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528861 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40866c5d-2992-4d53-b839-e3dc5740b96d-metrics-certs\") pod \"network-metrics-daemon-8gcng\" (UID: \"40866c5d-2992-4d53-b839-e3dc5740b96d\") " pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:52:57.529711 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528889 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b4113ffd-a496-4d76-9f75-942100b26c23-dbus\") pod \"global-pull-secret-syncer-vrbdc\" (UID: \"b4113ffd-a496-4d76-9f75-942100b26c23\") " pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:52:57.529711 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528913 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c96d9a00-a5ee-468a-ab1e-57fc28bda457-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m6xbq\" (UID: \"c96d9a00-a5ee-468a-ab1e-57fc28bda457\") " pod="openshift-multus/multus-additional-cni-plugins-m6xbq" Jul 13 14:52:57.529711 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528936 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-etc-openvswitch\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.529711 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528960 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-host-cni-bin\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.529711 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.528989 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/12195aca-5c5b-45a7-ba39-87ac34323f89-env-overrides\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.529711 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.529011 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-sys\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.529711 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.529037 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d56a4953-1969-4be8-840e-ef390c117114-tmp\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.529711 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.529063 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-multus-cni-dir\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.529711 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.529102 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-host-run-k8s-cni-cncf-io\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.529711 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.529136 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6494a281-bde1-4cb8-a6db-1a319f3cfa4d-etc-selinux\") pod \"aws-ebs-csi-driver-node-wclwd\" (UID: \"6494a281-bde1-4cb8-a6db-1a319f3cfa4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wclwd" Jul 13 14:52:57.529711 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.529176 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5gbz\" (UniqueName: \"kubernetes.io/projected/c96d9a00-a5ee-468a-ab1e-57fc28bda457-kube-api-access-l5gbz\") pod \"multus-additional-cni-plugins-m6xbq\" (UID: \"c96d9a00-a5ee-468a-ab1e-57fc28bda457\") " pod="openshift-multus/multus-additional-cni-plugins-m6xbq" Jul 13 14:52:57.529711 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.529199 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fa07f3f6-9861-4c60-9782-15bafe3f72d1-iptables-alerter-script\") pod \"iptables-alerter-xvxmb\" (UID: \"fa07f3f6-9861-4c60-9782-15bafe3f72d1\") " pod="openshift-network-operator/iptables-alerter-xvxmb" Jul 13 14:52:57.529711 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.529239 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d56a4953-1969-4be8-840e-ef390c117114-etc-tuned\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.629900 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.629876 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdckm\" (UniqueName: \"kubernetes.io/projected/6494a281-bde1-4cb8-a6db-1a319f3cfa4d-kube-api-access-cdckm\") pod \"aws-ebs-csi-driver-node-wclwd\" (UID: \"6494a281-bde1-4cb8-a6db-1a319f3cfa4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wclwd" Jul 13 14:52:57.630018 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.629905 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/47635ebe-4411-4f30-bd50-d642f911219b-hosts-file\") pod \"node-resolver-cw5zb\" (UID: \"47635ebe-4411-4f30-bd50-d642f911219b\") " pod="openshift-dns/node-resolver-cw5zb" Jul 13 14:52:57.630018 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.629921 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-lib-modules\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.630018 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.629937 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c96d9a00-a5ee-468a-ab1e-57fc28bda457-cnibin\") pod \"multus-additional-cni-plugins-m6xbq\" (UID: \"c96d9a00-a5ee-468a-ab1e-57fc28bda457\") " pod="openshift-multus/multus-additional-cni-plugins-m6xbq" Jul 13 14:52:57.630018 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.629952 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/12195aca-5c5b-45a7-ba39-87ac34323f89-ovnkube-config\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.630018 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.629966 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-host\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.630018 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.629987 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/706ce44660952d0aec5f85bd24b8e4aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-237.ec2.internal\" (UID: \"706ce44660952d0aec5f85bd24b8e4aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-237.ec2.internal" Jul 13 14:52:57.630018 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630005 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-system-cni-dir\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.630018 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630011 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/47635ebe-4411-4f30-bd50-d642f911219b-hosts-file\") pod \"node-resolver-cw5zb\" (UID: \"47635ebe-4411-4f30-bd50-d642f911219b\") " pod="openshift-dns/node-resolver-cw5zb" Jul 13 14:52:57.630476 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630055 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/706ce44660952d0aec5f85bd24b8e4aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-237.ec2.internal\" (UID: \"706ce44660952d0aec5f85bd24b8e4aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-237.ec2.internal" Jul 13 14:52:57.630476 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630061 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c96d9a00-a5ee-468a-ab1e-57fc28bda457-cnibin\") pod \"multus-additional-cni-plugins-m6xbq\" (UID: \"c96d9a00-a5ee-468a-ab1e-57fc28bda457\") " pod="openshift-multus/multus-additional-cni-plugins-m6xbq" Jul 13 14:52:57.630476 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630084 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-lib-modules\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.630476 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630092 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-host\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.630476 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630146 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4113ffd-a496-4d76-9f75-942100b26c23-original-pull-secret\") pod \"global-pull-secret-syncer-vrbdc\" (UID: \"b4113ffd-a496-4d76-9f75-942100b26c23\") " pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:52:57.630476 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630180 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-run-openvswitch\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.630476 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630185 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-system-cni-dir\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.630476 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630205 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/127d8c73-93c5-4fd9-8ab5-9276bcee81be-host\") pod \"node-ca-6cfq7\" (UID: \"127d8c73-93c5-4fd9-8ab5-9276bcee81be\") " pod="openshift-image-registry/node-ca-6cfq7" Jul 13 14:52:57.630476 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630230 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ftzp\" (UniqueName: \"kubernetes.io/projected/127d8c73-93c5-4fd9-8ab5-9276bcee81be-kube-api-access-2ftzp\") pod \"node-ca-6cfq7\" (UID: \"127d8c73-93c5-4fd9-8ab5-9276bcee81be\") " pod="openshift-image-registry/node-ca-6cfq7" Jul 13 14:52:57.630476 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630232 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-run-openvswitch\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.630476 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630256 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-var-lib-openvswitch\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.630476 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:57.630273 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 14:52:57.630476 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630286 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-etc-systemd\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.630476 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630307 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-var-lib-openvswitch\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.630476 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630317 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21e47eec-3d15-47fd-9cf8-dcaf27954260-cni-binary-copy\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.630476 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630307 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/127d8c73-93c5-4fd9-8ab5-9276bcee81be-host\") pod \"node-ca-6cfq7\" (UID: \"127d8c73-93c5-4fd9-8ab5-9276bcee81be\") " pod="openshift-image-registry/node-ca-6cfq7" Jul 13 14:52:57.630476 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630347 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-hostroot\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.630476 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630368 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-etc-systemd\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.631408 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:57.630391 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4113ffd-a496-4d76-9f75-942100b26c23-original-pull-secret podName:b4113ffd-a496-4d76-9f75-942100b26c23 nodeName:}" failed. No retries permitted until 2026-07-13 14:52:58.130344003 +0000 UTC m=+2.196916470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4113ffd-a496-4d76-9f75-942100b26c23-original-pull-secret") pod "global-pull-secret-syncer-vrbdc" (UID: "b4113ffd-a496-4d76-9f75-942100b26c23") : object "kube-system"/"original-pull-secret" not registered Jul 13 14:52:57.631408 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630400 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-hostroot\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.631408 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630431 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-host-run-multus-certs\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.631408 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630459 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b4113ffd-a496-4d76-9f75-942100b26c23-kubelet-config\") pod \"global-pull-secret-syncer-vrbdc\" (UID: \"b4113ffd-a496-4d76-9f75-942100b26c23\") " pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:52:57.631408 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630484 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-host-slash\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.631408 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630510 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-host-run-multus-certs\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.631408 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630532 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-run-systemd\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.631408 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630541 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b4113ffd-a496-4d76-9f75-942100b26c23-kubelet-config\") pod \"global-pull-secret-syncer-vrbdc\" (UID: \"b4113ffd-a496-4d76-9f75-942100b26c23\") " pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:52:57.631408 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630557 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6494a281-bde1-4cb8-a6db-1a319f3cfa4d-sys-fs\") pod \"aws-ebs-csi-driver-node-wclwd\" (UID: \"6494a281-bde1-4cb8-a6db-1a319f3cfa4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wclwd" Jul 13 14:52:57.631408 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630573 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-host-slash\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.631408 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630585 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c96d9a00-a5ee-468a-ab1e-57fc28bda457-cni-binary-copy\") pod \"multus-additional-cni-plugins-m6xbq\" (UID: \"c96d9a00-a5ee-468a-ab1e-57fc28bda457\") " pod="openshift-multus/multus-additional-cni-plugins-m6xbq" Jul 13 14:52:57.631408 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630598 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-run-systemd\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.631408 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630611 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-os-release\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.631408 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630628 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6494a281-bde1-4cb8-a6db-1a319f3cfa4d-sys-fs\") pod \"aws-ebs-csi-driver-node-wclwd\" (UID: \"6494a281-bde1-4cb8-a6db-1a319f3cfa4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wclwd" Jul 13 14:52:57.631408 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630636 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdktq\" (UniqueName: \"kubernetes.io/projected/21e47eec-3d15-47fd-9cf8-dcaf27954260-kube-api-access-mdktq\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.631408 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630650 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/12195aca-5c5b-45a7-ba39-87ac34323f89-ovnkube-config\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.631408 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630660 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-host-kubelet\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.632108 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630689 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-os-release\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.632108 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630690 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-host-run-ovn-kubernetes\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.632108 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630734 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-host-run-ovn-kubernetes\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.632108 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630806 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-host-kubelet\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.632108 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630845 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/12195aca-5c5b-45a7-ba39-87ac34323f89-ovnkube-script-lib\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.632108 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630886 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92j9w\" (UniqueName: \"kubernetes.io/projected/12195aca-5c5b-45a7-ba39-87ac34323f89-kube-api-access-92j9w\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.632108 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630911 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-etc-sysconfig\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.632108 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630929 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21e47eec-3d15-47fd-9cf8-dcaf27954260-cni-binary-copy\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.632108 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630942 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-etc-kubernetes\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.632108 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630987 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-etc-kubernetes\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.632108 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.630989 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-etc-sysconfig\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.632108 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631024 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40866c5d-2992-4d53-b839-e3dc5740b96d-metrics-certs\") pod \"network-metrics-daemon-8gcng\" (UID: \"40866c5d-2992-4d53-b839-e3dc5740b96d\") " pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:52:57.632108 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631044 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b4113ffd-a496-4d76-9f75-942100b26c23-dbus\") pod \"global-pull-secret-syncer-vrbdc\" (UID: \"b4113ffd-a496-4d76-9f75-942100b26c23\") " pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:52:57.632108 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:57.631157 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:52:57.632108 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631187 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b4113ffd-a496-4d76-9f75-942100b26c23-dbus\") pod \"global-pull-secret-syncer-vrbdc\" (UID: \"b4113ffd-a496-4d76-9f75-942100b26c23\") " pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:52:57.632108 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631186 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c96d9a00-a5ee-468a-ab1e-57fc28bda457-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m6xbq\" (UID: \"c96d9a00-a5ee-468a-ab1e-57fc28bda457\") " pod="openshift-multus/multus-additional-cni-plugins-m6xbq" Jul 13 14:52:57.632108 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:57.631210 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40866c5d-2992-4d53-b839-e3dc5740b96d-metrics-certs podName:40866c5d-2992-4d53-b839-e3dc5740b96d nodeName:}" failed. No retries permitted until 2026-07-13 14:52:58.13119672 +0000 UTC m=+2.197769180 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40866c5d-2992-4d53-b839-e3dc5740b96d-metrics-certs") pod "network-metrics-daemon-8gcng" (UID: "40866c5d-2992-4d53-b839-e3dc5740b96d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:52:57.632974 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631219 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c96d9a00-a5ee-468a-ab1e-57fc28bda457-cni-binary-copy\") pod \"multus-additional-cni-plugins-m6xbq\" (UID: \"c96d9a00-a5ee-468a-ab1e-57fc28bda457\") " pod="openshift-multus/multus-additional-cni-plugins-m6xbq" Jul 13 14:52:57.632974 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631239 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-etc-openvswitch\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.632974 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631259 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-host-cni-bin\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.632974 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631278 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-etc-openvswitch\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.632974 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631281 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/12195aca-5c5b-45a7-ba39-87ac34323f89-env-overrides\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.632974 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631310 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-sys\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.632974 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631326 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d56a4953-1969-4be8-840e-ef390c117114-tmp\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.632974 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631374 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-host-cni-bin\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.632974 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631366 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-multus-cni-dir\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.632974 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631402 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-sys\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.632974 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631415 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-host-run-k8s-cni-cncf-io\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.632974 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631438 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-multus-cni-dir\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.632974 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631458 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6494a281-bde1-4cb8-a6db-1a319f3cfa4d-etc-selinux\") pod \"aws-ebs-csi-driver-node-wclwd\" (UID: \"6494a281-bde1-4cb8-a6db-1a319f3cfa4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wclwd" Jul 13 14:52:57.632974 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631486 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5gbz\" (UniqueName: \"kubernetes.io/projected/c96d9a00-a5ee-468a-ab1e-57fc28bda457-kube-api-access-l5gbz\") pod \"multus-additional-cni-plugins-m6xbq\" (UID: \"c96d9a00-a5ee-468a-ab1e-57fc28bda457\") " pod="openshift-multus/multus-additional-cni-plugins-m6xbq" Jul 13 14:52:57.632974 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631518 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fa07f3f6-9861-4c60-9782-15bafe3f72d1-iptables-alerter-script\") pod \"iptables-alerter-xvxmb\" (UID: \"fa07f3f6-9861-4c60-9782-15bafe3f72d1\") " pod="openshift-network-operator/iptables-alerter-xvxmb" Jul 13 14:52:57.632974 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631542 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d56a4953-1969-4be8-840e-ef390c117114-etc-tuned\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.632974 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631566 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-host-var-lib-kubelet\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.633821 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631589 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-host-run-netns\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.633821 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631608 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6494a281-bde1-4cb8-a6db-1a319f3cfa4d-etc-selinux\") pod \"aws-ebs-csi-driver-node-wclwd\" (UID: \"6494a281-bde1-4cb8-a6db-1a319f3cfa4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wclwd" Jul 13 14:52:57.633821 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631642 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/12195aca-5c5b-45a7-ba39-87ac34323f89-env-overrides\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.633821 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631656 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 13 14:52:57.633821 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631619 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmpkv\" (UniqueName: \"kubernetes.io/projected/47635ebe-4411-4f30-bd50-d642f911219b-kube-api-access-kmpkv\") pod \"node-resolver-cw5zb\" (UID: \"47635ebe-4411-4f30-bd50-d642f911219b\") " pod="openshift-dns/node-resolver-cw5zb" Jul 13 14:52:57.633821 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631676 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c96d9a00-a5ee-468a-ab1e-57fc28bda457-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m6xbq\" (UID: \"c96d9a00-a5ee-468a-ab1e-57fc28bda457\") " pod="openshift-multus/multus-additional-cni-plugins-m6xbq" Jul 13 14:52:57.633821 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631697 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6494a281-bde1-4cb8-a6db-1a319f3cfa4d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wclwd\" (UID: \"6494a281-bde1-4cb8-a6db-1a319f3cfa4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wclwd" Jul 13 14:52:57.633821 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631479 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-host-run-k8s-cni-cncf-io\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.633821 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631728 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-host-var-lib-kubelet\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.633821 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631735 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-cnibin\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.633821 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631769 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4ccx\" (UniqueName: \"kubernetes.io/projected/40866c5d-2992-4d53-b839-e3dc5740b96d-kube-api-access-g4ccx\") pod \"network-metrics-daemon-8gcng\" (UID: \"40866c5d-2992-4d53-b839-e3dc5740b96d\") " pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:52:57.633821 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631777 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-host-run-netns\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.633821 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631809 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f105bdfa-cff6-4b9f-b5ac-7b386e2a9542-konnectivity-ca\") pod \"konnectivity-agent-bnrgl\" (UID: \"f105bdfa-cff6-4b9f-b5ac-7b386e2a9542\") " pod="kube-system/konnectivity-agent-bnrgl" Jul 13 14:52:57.633821 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631861 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6494a281-bde1-4cb8-a6db-1a319f3cfa4d-device-dir\") pod \"aws-ebs-csi-driver-node-wclwd\" (UID: \"6494a281-bde1-4cb8-a6db-1a319f3cfa4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wclwd" Jul 13 14:52:57.633821 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631869 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-cnibin\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.633821 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631889 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c96d9a00-a5ee-468a-ab1e-57fc28bda457-os-release\") pod \"multus-additional-cni-plugins-m6xbq\" (UID: \"c96d9a00-a5ee-468a-ab1e-57fc28bda457\") " pod="openshift-multus/multus-additional-cni-plugins-m6xbq" Jul 13 14:52:57.633821 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631913 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-run-ovn\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.633821 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631936 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-node-log\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.634730 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631960 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6494a281-bde1-4cb8-a6db-1a319f3cfa4d-socket-dir\") pod \"aws-ebs-csi-driver-node-wclwd\" (UID: \"6494a281-bde1-4cb8-a6db-1a319f3cfa4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wclwd" Jul 13 14:52:57.634730 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.631996 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c96d9a00-a5ee-468a-ab1e-57fc28bda457-os-release\") pod \"multus-additional-cni-plugins-m6xbq\" (UID: \"c96d9a00-a5ee-468a-ab1e-57fc28bda457\") " pod="openshift-multus/multus-additional-cni-plugins-m6xbq" Jul 13 14:52:57.634730 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632011 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-run-ovn\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.634730 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632017 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l7md\" (UniqueName: \"kubernetes.io/projected/d56a4953-1969-4be8-840e-ef390c117114-kube-api-access-9l7md\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.634730 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632054 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-node-log\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.634730 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632065 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6494a281-bde1-4cb8-a6db-1a319f3cfa4d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wclwd\" (UID: \"6494a281-bde1-4cb8-a6db-1a319f3cfa4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wclwd" Jul 13 14:52:57.634730 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632068 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b9zw\" (UniqueName: \"kubernetes.io/projected/ecfa98f6-7abe-43a4-956d-b613d7e1d854-kube-api-access-9b9zw\") pod \"network-check-target-gvdvc\" (UID: \"ecfa98f6-7abe-43a4-956d-b613d7e1d854\") " pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:52:57.634730 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632089 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6494a281-bde1-4cb8-a6db-1a319f3cfa4d-socket-dir\") pod \"aws-ebs-csi-driver-node-wclwd\" (UID: \"6494a281-bde1-4cb8-a6db-1a319f3cfa4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wclwd" Jul 13 14:52:57.634730 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632098 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-host-var-lib-cni-bin\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.634730 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632127 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-host-var-lib-cni-multus\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.634730 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632139 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6494a281-bde1-4cb8-a6db-1a319f3cfa4d-device-dir\") pod \"aws-ebs-csi-driver-node-wclwd\" (UID: \"6494a281-bde1-4cb8-a6db-1a319f3cfa4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wclwd" Jul 13 14:52:57.634730 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632157 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-multus-conf-dir\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.634730 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632187 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-host-var-lib-cni-multus\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.634730 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632197 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-host-var-lib-cni-bin\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.634730 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632208 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c96d9a00-a5ee-468a-ab1e-57fc28bda457-system-cni-dir\") pod \"multus-additional-cni-plugins-m6xbq\" (UID: \"c96d9a00-a5ee-468a-ab1e-57fc28bda457\") " pod="openshift-multus/multus-additional-cni-plugins-m6xbq" Jul 13 14:52:57.634730 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632227 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fa07f3f6-9861-4c60-9782-15bafe3f72d1-iptables-alerter-script\") pod \"iptables-alerter-xvxmb\" (UID: \"fa07f3f6-9861-4c60-9782-15bafe3f72d1\") " pod="openshift-network-operator/iptables-alerter-xvxmb" Jul 13 14:52:57.634730 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632262 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c96d9a00-a5ee-468a-ab1e-57fc28bda457-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m6xbq\" (UID: \"c96d9a00-a5ee-468a-ab1e-57fc28bda457\") " pod="openshift-multus/multus-additional-cni-plugins-m6xbq" Jul 13 14:52:57.635449 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632229 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-multus-conf-dir\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.635449 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632290 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-etc-kubernetes\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.635449 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632300 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c96d9a00-a5ee-468a-ab1e-57fc28bda457-system-cni-dir\") pod \"multus-additional-cni-plugins-m6xbq\" (UID: \"c96d9a00-a5ee-468a-ab1e-57fc28bda457\") " pod="openshift-multus/multus-additional-cni-plugins-m6xbq" Jul 13 14:52:57.635449 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632320 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-etc-sysctl-conf\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.635449 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632335 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/12195aca-5c5b-45a7-ba39-87ac34323f89-ovnkube-script-lib\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.635449 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632348 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-var-lib-kubelet\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.635449 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632370 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-etc-kubernetes\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.635449 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632373 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47635ebe-4411-4f30-bd50-d642f911219b-tmp-dir\") pod \"node-resolver-cw5zb\" (UID: \"47635ebe-4411-4f30-bd50-d642f911219b\") " pod="openshift-dns/node-resolver-cw5zb" Jul 13 14:52:57.635449 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632420 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c96d9a00-a5ee-468a-ab1e-57fc28bda457-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m6xbq\" (UID: \"c96d9a00-a5ee-468a-ab1e-57fc28bda457\") " pod="openshift-multus/multus-additional-cni-plugins-m6xbq" Jul 13 14:52:57.635449 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632436 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-var-lib-kubelet\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.635449 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632453 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.635449 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632464 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f105bdfa-cff6-4b9f-b5ac-7b386e2a9542-konnectivity-ca\") pod \"konnectivity-agent-bnrgl\" (UID: \"f105bdfa-cff6-4b9f-b5ac-7b386e2a9542\") " pod="kube-system/konnectivity-agent-bnrgl" Jul 13 14:52:57.635449 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632479 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/12195aca-5c5b-45a7-ba39-87ac34323f89-ovn-node-metrics-cert\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.635449 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632491 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c96d9a00-a5ee-468a-ab1e-57fc28bda457-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m6xbq\" (UID: \"c96d9a00-a5ee-468a-ab1e-57fc28bda457\") " pod="openshift-multus/multus-additional-cni-plugins-m6xbq" Jul 13 14:52:57.635449 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632506 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-etc-sysctl-conf\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.635449 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632505 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9m84\" (UniqueName: \"kubernetes.io/projected/fa07f3f6-9861-4c60-9782-15bafe3f72d1-kube-api-access-j9m84\") pod \"iptables-alerter-xvxmb\" (UID: \"fa07f3f6-9861-4c60-9782-15bafe3f72d1\") " pod="openshift-network-operator/iptables-alerter-xvxmb" Jul 13 14:52:57.635449 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632557 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-run\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.635987 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632583 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-systemd-units\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.635987 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632627 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/127d8c73-93c5-4fd9-8ab5-9276bcee81be-serviceca\") pod \"node-ca-6cfq7\" (UID: \"127d8c73-93c5-4fd9-8ab5-9276bcee81be\") " pod="openshift-image-registry/node-ca-6cfq7" Jul 13 14:52:57.635987 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632651 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-host-cni-netd\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.635987 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632676 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa07f3f6-9861-4c60-9782-15bafe3f72d1-host-slash\") pod \"iptables-alerter-xvxmb\" (UID: \"fa07f3f6-9861-4c60-9782-15bafe3f72d1\") " pod="openshift-network-operator/iptables-alerter-xvxmb" Jul 13 14:52:57.635987 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632704 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-multus-socket-dir-parent\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.635987 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632718 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47635ebe-4411-4f30-bd50-d642f911219b-tmp-dir\") pod \"node-resolver-cw5zb\" (UID: \"47635ebe-4411-4f30-bd50-d642f911219b\") " pod="openshift-dns/node-resolver-cw5zb" Jul 13 14:52:57.635987 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632730 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-host-run-netns\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.635987 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632758 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f105bdfa-cff6-4b9f-b5ac-7b386e2a9542-agent-certs\") pod \"konnectivity-agent-bnrgl\" (UID: \"f105bdfa-cff6-4b9f-b5ac-7b386e2a9542\") " pod="kube-system/konnectivity-agent-bnrgl" Jul 13 14:52:57.635987 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632844 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-run\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.635987 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632845 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-host-cni-netd\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.635987 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632529 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.635987 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632886 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa07f3f6-9861-4c60-9782-15bafe3f72d1-host-slash\") pod \"iptables-alerter-xvxmb\" (UID: \"fa07f3f6-9861-4c60-9782-15bafe3f72d1\") " pod="openshift-network-operator/iptables-alerter-xvxmb" Jul 13 14:52:57.635987 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632947 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-multus-socket-dir-parent\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.635987 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.632990 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21e47eec-3d15-47fd-9cf8-dcaf27954260-host-run-netns\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.635987 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.633024 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-log-socket\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.635987 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.633034 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-systemd-units\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.635987 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.633087 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-etc-modprobe-d\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.635987 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.633113 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-etc-sysctl-d\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.636501 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.633137 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/706ce44660952d0aec5f85bd24b8e4aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-237.ec2.internal\" (UID: \"706ce44660952d0aec5f85bd24b8e4aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-237.ec2.internal" Jul 13 14:52:57.636501 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.633164 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/21e47eec-3d15-47fd-9cf8-dcaf27954260-multus-daemon-config\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.636501 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.633179 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/127d8c73-93c5-4fd9-8ab5-9276bcee81be-serviceca\") pod \"node-ca-6cfq7\" (UID: \"127d8c73-93c5-4fd9-8ab5-9276bcee81be\") " pod="openshift-image-registry/node-ca-6cfq7" Jul 13 14:52:57.636501 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.633189 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/04d9ec37c251ad9524965495843a7e0c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-237.ec2.internal\" (UID: \"04d9ec37c251ad9524965495843a7e0c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-237.ec2.internal" Jul 13 14:52:57.636501 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.633129 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/12195aca-5c5b-45a7-ba39-87ac34323f89-log-socket\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.636501 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.633217 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-etc-modprobe-d\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.636501 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.633226 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6494a281-bde1-4cb8-a6db-1a319f3cfa4d-registration-dir\") pod \"aws-ebs-csi-driver-node-wclwd\" (UID: \"6494a281-bde1-4cb8-a6db-1a319f3cfa4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wclwd" Jul 13 14:52:57.636501 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.633298 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6494a281-bde1-4cb8-a6db-1a319f3cfa4d-registration-dir\") pod \"aws-ebs-csi-driver-node-wclwd\" (UID: \"6494a281-bde1-4cb8-a6db-1a319f3cfa4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wclwd" Jul 13 14:52:57.636501 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.633303 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d56a4953-1969-4be8-840e-ef390c117114-etc-sysctl-d\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.636501 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.633344 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/706ce44660952d0aec5f85bd24b8e4aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-237.ec2.internal\" (UID: \"706ce44660952d0aec5f85bd24b8e4aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-237.ec2.internal" Jul 13 14:52:57.636501 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.633352 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/04d9ec37c251ad9524965495843a7e0c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-237.ec2.internal\" (UID: \"04d9ec37c251ad9524965495843a7e0c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-237.ec2.internal" Jul 13 14:52:57.636501 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.633588 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/21e47eec-3d15-47fd-9cf8-dcaf27954260-multus-daemon-config\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.636501 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.633588 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c96d9a00-a5ee-468a-ab1e-57fc28bda457-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m6xbq\" (UID: \"c96d9a00-a5ee-468a-ab1e-57fc28bda457\") " pod="openshift-multus/multus-additional-cni-plugins-m6xbq" Jul 13 14:52:57.636501 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.635331 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d56a4953-1969-4be8-840e-ef390c117114-etc-tuned\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.636501 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.635409 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/12195aca-5c5b-45a7-ba39-87ac34323f89-ovn-node-metrics-cert\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.636501 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.635410 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d56a4953-1969-4be8-840e-ef390c117114-tmp\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.636501 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.635587 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f105bdfa-cff6-4b9f-b5ac-7b386e2a9542-agent-certs\") pod \"konnectivity-agent-bnrgl\" (UID: \"f105bdfa-cff6-4b9f-b5ac-7b386e2a9542\") " pod="kube-system/konnectivity-agent-bnrgl" Jul 13 14:52:57.645556 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:57.645530 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 14:52:57.645556 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:57.645559 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 14:52:57.645743 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:57.645575 2577 projected.go:196] Error preparing data for projected volume kube-api-access-9b9zw for pod openshift-network-diagnostics/network-check-target-gvdvc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:52:57.645743 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.645612 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ftzp\" (UniqueName: \"kubernetes.io/projected/127d8c73-93c5-4fd9-8ab5-9276bcee81be-kube-api-access-2ftzp\") pod \"node-ca-6cfq7\" (UID: \"127d8c73-93c5-4fd9-8ab5-9276bcee81be\") " pod="openshift-image-registry/node-ca-6cfq7" Jul 13 14:52:57.645900 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:57.645767 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecfa98f6-7abe-43a4-956d-b613d7e1d854-kube-api-access-9b9zw podName:ecfa98f6-7abe-43a4-956d-b613d7e1d854 nodeName:}" failed. No retries permitted until 2026-07-13 14:52:58.145748393 +0000 UTC m=+2.212320857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9b9zw" (UniqueName: "kubernetes.io/projected/ecfa98f6-7abe-43a4-956d-b613d7e1d854-kube-api-access-9b9zw") pod "network-check-target-gvdvc" (UID: "ecfa98f6-7abe-43a4-956d-b613d7e1d854") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:52:57.646287 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.646260 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l7md\" (UniqueName: \"kubernetes.io/projected/d56a4953-1969-4be8-840e-ef390c117114-kube-api-access-9l7md\") pod \"tuned-p5sxk\" (UID: \"d56a4953-1969-4be8-840e-ef390c117114\") " pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:57.646368 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.646275 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9m84\" (UniqueName: \"kubernetes.io/projected/fa07f3f6-9861-4c60-9782-15bafe3f72d1-kube-api-access-j9m84\") pod \"iptables-alerter-xvxmb\" (UID: \"fa07f3f6-9861-4c60-9782-15bafe3f72d1\") " pod="openshift-network-operator/iptables-alerter-xvxmb" Jul 13 14:52:57.646767 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.646739 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmpkv\" (UniqueName: \"kubernetes.io/projected/47635ebe-4411-4f30-bd50-d642f911219b-kube-api-access-kmpkv\") pod \"node-resolver-cw5zb\" (UID: \"47635ebe-4411-4f30-bd50-d642f911219b\") " pod="openshift-dns/node-resolver-cw5zb" Jul 13 14:52:57.647558 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.647505 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4ccx\" (UniqueName: \"kubernetes.io/projected/40866c5d-2992-4d53-b839-e3dc5740b96d-kube-api-access-g4ccx\") pod \"network-metrics-daemon-8gcng\" (UID: \"40866c5d-2992-4d53-b839-e3dc5740b96d\") " pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:52:57.647634 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.647617 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5gbz\" (UniqueName: \"kubernetes.io/projected/c96d9a00-a5ee-468a-ab1e-57fc28bda457-kube-api-access-l5gbz\") pod \"multus-additional-cni-plugins-m6xbq\" (UID: \"c96d9a00-a5ee-468a-ab1e-57fc28bda457\") " pod="openshift-multus/multus-additional-cni-plugins-m6xbq" Jul 13 14:52:57.648301 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.648273 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdckm\" (UniqueName: \"kubernetes.io/projected/6494a281-bde1-4cb8-a6db-1a319f3cfa4d-kube-api-access-cdckm\") pod \"aws-ebs-csi-driver-node-wclwd\" (UID: \"6494a281-bde1-4cb8-a6db-1a319f3cfa4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wclwd" Jul 13 14:52:57.648429 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.648413 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdktq\" (UniqueName: \"kubernetes.io/projected/21e47eec-3d15-47fd-9cf8-dcaf27954260-kube-api-access-mdktq\") pod \"multus-4tv96\" (UID: \"21e47eec-3d15-47fd-9cf8-dcaf27954260\") " pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.648749 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.648733 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92j9w\" (UniqueName: \"kubernetes.io/projected/12195aca-5c5b-45a7-ba39-87ac34323f89-kube-api-access-92j9w\") pod \"ovnkube-node-hq8bg\" (UID: \"12195aca-5c5b-45a7-ba39-87ac34323f89\") " pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.783999 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.783971 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-237.ec2.internal" Jul 13 14:52:57.788916 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.788902 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-237.ec2.internal" Jul 13 14:52:57.791747 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.791730 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bnrgl" Jul 13 14:52:57.816602 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.816575 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wclwd" Jul 13 14:52:57.825736 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.825712 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cw5zb" Jul 13 14:52:57.841682 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.841658 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m6xbq" Jul 13 14:52:57.850683 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.850665 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:52:57.869057 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.869035 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xvxmb" Jul 13 14:52:57.885002 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.884981 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6cfq7" Jul 13 14:52:57.897078 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.897060 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4tv96" Jul 13 14:52:57.902035 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:57.902010 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" Jul 13 14:52:58.137578 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:58.137548 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4113ffd-a496-4d76-9f75-942100b26c23-original-pull-secret\") pod \"global-pull-secret-syncer-vrbdc\" (UID: \"b4113ffd-a496-4d76-9f75-942100b26c23\") " pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:52:58.137736 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:58.137585 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40866c5d-2992-4d53-b839-e3dc5740b96d-metrics-certs\") pod \"network-metrics-daemon-8gcng\" (UID: \"40866c5d-2992-4d53-b839-e3dc5740b96d\") " pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:52:58.137736 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:58.137680 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:52:58.137736 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:58.137687 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 14:52:58.137736 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:58.137729 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40866c5d-2992-4d53-b839-e3dc5740b96d-metrics-certs podName:40866c5d-2992-4d53-b839-e3dc5740b96d nodeName:}" failed. No retries permitted until 2026-07-13 14:52:59.13771424 +0000 UTC m=+3.204286684 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40866c5d-2992-4d53-b839-e3dc5740b96d-metrics-certs") pod "network-metrics-daemon-8gcng" (UID: "40866c5d-2992-4d53-b839-e3dc5740b96d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:52:58.137902 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:58.137742 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4113ffd-a496-4d76-9f75-942100b26c23-original-pull-secret podName:b4113ffd-a496-4d76-9f75-942100b26c23 nodeName:}" failed. No retries permitted until 2026-07-13 14:52:59.137735937 +0000 UTC m=+3.204308382 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4113ffd-a496-4d76-9f75-942100b26c23-original-pull-secret") pod "global-pull-secret-syncer-vrbdc" (UID: "b4113ffd-a496-4d76-9f75-942100b26c23") : object "kube-system"/"original-pull-secret" not registered Jul 13 14:52:58.208762 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:58.208697 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 14:52:58.239020 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:58.238978 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b9zw\" (UniqueName: \"kubernetes.io/projected/ecfa98f6-7abe-43a4-956d-b613d7e1d854-kube-api-access-9b9zw\") pod \"network-check-target-gvdvc\" (UID: \"ecfa98f6-7abe-43a4-956d-b613d7e1d854\") " pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:52:58.239156 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:58.239112 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 14:52:58.239156 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:58.239130 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 14:52:58.239156 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:58.239142 2577 projected.go:196] Error preparing data for projected volume kube-api-access-9b9zw for pod openshift-network-diagnostics/network-check-target-gvdvc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:52:58.239263 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:58.239193 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecfa98f6-7abe-43a4-956d-b613d7e1d854-kube-api-access-9b9zw podName:ecfa98f6-7abe-43a4-956d-b613d7e1d854 nodeName:}" failed. No retries permitted until 2026-07-13 14:52:59.239174946 +0000 UTC m=+3.305747414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9b9zw" (UniqueName: "kubernetes.io/projected/ecfa98f6-7abe-43a4-956d-b613d7e1d854-kube-api-access-9b9zw") pod "network-check-target-gvdvc" (UID: "ecfa98f6-7abe-43a4-956d-b613d7e1d854") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:52:58.364265 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:58.364228 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod706ce44660952d0aec5f85bd24b8e4aa.slice/crio-ab3dc598633d72def736288fb9ae5e49f64590e6fe7288c178616a1c65a4caa8 WatchSource:0}: Error finding container ab3dc598633d72def736288fb9ae5e49f64590e6fe7288c178616a1c65a4caa8: Status 404 returned error can't find the container with id ab3dc598633d72def736288fb9ae5e49f64590e6fe7288c178616a1c65a4caa8 Jul 13 14:52:58.364653 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:58.364619 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21e47eec_3d15_47fd_9cf8_dcaf27954260.slice/crio-ed5d4025bc6d864738bcfa11b6556aa1640f5b90939d39e05124e87a8836517d WatchSource:0}: Error finding container ed5d4025bc6d864738bcfa11b6556aa1640f5b90939d39e05124e87a8836517d: Status 404 returned error can't find the container with id ed5d4025bc6d864738bcfa11b6556aa1640f5b90939d39e05124e87a8836517d Jul 13 14:52:58.365569 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:58.365549 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6494a281_bde1_4cb8_a6db_1a319f3cfa4d.slice/crio-3527c0135ba8f720342f3c644e71c98a65c6e3382f3d9b566eded2851c52a26b WatchSource:0}: Error finding container 3527c0135ba8f720342f3c644e71c98a65c6e3382f3d9b566eded2851c52a26b: Status 404 returned error can't find the container with id 3527c0135ba8f720342f3c644e71c98a65c6e3382f3d9b566eded2851c52a26b Jul 13 14:52:58.373744 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:58.373725 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 14:52:58.385308 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:58.385278 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04d9ec37c251ad9524965495843a7e0c.slice/crio-16fa810cf58958905ed9e6a8150084ab7165cae72146272f0751a7928530c5f9 WatchSource:0}: Error finding container 16fa810cf58958905ed9e6a8150084ab7165cae72146272f0751a7928530c5f9: Status 404 returned error can't find the container with id 16fa810cf58958905ed9e6a8150084ab7165cae72146272f0751a7928530c5f9 Jul 13 14:52:58.396743 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:58.396720 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47635ebe_4411_4f30_bd50_d642f911219b.slice/crio-ad83b780a4d364760c75ef283fa2d3069637e4787d968ea54210d9d0a7ea2f4d WatchSource:0}: Error finding container ad83b780a4d364760c75ef283fa2d3069637e4787d968ea54210d9d0a7ea2f4d: Status 404 returned error can't find the container with id ad83b780a4d364760c75ef283fa2d3069637e4787d968ea54210d9d0a7ea2f4d Jul 13 14:52:58.432829 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:58.432803 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd56a4953_1969_4be8_840e_ef390c117114.slice/crio-d7ad4af12fc31e70640d349e424a43942c426b3c3e4d3e2f06c9e1a357895124 WatchSource:0}: Error finding container d7ad4af12fc31e70640d349e424a43942c426b3c3e4d3e2f06c9e1a357895124: Status 404 returned error can't find the container with id d7ad4af12fc31e70640d349e424a43942c426b3c3e4d3e2f06c9e1a357895124 Jul 13 14:52:58.446555 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:58.446532 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod127d8c73_93c5_4fd9_8ab5_9276bcee81be.slice/crio-013bdbef7dff2ac45fac9cd1434a0b87ab775b9b5d9619a16399e0dcffd85239 WatchSource:0}: Error finding container 013bdbef7dff2ac45fac9cd1434a0b87ab775b9b5d9619a16399e0dcffd85239: Status 404 returned error can't find the container with id 013bdbef7dff2ac45fac9cd1434a0b87ab775b9b5d9619a16399e0dcffd85239 Jul 13 14:52:58.458201 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:58.458179 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf105bdfa_cff6_4b9f_b5ac_7b386e2a9542.slice/crio-a5899e121705a0fc5358c5542fbc947e74a5fb4808c36d3577c7b38afa4968e5 WatchSource:0}: Error finding container a5899e121705a0fc5358c5542fbc947e74a5fb4808c36d3577c7b38afa4968e5: Status 404 returned error can't find the container with id a5899e121705a0fc5358c5542fbc947e74a5fb4808c36d3577c7b38afa4968e5 Jul 13 14:52:58.483904 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:58.483856 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 14:47:57 +0000 UTC" deadline="2028-01-06 11:45:28.589220483 +0000 UTC" Jul 13 14:52:58.483904 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:58.483895 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13004h52m30.105328192s" Jul 13 14:52:58.504358 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:58.504331 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc96d9a00_a5ee_468a_ab1e_57fc28bda457.slice/crio-9c9dfa23c3314a24568914defa7176ea0ee6c11a7c57b655e6822c5c855316cd WatchSource:0}: Error finding container 9c9dfa23c3314a24568914defa7176ea0ee6c11a7c57b655e6822c5c855316cd: Status 404 returned error can't find the container with id 9c9dfa23c3314a24568914defa7176ea0ee6c11a7c57b655e6822c5c855316cd Jul 13 14:52:58.556663 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:52:58.556641 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa07f3f6_9861_4c60_9782_15bafe3f72d1.slice/crio-44f4c5548b088dc42419540c213260651715e456d986a542b291610ececa6f5e WatchSource:0}: Error finding container 44f4c5548b088dc42419540c213260651715e456d986a542b291610ececa6f5e: Status 404 returned error can't find the container with id 44f4c5548b088dc42419540c213260651715e456d986a542b291610ececa6f5e Jul 13 14:52:58.877473 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:58.877400 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 14:52:59.145081 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:59.145002 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4113ffd-a496-4d76-9f75-942100b26c23-original-pull-secret\") pod \"global-pull-secret-syncer-vrbdc\" (UID: \"b4113ffd-a496-4d76-9f75-942100b26c23\") " pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:52:59.145081 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:59.145057 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40866c5d-2992-4d53-b839-e3dc5740b96d-metrics-certs\") pod \"network-metrics-daemon-8gcng\" (UID: \"40866c5d-2992-4d53-b839-e3dc5740b96d\") " pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:52:59.145302 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:59.145182 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:52:59.145302 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:59.145241 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40866c5d-2992-4d53-b839-e3dc5740b96d-metrics-certs podName:40866c5d-2992-4d53-b839-e3dc5740b96d nodeName:}" failed. No retries permitted until 2026-07-13 14:53:01.145222199 +0000 UTC m=+5.211794662 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40866c5d-2992-4d53-b839-e3dc5740b96d-metrics-certs") pod "network-metrics-daemon-8gcng" (UID: "40866c5d-2992-4d53-b839-e3dc5740b96d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:52:59.145422 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:59.145305 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 14:52:59.145422 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:59.145341 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4113ffd-a496-4d76-9f75-942100b26c23-original-pull-secret podName:b4113ffd-a496-4d76-9f75-942100b26c23 nodeName:}" failed. No retries permitted until 2026-07-13 14:53:01.145328514 +0000 UTC m=+5.211900958 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4113ffd-a496-4d76-9f75-942100b26c23-original-pull-secret") pod "global-pull-secret-syncer-vrbdc" (UID: "b4113ffd-a496-4d76-9f75-942100b26c23") : object "kube-system"/"original-pull-secret" not registered Jul 13 14:52:59.245845 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:59.245786 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b9zw\" (UniqueName: \"kubernetes.io/projected/ecfa98f6-7abe-43a4-956d-b613d7e1d854-kube-api-access-9b9zw\") pod \"network-check-target-gvdvc\" (UID: \"ecfa98f6-7abe-43a4-956d-b613d7e1d854\") " pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:52:59.246045 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:59.246000 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 14:52:59.246045 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:59.246024 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 14:52:59.246045 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:59.246040 2577 projected.go:196] Error preparing data for projected volume kube-api-access-9b9zw for pod openshift-network-diagnostics/network-check-target-gvdvc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:52:59.246223 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:59.246112 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecfa98f6-7abe-43a4-956d-b613d7e1d854-kube-api-access-9b9zw podName:ecfa98f6-7abe-43a4-956d-b613d7e1d854 nodeName:}" failed. No retries permitted until 2026-07-13 14:53:01.24609149 +0000 UTC m=+5.312663947 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9b9zw" (UniqueName: "kubernetes.io/projected/ecfa98f6-7abe-43a4-956d-b613d7e1d854-kube-api-access-9b9zw") pod "network-check-target-gvdvc" (UID: "ecfa98f6-7abe-43a4-956d-b613d7e1d854") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:52:59.342113 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:59.342079 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:52:59.342299 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:59.342217 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvdvc" podUID="ecfa98f6-7abe-43a4-956d-b613d7e1d854" Jul 13 14:52:59.342650 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:59.342631 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:52:59.342798 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:59.342772 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gcng" podUID="40866c5d-2992-4d53-b839-e3dc5740b96d" Jul 13 14:52:59.342875 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:59.342842 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:52:59.342965 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:52:59.342945 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrbdc" podUID="b4113ffd-a496-4d76-9f75-942100b26c23" Jul 13 14:52:59.360732 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:59.360675 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6xbq" event={"ID":"c96d9a00-a5ee-468a-ab1e-57fc28bda457","Type":"ContainerStarted","Data":"9c9dfa23c3314a24568914defa7176ea0ee6c11a7c57b655e6822c5c855316cd"} Jul 13 14:52:59.365369 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:59.365336 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bnrgl" event={"ID":"f105bdfa-cff6-4b9f-b5ac-7b386e2a9542","Type":"ContainerStarted","Data":"a5899e121705a0fc5358c5542fbc947e74a5fb4808c36d3577c7b38afa4968e5"} Jul 13 14:52:59.374024 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:59.373991 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6cfq7" event={"ID":"127d8c73-93c5-4fd9-8ab5-9276bcee81be","Type":"ContainerStarted","Data":"013bdbef7dff2ac45fac9cd1434a0b87ab775b9b5d9619a16399e0dcffd85239"} Jul 13 14:52:59.392686 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:59.392656 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cw5zb" event={"ID":"47635ebe-4411-4f30-bd50-d642f911219b","Type":"ContainerStarted","Data":"ad83b780a4d364760c75ef283fa2d3069637e4787d968ea54210d9d0a7ea2f4d"} Jul 13 14:52:59.399577 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:59.399501 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-237.ec2.internal" event={"ID":"04d9ec37c251ad9524965495843a7e0c","Type":"ContainerStarted","Data":"16fa810cf58958905ed9e6a8150084ab7165cae72146272f0751a7928530c5f9"} Jul 13 14:52:59.404498 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:59.404471 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4tv96" event={"ID":"21e47eec-3d15-47fd-9cf8-dcaf27954260","Type":"ContainerStarted","Data":"ed5d4025bc6d864738bcfa11b6556aa1640f5b90939d39e05124e87a8836517d"} Jul 13 14:52:59.412917 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:59.412890 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wclwd" event={"ID":"6494a281-bde1-4cb8-a6db-1a319f3cfa4d","Type":"ContainerStarted","Data":"3527c0135ba8f720342f3c644e71c98a65c6e3382f3d9b566eded2851c52a26b"} Jul 13 14:52:59.415234 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:59.415209 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xvxmb" event={"ID":"fa07f3f6-9861-4c60-9782-15bafe3f72d1","Type":"ContainerStarted","Data":"44f4c5548b088dc42419540c213260651715e456d986a542b291610ececa6f5e"} Jul 13 14:52:59.418193 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:59.418127 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" event={"ID":"d56a4953-1969-4be8-840e-ef390c117114","Type":"ContainerStarted","Data":"d7ad4af12fc31e70640d349e424a43942c426b3c3e4d3e2f06c9e1a357895124"} Jul 13 14:52:59.421884 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:59.421815 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-237.ec2.internal" event={"ID":"706ce44660952d0aec5f85bd24b8e4aa","Type":"ContainerStarted","Data":"ab3dc598633d72def736288fb9ae5e49f64590e6fe7288c178616a1c65a4caa8"} Jul 13 14:52:59.485006 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:59.484926 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 14:47:57 +0000 UTC" deadline="2028-02-24 11:58:33.545278961 +0000 UTC" Jul 13 14:52:59.485006 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:52:59.484981 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14181h5m34.060302164s" Jul 13 14:53:01.167807 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:01.167702 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4113ffd-a496-4d76-9f75-942100b26c23-original-pull-secret\") pod \"global-pull-secret-syncer-vrbdc\" (UID: \"b4113ffd-a496-4d76-9f75-942100b26c23\") " pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:53:01.167807 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:01.167764 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40866c5d-2992-4d53-b839-e3dc5740b96d-metrics-certs\") pod \"network-metrics-daemon-8gcng\" (UID: \"40866c5d-2992-4d53-b839-e3dc5740b96d\") " pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:53:01.168527 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:01.167956 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:53:01.168527 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:01.168026 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40866c5d-2992-4d53-b839-e3dc5740b96d-metrics-certs podName:40866c5d-2992-4d53-b839-e3dc5740b96d nodeName:}" failed. No retries permitted until 2026-07-13 14:53:05.168005021 +0000 UTC m=+9.234577472 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40866c5d-2992-4d53-b839-e3dc5740b96d-metrics-certs") pod "network-metrics-daemon-8gcng" (UID: "40866c5d-2992-4d53-b839-e3dc5740b96d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:53:01.168527 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:01.168459 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 14:53:01.168527 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:01.168524 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4113ffd-a496-4d76-9f75-942100b26c23-original-pull-secret podName:b4113ffd-a496-4d76-9f75-942100b26c23 nodeName:}" failed. No retries permitted until 2026-07-13 14:53:05.16850737 +0000 UTC m=+9.235079816 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4113ffd-a496-4d76-9f75-942100b26c23-original-pull-secret") pod "global-pull-secret-syncer-vrbdc" (UID: "b4113ffd-a496-4d76-9f75-942100b26c23") : object "kube-system"/"original-pull-secret" not registered Jul 13 14:53:01.269161 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:01.269125 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b9zw\" (UniqueName: \"kubernetes.io/projected/ecfa98f6-7abe-43a4-956d-b613d7e1d854-kube-api-access-9b9zw\") pod \"network-check-target-gvdvc\" (UID: \"ecfa98f6-7abe-43a4-956d-b613d7e1d854\") " pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:53:01.269349 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:01.269325 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 14:53:01.269349 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:01.269348 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 14:53:01.269471 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:01.269362 2577 projected.go:196] Error preparing data for projected volume kube-api-access-9b9zw for pod openshift-network-diagnostics/network-check-target-gvdvc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:53:01.269471 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:01.269426 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecfa98f6-7abe-43a4-956d-b613d7e1d854-kube-api-access-9b9zw podName:ecfa98f6-7abe-43a4-956d-b613d7e1d854 nodeName:}" failed. No retries permitted until 2026-07-13 14:53:05.269406867 +0000 UTC m=+9.335979316 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9b9zw" (UniqueName: "kubernetes.io/projected/ecfa98f6-7abe-43a4-956d-b613d7e1d854-kube-api-access-9b9zw") pod "network-check-target-gvdvc" (UID: "ecfa98f6-7abe-43a4-956d-b613d7e1d854") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:53:01.342726 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:01.342696 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:53:01.342909 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:01.342828 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrbdc" podUID="b4113ffd-a496-4d76-9f75-942100b26c23" Jul 13 14:53:01.342973 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:01.342937 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:53:01.343036 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:01.343013 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvdvc" podUID="ecfa98f6-7abe-43a4-956d-b613d7e1d854" Jul 13 14:53:01.343091 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:01.343069 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:53:01.343172 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:01.343151 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gcng" podUID="40866c5d-2992-4d53-b839-e3dc5740b96d" Jul 13 14:53:03.339744 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:03.339692 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:53:03.340263 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:03.339706 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:53:03.340263 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:03.339852 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvdvc" podUID="ecfa98f6-7abe-43a4-956d-b613d7e1d854" Jul 13 14:53:03.340263 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:03.339706 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:53:03.340263 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:03.339915 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrbdc" podUID="b4113ffd-a496-4d76-9f75-942100b26c23" Jul 13 14:53:03.340263 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:03.340032 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gcng" podUID="40866c5d-2992-4d53-b839-e3dc5740b96d" Jul 13 14:53:05.201078 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:05.201044 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40866c5d-2992-4d53-b839-e3dc5740b96d-metrics-certs\") pod \"network-metrics-daemon-8gcng\" (UID: \"40866c5d-2992-4d53-b839-e3dc5740b96d\") " pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:53:05.201540 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:05.201131 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4113ffd-a496-4d76-9f75-942100b26c23-original-pull-secret\") pod \"global-pull-secret-syncer-vrbdc\" (UID: \"b4113ffd-a496-4d76-9f75-942100b26c23\") " pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:53:05.201540 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:05.201222 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:53:05.201540 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:05.201235 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 14:53:05.201540 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:05.201294 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40866c5d-2992-4d53-b839-e3dc5740b96d-metrics-certs podName:40866c5d-2992-4d53-b839-e3dc5740b96d nodeName:}" failed. No retries permitted until 2026-07-13 14:53:13.201272929 +0000 UTC m=+17.267845378 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40866c5d-2992-4d53-b839-e3dc5740b96d-metrics-certs") pod "network-metrics-daemon-8gcng" (UID: "40866c5d-2992-4d53-b839-e3dc5740b96d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:53:05.201540 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:05.201317 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4113ffd-a496-4d76-9f75-942100b26c23-original-pull-secret podName:b4113ffd-a496-4d76-9f75-942100b26c23 nodeName:}" failed. No retries permitted until 2026-07-13 14:53:13.201306753 +0000 UTC m=+17.267879200 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4113ffd-a496-4d76-9f75-942100b26c23-original-pull-secret") pod "global-pull-secret-syncer-vrbdc" (UID: "b4113ffd-a496-4d76-9f75-942100b26c23") : object "kube-system"/"original-pull-secret" not registered Jul 13 14:53:05.302053 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:05.302018 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b9zw\" (UniqueName: \"kubernetes.io/projected/ecfa98f6-7abe-43a4-956d-b613d7e1d854-kube-api-access-9b9zw\") pod \"network-check-target-gvdvc\" (UID: \"ecfa98f6-7abe-43a4-956d-b613d7e1d854\") " pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:53:05.302226 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:05.302174 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 14:53:05.302226 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:05.302194 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 14:53:05.302226 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:05.302206 2577 projected.go:196] Error preparing data for projected volume kube-api-access-9b9zw for pod openshift-network-diagnostics/network-check-target-gvdvc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:53:05.302346 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:05.302257 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecfa98f6-7abe-43a4-956d-b613d7e1d854-kube-api-access-9b9zw podName:ecfa98f6-7abe-43a4-956d-b613d7e1d854 nodeName:}" failed. No retries permitted until 2026-07-13 14:53:13.302242007 +0000 UTC m=+17.368814450 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9b9zw" (UniqueName: "kubernetes.io/projected/ecfa98f6-7abe-43a4-956d-b613d7e1d854-kube-api-access-9b9zw") pod "network-check-target-gvdvc" (UID: "ecfa98f6-7abe-43a4-956d-b613d7e1d854") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:53:05.340189 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:05.340156 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:53:05.340189 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:05.340183 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:53:05.340414 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:05.340203 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:53:05.340414 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:05.340296 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvdvc" podUID="ecfa98f6-7abe-43a4-956d-b613d7e1d854" Jul 13 14:53:05.340538 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:05.340461 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gcng" podUID="40866c5d-2992-4d53-b839-e3dc5740b96d" Jul 13 14:53:05.340596 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:05.340548 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrbdc" podUID="b4113ffd-a496-4d76-9f75-942100b26c23" Jul 13 14:53:07.340645 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:07.340613 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:53:07.341111 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:07.340706 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvdvc" podUID="ecfa98f6-7abe-43a4-956d-b613d7e1d854" Jul 13 14:53:07.341111 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:07.340760 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:53:07.341111 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:07.340855 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gcng" podUID="40866c5d-2992-4d53-b839-e3dc5740b96d" Jul 13 14:53:07.341111 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:07.340891 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:53:07.341111 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:07.340998 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrbdc" podUID="b4113ffd-a496-4d76-9f75-942100b26c23" Jul 13 14:53:09.340264 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:09.340227 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:53:09.340752 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:09.340230 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:53:09.340752 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:09.340362 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrbdc" podUID="b4113ffd-a496-4d76-9f75-942100b26c23" Jul 13 14:53:09.340752 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:09.340401 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:53:09.340752 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:09.340509 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvdvc" podUID="ecfa98f6-7abe-43a4-956d-b613d7e1d854" Jul 13 14:53:09.340752 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:09.340615 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gcng" podUID="40866c5d-2992-4d53-b839-e3dc5740b96d" Jul 13 14:53:11.339880 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:11.339854 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:53:11.340265 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:11.339861 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:53:11.340265 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:11.339957 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrbdc" podUID="b4113ffd-a496-4d76-9f75-942100b26c23" Jul 13 14:53:11.340265 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:11.340015 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvdvc" podUID="ecfa98f6-7abe-43a4-956d-b613d7e1d854" Jul 13 14:53:11.340265 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:11.339867 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:53:11.340265 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:11.340151 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gcng" podUID="40866c5d-2992-4d53-b839-e3dc5740b96d" Jul 13 14:53:12.463337 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:12.463064 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-237.ec2.internal" event={"ID":"04d9ec37c251ad9524965495843a7e0c","Type":"ContainerStarted","Data":"7527427ce5f223ebef7dc511723a4f5e151ee46284aeaa87be4ad28c87d26cfb"} Jul 13 14:53:12.474619 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:12.474585 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4tv96" event={"ID":"21e47eec-3d15-47fd-9cf8-dcaf27954260","Type":"ContainerStarted","Data":"4a4f67c2e79ec7f5fb43048b1dadd4d2fa7cb1b00cc9526c0e3718b10b432fad"} Jul 13 14:53:12.476281 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:12.476214 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" event={"ID":"12195aca-5c5b-45a7-ba39-87ac34323f89","Type":"ContainerStarted","Data":"4ba4d2c47b984e5d332184fdbe2d3275a8d34c93f6039ffc91f213df4c5e8192"} Jul 13 14:53:12.478414 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:12.478388 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" event={"ID":"d56a4953-1969-4be8-840e-ef390c117114","Type":"ContainerStarted","Data":"5986e27327b193f7d15ae141b0097a53ace39b87e5ca50fa7b6818a64b34714f"} Jul 13 14:53:12.480379 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:12.480333 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-237.ec2.internal" podStartSLOduration=15.480316401 podStartE2EDuration="15.480316401s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:52:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:53:12.47987755 +0000 UTC m=+16.546450014" watchObservedRunningTime="2026-07-13 14:53:12.480316401 +0000 UTC m=+16.546888876" Jul 13 14:53:12.498886 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:12.498838 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4tv96" podStartSLOduration=2.180930129 podStartE2EDuration="15.49882197s" totalImagesPullingTime="13.317891841s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:53:12.498446355 +0000 UTC m=+16.565018821" watchObservedRunningTime="2026-07-13 14:53:12.49882197 +0000 UTC m=+16.565394434" Jul 13 14:53:13.264956 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:13.264841 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4113ffd-a496-4d76-9f75-942100b26c23-original-pull-secret\") pod \"global-pull-secret-syncer-vrbdc\" (UID: \"b4113ffd-a496-4d76-9f75-942100b26c23\") " pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:53:13.264956 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:13.264916 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40866c5d-2992-4d53-b839-e3dc5740b96d-metrics-certs\") pod \"network-metrics-daemon-8gcng\" (UID: \"40866c5d-2992-4d53-b839-e3dc5740b96d\") " pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:53:13.265157 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:13.265049 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:53:13.265157 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:13.265062 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 14:53:13.265157 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:13.265119 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40866c5d-2992-4d53-b839-e3dc5740b96d-metrics-certs podName:40866c5d-2992-4d53-b839-e3dc5740b96d nodeName:}" failed. No retries permitted until 2026-07-13 14:53:29.265099749 +0000 UTC m=+33.331672216 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40866c5d-2992-4d53-b839-e3dc5740b96d-metrics-certs") pod "network-metrics-daemon-8gcng" (UID: "40866c5d-2992-4d53-b839-e3dc5740b96d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:53:13.265157 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:13.265139 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4113ffd-a496-4d76-9f75-942100b26c23-original-pull-secret podName:b4113ffd-a496-4d76-9f75-942100b26c23 nodeName:}" failed. No retries permitted until 2026-07-13 14:53:29.265128987 +0000 UTC m=+33.331701439 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4113ffd-a496-4d76-9f75-942100b26c23-original-pull-secret") pod "global-pull-secret-syncer-vrbdc" (UID: "b4113ffd-a496-4d76-9f75-942100b26c23") : object "kube-system"/"original-pull-secret" not registered Jul 13 14:53:13.340819 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:13.340212 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:53:13.340819 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:13.340365 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gcng" podUID="40866c5d-2992-4d53-b839-e3dc5740b96d" Jul 13 14:53:13.341084 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:13.340878 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:53:13.341084 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:13.340916 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:53:13.341084 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:13.341033 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrbdc" podUID="b4113ffd-a496-4d76-9f75-942100b26c23" Jul 13 14:53:13.341226 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:13.341118 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvdvc" podUID="ecfa98f6-7abe-43a4-956d-b613d7e1d854" Jul 13 14:53:13.366233 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:13.366185 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b9zw\" (UniqueName: \"kubernetes.io/projected/ecfa98f6-7abe-43a4-956d-b613d7e1d854-kube-api-access-9b9zw\") pod \"network-check-target-gvdvc\" (UID: \"ecfa98f6-7abe-43a4-956d-b613d7e1d854\") " pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:53:13.366424 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:13.366364 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 14:53:13.366424 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:13.366385 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 14:53:13.366424 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:13.366397 2577 projected.go:196] Error preparing data for projected volume kube-api-access-9b9zw for pod openshift-network-diagnostics/network-check-target-gvdvc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:53:13.366583 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:13.366454 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecfa98f6-7abe-43a4-956d-b613d7e1d854-kube-api-access-9b9zw podName:ecfa98f6-7abe-43a4-956d-b613d7e1d854 nodeName:}" failed. No retries permitted until 2026-07-13 14:53:29.366436379 +0000 UTC m=+33.433008826 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9b9zw" (UniqueName: "kubernetes.io/projected/ecfa98f6-7abe-43a4-956d-b613d7e1d854-kube-api-access-9b9zw") pod "network-check-target-gvdvc" (UID: "ecfa98f6-7abe-43a4-956d-b613d7e1d854") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:53:13.482635 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:13.482560 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xvxmb" event={"ID":"fa07f3f6-9861-4c60-9782-15bafe3f72d1","Type":"ContainerStarted","Data":"27673e1f43bcdb518d5923a2bb90ceb6d9dd11921a254431a670b4a65e698611"} Jul 13 14:53:13.484750 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:13.484636 2577 generic.go:356] "Generic (PLEG): container finished" podID="706ce44660952d0aec5f85bd24b8e4aa" containerID="3921fb07aec0b0af2182da6274469fa7727a5ef960ba67323b63826cc0a3de33" exitCode=0 Jul 13 14:53:13.484750 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:13.484698 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-237.ec2.internal" event={"ID":"706ce44660952d0aec5f85bd24b8e4aa","Type":"ContainerDied","Data":"3921fb07aec0b0af2182da6274469fa7727a5ef960ba67323b63826cc0a3de33"} Jul 13 14:53:13.486555 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:13.486528 2577 generic.go:356] "Generic (PLEG): container finished" podID="c96d9a00-a5ee-468a-ab1e-57fc28bda457" containerID="b3d91a5c19c9d0c73acef36d232a95e06a13b3ff893f44066b0f50abe2c44e24" exitCode=0 Jul 13 14:53:13.486649 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:13.486600 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6xbq" event={"ID":"c96d9a00-a5ee-468a-ab1e-57fc28bda457","Type":"ContainerDied","Data":"b3d91a5c19c9d0c73acef36d232a95e06a13b3ff893f44066b0f50abe2c44e24"} Jul 13 14:53:13.488401 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:13.488380 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bnrgl" event={"ID":"f105bdfa-cff6-4b9f-b5ac-7b386e2a9542","Type":"ContainerStarted","Data":"d5a6d305ba53535bed0ebd7fde029d00afc60e1e673e14dd1703bde9c9bb0497"} Jul 13 14:53:13.493231 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:13.492434 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6cfq7" event={"ID":"127d8c73-93c5-4fd9-8ab5-9276bcee81be","Type":"ContainerStarted","Data":"9ebbf586d0e09d7542d3a0ba2194afbb3f5b73d5dfc36aa7d4ca03c7d73f210e"} Jul 13 14:53:13.495503 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:13.495478 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cw5zb" event={"ID":"47635ebe-4411-4f30-bd50-d642f911219b","Type":"ContainerStarted","Data":"22302520c07acb65c2e51b47d9adc8067e1cc98c64dd12c9e18d7c3045a133b6"} Jul 13 14:53:13.497433 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:13.497408 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wclwd" event={"ID":"6494a281-bde1-4cb8-a6db-1a319f3cfa4d","Type":"ContainerStarted","Data":"41432da851b5cec9dc0ea8b20f76c27da8470a28763d2570c6e220f0ada37f8f"} Jul 13 14:53:13.498705 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:13.498659 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xvxmb" podStartSLOduration=4.398105172 podStartE2EDuration="16.498641876s" totalImagesPullingTime="12.100536704s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:53:13.498297087 +0000 UTC m=+17.564869555" watchObservedRunningTime="2026-07-13 14:53:13.498641876 +0000 UTC m=+17.565214344" Jul 13 14:53:13.498824 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:13.498766 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-p5sxk" podStartSLOduration=3.24583851 podStartE2EDuration="16.498758621s" totalImagesPullingTime="13.252920111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:53:12.514425913 +0000 UTC m=+16.580998379" watchObservedRunningTime="2026-07-13 14:53:13.498758621 +0000 UTC m=+17.565331088" Jul 13 14:53:13.512988 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:13.512922 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6cfq7" podStartSLOduration=3.274740095 podStartE2EDuration="16.512903919s" totalImagesPullingTime="13.238163824s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:53:13.512410685 +0000 UTC m=+17.578983149" watchObservedRunningTime="2026-07-13 14:53:13.512903919 +0000 UTC m=+17.579476379" Jul 13 14:53:13.543203 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:13.542863 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bnrgl" podStartSLOduration=3.310635022 podStartE2EDuration="16.54284267s" totalImagesPullingTime="13.232207648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:53:13.542811284 +0000 UTC m=+17.609383749" watchObservedRunningTime="2026-07-13 14:53:13.54284267 +0000 UTC m=+17.609415142" Jul 13 14:53:13.558639 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:13.558582 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cw5zb" podStartSLOduration=4.298237261 podStartE2EDuration="16.558565022s" totalImagesPullingTime="12.260327761s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:53:13.558286825 +0000 UTC m=+17.624859291" watchObservedRunningTime="2026-07-13 14:53:13.558565022 +0000 UTC m=+17.625137489" Jul 13 14:53:14.502540 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:14.502328 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-237.ec2.internal" event={"ID":"706ce44660952d0aec5f85bd24b8e4aa","Type":"ContainerStarted","Data":"573bc33924e9855b32df8d92ac1911c51da9f361d90928e27b4c07d8901e5ddb"} Jul 13 14:53:14.518389 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:14.518332 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-237.ec2.internal" podStartSLOduration=17.518312346 podStartE2EDuration="17.518312346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:52:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:53:14.517885442 +0000 UTC m=+18.584457910" watchObservedRunningTime="2026-07-13 14:53:14.518312346 +0000 UTC m=+18.584884817" Jul 13 14:53:14.646014 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:14.645839 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 13 14:53:15.185566 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:15.185461 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T14:53:14.645853891Z","UUID":"3bc51b1a-a11a-496d-b3ca-34a6a653bb70","Handler":null,"Name":"","Endpoint":""} Jul 13 14:53:15.187164 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:15.187143 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 13 14:53:15.187291 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:15.187185 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 13 14:53:15.340220 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:15.340187 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:53:15.340399 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:15.340312 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvdvc" podUID="ecfa98f6-7abe-43a4-956d-b613d7e1d854" Jul 13 14:53:15.340659 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:15.340603 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:53:15.340755 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:15.340719 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gcng" podUID="40866c5d-2992-4d53-b839-e3dc5740b96d" Jul 13 14:53:15.340842 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:15.340807 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:53:15.340948 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:15.340898 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrbdc" podUID="b4113ffd-a496-4d76-9f75-942100b26c23" Jul 13 14:53:15.506432 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:15.506352 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wclwd" event={"ID":"6494a281-bde1-4cb8-a6db-1a319f3cfa4d","Type":"ContainerStarted","Data":"4500b1a9d59443f0f52edede49c6b55a7b4fa8ebd0398fa0311851c8c258019f"} Jul 13 14:53:15.677947 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:15.677916 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bnrgl" Jul 13 14:53:15.678649 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:15.678632 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bnrgl" Jul 13 14:53:16.511935 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:16.511896 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wclwd" event={"ID":"6494a281-bde1-4cb8-a6db-1a319f3cfa4d","Type":"ContainerStarted","Data":"72ec4a80c79be815c6860b38c8d50161889f9319b97471e93c80333bb64b69bf"} Jul 13 14:53:16.512559 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:16.511967 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bnrgl" Jul 13 14:53:16.512559 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:16.512286 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bnrgl" Jul 13 14:53:16.531489 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:16.531429 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wclwd" podStartSLOduration=3.696935764 podStartE2EDuration="19.531408342s" totalImagesPullingTime="15.834472578s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:52:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:53:16.530660528 +0000 UTC m=+20.597232996" watchObservedRunningTime="2026-07-13 14:53:16.531408342 +0000 UTC m=+20.597980806" Jul 13 14:53:17.341727 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:17.341481 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:53:17.341924 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:17.341561 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:53:17.341924 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:17.341837 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvdvc" podUID="ecfa98f6-7abe-43a4-956d-b613d7e1d854" Jul 13 14:53:17.341924 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:17.341631 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:53:17.342093 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:17.341951 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gcng" podUID="40866c5d-2992-4d53-b839-e3dc5740b96d" Jul 13 14:53:17.342093 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:17.342031 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrbdc" podUID="b4113ffd-a496-4d76-9f75-942100b26c23" Jul 13 14:53:18.518411 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:18.518324 2577 generic.go:356] "Generic (PLEG): container finished" podID="c96d9a00-a5ee-468a-ab1e-57fc28bda457" containerID="911d53f9f2a9fe2f543246c3c5ac18947467e4728ef00123570f1f54a275ab07" exitCode=0 Jul 13 14:53:18.518835 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:18.518411 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6xbq" event={"ID":"c96d9a00-a5ee-468a-ab1e-57fc28bda457","Type":"ContainerDied","Data":"911d53f9f2a9fe2f543246c3c5ac18947467e4728ef00123570f1f54a275ab07"} Jul 13 14:53:19.340338 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:19.340300 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:53:19.340338 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:19.340335 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:53:19.340712 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:19.340300 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:53:19.340712 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:19.340434 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gcng" podUID="40866c5d-2992-4d53-b839-e3dc5740b96d" Jul 13 14:53:19.340712 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:19.340498 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvdvc" podUID="ecfa98f6-7abe-43a4-956d-b613d7e1d854" Jul 13 14:53:19.340712 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:19.340589 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrbdc" podUID="b4113ffd-a496-4d76-9f75-942100b26c23" Jul 13 14:53:19.853348 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:19.853318 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cw5zb_47635ebe-4411-4f30-bd50-d642f911219b/dns-node-resolver/0.log" Jul 13 14:53:20.822902 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:20.822864 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6cfq7_127d8c73-93c5-4fd9-8ab5-9276bcee81be/node-ca/0.log" Jul 13 14:53:21.339607 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:21.339545 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:53:21.339607 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:21.339587 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:53:21.340131 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:21.339547 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:53:21.340131 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:21.339668 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvdvc" podUID="ecfa98f6-7abe-43a4-956d-b613d7e1d854" Jul 13 14:53:21.340131 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:21.339805 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gcng" podUID="40866c5d-2992-4d53-b839-e3dc5740b96d" Jul 13 14:53:21.340131 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:21.339882 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrbdc" podUID="b4113ffd-a496-4d76-9f75-942100b26c23" Jul 13 14:53:23.339432 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:23.339391 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:53:23.339432 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:23.339411 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:53:23.339883 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:23.339502 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvdvc" podUID="ecfa98f6-7abe-43a4-956d-b613d7e1d854" Jul 13 14:53:23.339883 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:23.339537 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrbdc" podUID="b4113ffd-a496-4d76-9f75-942100b26c23" Jul 13 14:53:23.339883 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:23.339597 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:53:23.339883 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:23.339716 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gcng" podUID="40866c5d-2992-4d53-b839-e3dc5740b96d" Jul 13 14:53:24.533870 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:24.533634 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" event={"ID":"12195aca-5c5b-45a7-ba39-87ac34323f89","Type":"ContainerStarted","Data":"48a6acc4ef2f9c5c503a144f2da11622a136ed0c5566830add34adc68ee98ba6"} Jul 13 14:53:24.534255 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:24.533927 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" event={"ID":"12195aca-5c5b-45a7-ba39-87ac34323f89","Type":"ContainerStarted","Data":"b1662aeefb83d80b368f8a177ac25caa566bbb0b6266af0e86581c03cfd5c250"} Jul 13 14:53:24.534255 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:24.533972 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" event={"ID":"12195aca-5c5b-45a7-ba39-87ac34323f89","Type":"ContainerStarted","Data":"015bc4de3c09b772817978ce1c89d464b4131a2888aed645baf59f325b58cad6"} Jul 13 14:53:24.534255 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:24.534000 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" event={"ID":"12195aca-5c5b-45a7-ba39-87ac34323f89","Type":"ContainerStarted","Data":"59edcdc370b67aff7d1425978cf418c1b1aac39c292d366575c011a4043c3d87"} Jul 13 14:53:24.534255 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:24.534026 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" event={"ID":"12195aca-5c5b-45a7-ba39-87ac34323f89","Type":"ContainerStarted","Data":"bacb90cb5e0c776f92d5e166cb9cda3612d1a2b1c95fbb339dcdc7f4cb5d33d6"} Jul 13 14:53:24.534255 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:24.534052 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" event={"ID":"12195aca-5c5b-45a7-ba39-87ac34323f89","Type":"ContainerStarted","Data":"8bb20b5d6b1d3b73f83458051565434ee1a6d14739dfc33547969bb5d95f0282"} Jul 13 14:53:24.535689 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:24.535666 2577 generic.go:356] "Generic (PLEG): container finished" podID="c96d9a00-a5ee-468a-ab1e-57fc28bda457" containerID="efbd4fee47297edb746b0ee16d5ace8067fdec76ec116b5a4da209003efc4d4d" exitCode=0 Jul 13 14:53:24.535794 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:24.535702 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6xbq" event={"ID":"c96d9a00-a5ee-468a-ab1e-57fc28bda457","Type":"ContainerDied","Data":"efbd4fee47297edb746b0ee16d5ace8067fdec76ec116b5a4da209003efc4d4d"} Jul 13 14:53:25.339795 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:25.339756 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:53:25.339795 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:25.339793 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:53:25.340020 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:25.339762 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:53:25.340020 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:25.339869 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvdvc" podUID="ecfa98f6-7abe-43a4-956d-b613d7e1d854" Jul 13 14:53:25.340020 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:25.339922 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gcng" podUID="40866c5d-2992-4d53-b839-e3dc5740b96d" Jul 13 14:53:25.340020 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:25.339980 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrbdc" podUID="b4113ffd-a496-4d76-9f75-942100b26c23" Jul 13 14:53:25.540061 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:25.540037 2577 generic.go:356] "Generic (PLEG): container finished" podID="c96d9a00-a5ee-468a-ab1e-57fc28bda457" containerID="5db0e2e4d7d197c452a6f644e50fb53ad4a2f56d53c8ab67b56ceb9e333c0de9" exitCode=0 Jul 13 14:53:25.540452 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:25.540071 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6xbq" event={"ID":"c96d9a00-a5ee-468a-ab1e-57fc28bda457","Type":"ContainerDied","Data":"5db0e2e4d7d197c452a6f644e50fb53ad4a2f56d53c8ab67b56ceb9e333c0de9"} Jul 13 14:53:27.340682 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:27.340654 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:53:27.341154 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:27.340731 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvdvc" podUID="ecfa98f6-7abe-43a4-956d-b613d7e1d854" Jul 13 14:53:27.341154 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:27.340830 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:53:27.341154 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:27.340949 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gcng" podUID="40866c5d-2992-4d53-b839-e3dc5740b96d" Jul 13 14:53:27.341154 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:27.340999 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:53:27.341154 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:27.341102 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrbdc" podUID="b4113ffd-a496-4d76-9f75-942100b26c23" Jul 13 14:53:27.548165 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:27.548124 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" event={"ID":"12195aca-5c5b-45a7-ba39-87ac34323f89","Type":"ContainerStarted","Data":"94b8117d9ac8c866b020583e7c08f29889eb8e90d4777e8e84ad3d8a8af636bc"} Jul 13 14:53:29.289878 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:29.289840 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40866c5d-2992-4d53-b839-e3dc5740b96d-metrics-certs\") pod \"network-metrics-daemon-8gcng\" (UID: \"40866c5d-2992-4d53-b839-e3dc5740b96d\") " pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:53:29.289878 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:29.289917 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4113ffd-a496-4d76-9f75-942100b26c23-original-pull-secret\") pod \"global-pull-secret-syncer-vrbdc\" (UID: \"b4113ffd-a496-4d76-9f75-942100b26c23\") " pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:53:29.290357 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:29.290007 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:53:29.290357 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:29.290027 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 14:53:29.290357 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:29.290073 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40866c5d-2992-4d53-b839-e3dc5740b96d-metrics-certs podName:40866c5d-2992-4d53-b839-e3dc5740b96d nodeName:}" failed. No retries permitted until 2026-07-13 14:54:01.290057298 +0000 UTC m=+65.356629751 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40866c5d-2992-4d53-b839-e3dc5740b96d-metrics-certs") pod "network-metrics-daemon-8gcng" (UID: "40866c5d-2992-4d53-b839-e3dc5740b96d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:53:29.290357 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:29.290088 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4113ffd-a496-4d76-9f75-942100b26c23-original-pull-secret podName:b4113ffd-a496-4d76-9f75-942100b26c23 nodeName:}" failed. No retries permitted until 2026-07-13 14:54:01.290082435 +0000 UTC m=+65.356654891 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4113ffd-a496-4d76-9f75-942100b26c23-original-pull-secret") pod "global-pull-secret-syncer-vrbdc" (UID: "b4113ffd-a496-4d76-9f75-942100b26c23") : object "kube-system"/"original-pull-secret" not registered Jul 13 14:53:29.339999 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:29.339965 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:53:29.340140 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:29.339965 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:53:29.340140 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:29.340089 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:53:29.340140 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:29.340086 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrbdc" podUID="b4113ffd-a496-4d76-9f75-942100b26c23" Jul 13 14:53:29.340315 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:29.340197 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gcng" podUID="40866c5d-2992-4d53-b839-e3dc5740b96d" Jul 13 14:53:29.340315 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:29.340286 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvdvc" podUID="ecfa98f6-7abe-43a4-956d-b613d7e1d854" Jul 13 14:53:29.391290 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:29.391259 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b9zw\" (UniqueName: \"kubernetes.io/projected/ecfa98f6-7abe-43a4-956d-b613d7e1d854-kube-api-access-9b9zw\") pod \"network-check-target-gvdvc\" (UID: \"ecfa98f6-7abe-43a4-956d-b613d7e1d854\") " pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:53:29.391442 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:29.391422 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 14:53:29.391499 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:29.391449 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 14:53:29.391499 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:29.391462 2577 projected.go:196] Error preparing data for projected volume kube-api-access-9b9zw for pod openshift-network-diagnostics/network-check-target-gvdvc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:53:29.391595 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:29.391518 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecfa98f6-7abe-43a4-956d-b613d7e1d854-kube-api-access-9b9zw podName:ecfa98f6-7abe-43a4-956d-b613d7e1d854 nodeName:}" failed. No retries permitted until 2026-07-13 14:54:01.39150007 +0000 UTC m=+65.458072527 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9b9zw" (UniqueName: "kubernetes.io/projected/ecfa98f6-7abe-43a4-956d-b613d7e1d854-kube-api-access-9b9zw") pod "network-check-target-gvdvc" (UID: "ecfa98f6-7abe-43a4-956d-b613d7e1d854") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:53:30.557917 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:30.557734 2577 generic.go:356] "Generic (PLEG): container finished" podID="c96d9a00-a5ee-468a-ab1e-57fc28bda457" containerID="61a5127f0b819293cab6ec38791eba8e6ef4a1fde728e9dc44c46215a0fe57c4" exitCode=0 Jul 13 14:53:30.558454 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:30.557807 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6xbq" event={"ID":"c96d9a00-a5ee-468a-ab1e-57fc28bda457","Type":"ContainerDied","Data":"61a5127f0b819293cab6ec38791eba8e6ef4a1fde728e9dc44c46215a0fe57c4"} Jul 13 14:53:30.561706 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:30.561686 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" event={"ID":"12195aca-5c5b-45a7-ba39-87ac34323f89","Type":"ContainerStarted","Data":"899c9f47e56f3d2a1e39225b8c7f52352f0b7015f06cab1f8229a4ad7720644b"} Jul 13 14:53:30.561952 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:30.561936 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:53:30.562008 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:30.561990 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:53:30.577960 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:30.577941 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:53:30.608596 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:30.608559 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" podStartSLOduration=21.620188764 podStartE2EDuration="33.608547213s" totalImagesPullingTime="11.988358449s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:53:30.607990649 +0000 UTC m=+34.674563114" watchObservedRunningTime="2026-07-13 14:53:30.608547213 +0000 UTC m=+34.675119715" Jul 13 14:53:31.340318 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:31.340286 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:53:31.340481 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:31.340287 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:53:31.340481 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:31.340409 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:53:31.340481 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:31.340416 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gcng" podUID="40866c5d-2992-4d53-b839-e3dc5740b96d" Jul 13 14:53:31.340596 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:31.340496 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvdvc" podUID="ecfa98f6-7abe-43a4-956d-b613d7e1d854" Jul 13 14:53:31.340596 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:31.340574 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrbdc" podUID="b4113ffd-a496-4d76-9f75-942100b26c23" Jul 13 14:53:31.566730 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:31.566701 2577 generic.go:356] "Generic (PLEG): container finished" podID="c96d9a00-a5ee-468a-ab1e-57fc28bda457" containerID="c90e47aa9c5460c59fb1bc2c4eb6cedf834d72c18a3c038f8868c9109263438c" exitCode=0 Jul 13 14:53:31.567129 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:31.566762 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6xbq" event={"ID":"c96d9a00-a5ee-468a-ab1e-57fc28bda457","Type":"ContainerDied","Data":"c90e47aa9c5460c59fb1bc2c4eb6cedf834d72c18a3c038f8868c9109263438c"} Jul 13 14:53:31.567283 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:31.567252 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:53:31.586495 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:31.586462 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:53:32.571833 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:32.571790 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m6xbq" event={"ID":"c96d9a00-a5ee-468a-ab1e-57fc28bda457","Type":"ContainerStarted","Data":"b940019e0274b6ef53f2093e508e54b114b64bbdc6f48c2b8dc7a3597f63e913"} Jul 13 14:53:32.594263 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:32.594214 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-m6xbq" podStartSLOduration=6.980029171 podStartE2EDuration="35.594199056s" totalImagesPullingTime="28.614169885s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:52:57 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:53:32.593078055 +0000 UTC m=+36.659650522" watchObservedRunningTime="2026-07-13 14:53:32.594199056 +0000 UTC m=+36.660771520" Jul 13 14:53:33.339641 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:33.339615 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:53:33.339641 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:33.339631 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:53:33.339878 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:33.339632 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:53:33.339878 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:33.339709 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gcng" podUID="40866c5d-2992-4d53-b839-e3dc5740b96d" Jul 13 14:53:33.339878 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:33.339798 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrbdc" podUID="b4113ffd-a496-4d76-9f75-942100b26c23" Jul 13 14:53:33.339970 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:33.339872 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvdvc" podUID="ecfa98f6-7abe-43a4-956d-b613d7e1d854" Jul 13 14:53:35.339965 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:35.339931 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:53:35.339965 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:35.339951 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:53:35.340402 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:35.340042 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvdvc" podUID="ecfa98f6-7abe-43a4-956d-b613d7e1d854" Jul 13 14:53:35.340402 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:35.340112 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gcng" podUID="40866c5d-2992-4d53-b839-e3dc5740b96d" Jul 13 14:53:35.340402 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:35.340142 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:53:35.340402 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:35.340249 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrbdc" podUID="b4113ffd-a496-4d76-9f75-942100b26c23" Jul 13 14:53:37.340179 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:37.340157 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:53:37.340515 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:37.340239 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvdvc" podUID="ecfa98f6-7abe-43a4-956d-b613d7e1d854" Jul 13 14:53:37.340515 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:37.340313 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:53:37.340515 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:37.340392 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrbdc" podUID="b4113ffd-a496-4d76-9f75-942100b26c23" Jul 13 14:53:37.340515 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:37.340446 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:53:37.340515 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:37.340509 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gcng" podUID="40866c5d-2992-4d53-b839-e3dc5740b96d" Jul 13 14:53:39.339999 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:39.339961 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:53:39.340423 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:39.339967 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:53:39.340423 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:39.340044 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvdvc" podUID="ecfa98f6-7abe-43a4-956d-b613d7e1d854" Jul 13 14:53:39.340423 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:39.340112 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gcng" podUID="40866c5d-2992-4d53-b839-e3dc5740b96d" Jul 13 14:53:39.340423 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:39.340135 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:53:39.340423 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:39.340241 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrbdc" podUID="b4113ffd-a496-4d76-9f75-942100b26c23" Jul 13 14:53:41.340295 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:41.340266 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:53:41.340295 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:41.340279 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:53:41.340791 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:41.340267 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:53:41.340791 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:41.340361 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvdvc" podUID="ecfa98f6-7abe-43a4-956d-b613d7e1d854" Jul 13 14:53:41.340791 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:41.340472 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gcng" podUID="40866c5d-2992-4d53-b839-e3dc5740b96d" Jul 13 14:53:41.340791 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:41.340570 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrbdc" podUID="b4113ffd-a496-4d76-9f75-942100b26c23" Jul 13 14:53:43.339918 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:43.339887 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:53:43.339918 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:43.339918 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:53:43.340304 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:43.339918 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:53:43.340304 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:43.339985 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvdvc" podUID="ecfa98f6-7abe-43a4-956d-b613d7e1d854" Jul 13 14:53:43.340304 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:43.340078 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gcng" podUID="40866c5d-2992-4d53-b839-e3dc5740b96d" Jul 13 14:53:43.340304 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:43.340163 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrbdc" podUID="b4113ffd-a496-4d76-9f75-942100b26c23" Jul 13 14:53:45.146859 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:45.146657 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vrbdc"] Jul 13 14:53:45.147261 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:45.146941 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:53:45.147261 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:45.147035 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrbdc" podUID="b4113ffd-a496-4d76-9f75-942100b26c23" Jul 13 14:53:45.147261 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:45.147200 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gvdvc"] Jul 13 14:53:45.147410 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:45.147272 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:53:45.147410 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:45.147346 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvdvc" podUID="ecfa98f6-7abe-43a4-956d-b613d7e1d854" Jul 13 14:53:45.163117 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:45.163043 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8gcng"] Jul 13 14:53:45.163252 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:45.163164 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:53:45.163300 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:45.163281 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gcng" podUID="40866c5d-2992-4d53-b839-e3dc5740b96d" Jul 13 14:53:47.341062 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:47.341026 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:53:47.341662 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:47.341110 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:53:47.341662 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:47.341110 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gvdvc" podUID="ecfa98f6-7abe-43a4-956d-b613d7e1d854" Jul 13 14:53:47.341662 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:47.341249 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:53:47.341662 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:47.341247 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gcng" podUID="40866c5d-2992-4d53-b839-e3dc5740b96d" Jul 13 14:53:47.341662 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:53:47.341328 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrbdc" podUID="b4113ffd-a496-4d76-9f75-942100b26c23" Jul 13 14:53:49.276247 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.276223 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-237.ec2.internal" event="NodeReady" Jul 13 14:53:49.276685 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.276359 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 13 14:53:49.340323 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.340286 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:53:49.340661 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.340363 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:53:49.340661 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.340649 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:53:49.343567 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.343546 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74869c78fb-4snkc"] Jul 13 14:53:49.345383 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.345367 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74869c78fb-4snkc" Jul 13 14:53:49.349407 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.349385 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 14:53:49.349638 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.349623 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 14:53:49.349752 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.349738 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 14:53:49.349868 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.349856 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 14:53:49.350017 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.350001 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 13 14:53:49.350017 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.350001 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 13 14:53:49.350332 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.350312 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bz4r7\"" Jul 13 14:53:49.350444 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.350410 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hw4cv\"" Jul 13 14:53:49.350444 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.350431 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 13 14:53:49.350606 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.350575 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-77ztl\"" Jul 13 14:53:49.357806 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.357768 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 13 14:53:49.370282 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.370258 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74869c78fb-4snkc"] Jul 13 14:53:49.377381 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.377361 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l9jkc"] Jul 13 14:53:49.379074 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.379060 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l9jkc" Jul 13 14:53:49.383261 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.383244 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gx4xs"] Jul 13 14:53:49.383261 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.383254 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 13 14:53:49.383415 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.383254 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 13 14:53:49.383415 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.383302 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5mgh5\"" Jul 13 14:53:49.385226 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.385211 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gx4xs" Jul 13 14:53:49.388767 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.388749 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 13 14:53:49.388870 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.388800 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4s4js\"" Jul 13 14:53:49.389468 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.389450 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 13 14:53:49.389734 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.389721 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 13 14:53:49.407149 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.407124 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l9jkc"] Jul 13 14:53:49.433584 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.433549 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gx4xs"] Jul 13 14:53:49.436082 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.436059 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e834a3dd-45d7-4375-bcb2-aec8703c05c2-trusted-ca\") pod \"image-registry-74869c78fb-4snkc\" (UID: \"e834a3dd-45d7-4375-bcb2-aec8703c05c2\") " pod="openshift-image-registry/image-registry-74869c78fb-4snkc" Jul 13 14:53:49.436219 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.436087 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e834a3dd-45d7-4375-bcb2-aec8703c05c2-installation-pull-secrets\") pod \"image-registry-74869c78fb-4snkc\" (UID: \"e834a3dd-45d7-4375-bcb2-aec8703c05c2\") " pod="openshift-image-registry/image-registry-74869c78fb-4snkc" Jul 13 14:53:49.436219 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.436115 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e834a3dd-45d7-4375-bcb2-aec8703c05c2-bound-sa-token\") pod \"image-registry-74869c78fb-4snkc\" (UID: \"e834a3dd-45d7-4375-bcb2-aec8703c05c2\") " pod="openshift-image-registry/image-registry-74869c78fb-4snkc" Jul 13 14:53:49.436219 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.436139 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6f7d3e1-80fb-4fb2-af95-146709ef0532-tmp-dir\") pod \"dns-default-l9jkc\" (UID: \"e6f7d3e1-80fb-4fb2-af95-146709ef0532\") " pod="openshift-dns/dns-default-l9jkc" Jul 13 14:53:49.436219 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.436191 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6f7d3e1-80fb-4fb2-af95-146709ef0532-metrics-tls\") pod \"dns-default-l9jkc\" (UID: \"e6f7d3e1-80fb-4fb2-af95-146709ef0532\") " pod="openshift-dns/dns-default-l9jkc" Jul 13 14:53:49.436413 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.436222 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e834a3dd-45d7-4375-bcb2-aec8703c05c2-image-registry-private-configuration\") pod \"image-registry-74869c78fb-4snkc\" (UID: \"e834a3dd-45d7-4375-bcb2-aec8703c05c2\") " pod="openshift-image-registry/image-registry-74869c78fb-4snkc" Jul 13 14:53:49.436413 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.436304 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e834a3dd-45d7-4375-bcb2-aec8703c05c2-ca-trust-extracted\") pod \"image-registry-74869c78fb-4snkc\" (UID: \"e834a3dd-45d7-4375-bcb2-aec8703c05c2\") " pod="openshift-image-registry/image-registry-74869c78fb-4snkc" Jul 13 14:53:49.436413 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.436376 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2127b3c-d4ef-48e7-887a-12892501daaf-cert\") pod \"ingress-canary-gx4xs\" (UID: \"c2127b3c-d4ef-48e7-887a-12892501daaf\") " pod="openshift-ingress-canary/ingress-canary-gx4xs" Jul 13 14:53:49.436413 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.436396 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e834a3dd-45d7-4375-bcb2-aec8703c05c2-registry-tls\") pod \"image-registry-74869c78fb-4snkc\" (UID: \"e834a3dd-45d7-4375-bcb2-aec8703c05c2\") " pod="openshift-image-registry/image-registry-74869c78fb-4snkc" Jul 13 14:53:49.436413 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.436412 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kqjs\" (UniqueName: \"kubernetes.io/projected/e834a3dd-45d7-4375-bcb2-aec8703c05c2-kube-api-access-6kqjs\") pod \"image-registry-74869c78fb-4snkc\" (UID: \"e834a3dd-45d7-4375-bcb2-aec8703c05c2\") " pod="openshift-image-registry/image-registry-74869c78fb-4snkc" Jul 13 14:53:49.436571 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.436441 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e6f7d3e1-80fb-4fb2-af95-146709ef0532-config-volume\") pod \"dns-default-l9jkc\" (UID: \"e6f7d3e1-80fb-4fb2-af95-146709ef0532\") " pod="openshift-dns/dns-default-l9jkc" Jul 13 14:53:49.436608 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.436591 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgld4\" (UniqueName: \"kubernetes.io/projected/c2127b3c-d4ef-48e7-887a-12892501daaf-kube-api-access-vgld4\") pod \"ingress-canary-gx4xs\" (UID: \"c2127b3c-d4ef-48e7-887a-12892501daaf\") " pod="openshift-ingress-canary/ingress-canary-gx4xs" Jul 13 14:53:49.436640 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.436617 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e834a3dd-45d7-4375-bcb2-aec8703c05c2-registry-certificates\") pod \"image-registry-74869c78fb-4snkc\" (UID: \"e834a3dd-45d7-4375-bcb2-aec8703c05c2\") " pod="openshift-image-registry/image-registry-74869c78fb-4snkc" Jul 13 14:53:49.436701 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.436682 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpqfm\" (UniqueName: \"kubernetes.io/projected/e6f7d3e1-80fb-4fb2-af95-146709ef0532-kube-api-access-dpqfm\") pod \"dns-default-l9jkc\" (UID: \"e6f7d3e1-80fb-4fb2-af95-146709ef0532\") " pod="openshift-dns/dns-default-l9jkc" Jul 13 14:53:49.494260 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.494234 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pxbb4"] Jul 13 14:53:49.496305 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.496290 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pxbb4" Jul 13 14:53:49.501323 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.501301 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 13 14:53:49.501492 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.501477 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 13 14:53:49.501853 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.501844 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 13 14:53:49.502350 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.502318 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 13 14:53:49.502564 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.502551 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ghzxf\"" Jul 13 14:53:49.523898 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.523868 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pxbb4"] Jul 13 14:53:49.537230 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.537156 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e90d2eb-57e0-4e48-8167-aa16764b612a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pxbb4\" (UID: \"1e90d2eb-57e0-4e48-8167-aa16764b612a\") " pod="openshift-insights/insights-runtime-extractor-pxbb4" Jul 13 14:53:49.537230 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.537211 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpqfm\" (UniqueName: \"kubernetes.io/projected/e6f7d3e1-80fb-4fb2-af95-146709ef0532-kube-api-access-dpqfm\") pod \"dns-default-l9jkc\" (UID: \"e6f7d3e1-80fb-4fb2-af95-146709ef0532\") " pod="openshift-dns/dns-default-l9jkc" Jul 13 14:53:49.537413 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.537263 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e834a3dd-45d7-4375-bcb2-aec8703c05c2-trusted-ca\") pod \"image-registry-74869c78fb-4snkc\" (UID: \"e834a3dd-45d7-4375-bcb2-aec8703c05c2\") " pod="openshift-image-registry/image-registry-74869c78fb-4snkc" Jul 13 14:53:49.537413 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.537295 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e834a3dd-45d7-4375-bcb2-aec8703c05c2-installation-pull-secrets\") pod \"image-registry-74869c78fb-4snkc\" (UID: \"e834a3dd-45d7-4375-bcb2-aec8703c05c2\") " pod="openshift-image-registry/image-registry-74869c78fb-4snkc" Jul 13 14:53:49.537413 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.537320 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e90d2eb-57e0-4e48-8167-aa16764b612a-data-volume\") pod \"insights-runtime-extractor-pxbb4\" (UID: \"1e90d2eb-57e0-4e48-8167-aa16764b612a\") " pod="openshift-insights/insights-runtime-extractor-pxbb4" Jul 13 14:53:49.537413 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.537338 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e834a3dd-45d7-4375-bcb2-aec8703c05c2-bound-sa-token\") pod \"image-registry-74869c78fb-4snkc\" (UID: \"e834a3dd-45d7-4375-bcb2-aec8703c05c2\") " pod="openshift-image-registry/image-registry-74869c78fb-4snkc" Jul 13 14:53:49.537413 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.537391 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6f7d3e1-80fb-4fb2-af95-146709ef0532-tmp-dir\") pod \"dns-default-l9jkc\" (UID: \"e6f7d3e1-80fb-4fb2-af95-146709ef0532\") " pod="openshift-dns/dns-default-l9jkc" Jul 13 14:53:49.537657 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.537422 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6f7d3e1-80fb-4fb2-af95-146709ef0532-metrics-tls\") pod \"dns-default-l9jkc\" (UID: \"e6f7d3e1-80fb-4fb2-af95-146709ef0532\") " pod="openshift-dns/dns-default-l9jkc" Jul 13 14:53:49.537657 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.537453 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e834a3dd-45d7-4375-bcb2-aec8703c05c2-image-registry-private-configuration\") pod \"image-registry-74869c78fb-4snkc\" (UID: \"e834a3dd-45d7-4375-bcb2-aec8703c05c2\") " pod="openshift-image-registry/image-registry-74869c78fb-4snkc" Jul 13 14:53:49.537657 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.537495 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khtgx\" (UniqueName: \"kubernetes.io/projected/1e90d2eb-57e0-4e48-8167-aa16764b612a-kube-api-access-khtgx\") pod \"insights-runtime-extractor-pxbb4\" (UID: \"1e90d2eb-57e0-4e48-8167-aa16764b612a\") " pod="openshift-insights/insights-runtime-extractor-pxbb4" Jul 13 14:53:49.537657 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.537533 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e90d2eb-57e0-4e48-8167-aa16764b612a-crio-socket\") pod \"insights-runtime-extractor-pxbb4\" (UID: \"1e90d2eb-57e0-4e48-8167-aa16764b612a\") " pod="openshift-insights/insights-runtime-extractor-pxbb4" Jul 13 14:53:49.537657 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.537557 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e90d2eb-57e0-4e48-8167-aa16764b612a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pxbb4\" (UID: \"1e90d2eb-57e0-4e48-8167-aa16764b612a\") " pod="openshift-insights/insights-runtime-extractor-pxbb4" Jul 13 14:53:49.537657 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.537610 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e834a3dd-45d7-4375-bcb2-aec8703c05c2-ca-trust-extracted\") pod \"image-registry-74869c78fb-4snkc\" (UID: \"e834a3dd-45d7-4375-bcb2-aec8703c05c2\") " pod="openshift-image-registry/image-registry-74869c78fb-4snkc" Jul 13 14:53:49.537955 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.537691 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2127b3c-d4ef-48e7-887a-12892501daaf-cert\") pod \"ingress-canary-gx4xs\" (UID: \"c2127b3c-d4ef-48e7-887a-12892501daaf\") " pod="openshift-ingress-canary/ingress-canary-gx4xs" Jul 13 14:53:49.537955 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.537724 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e834a3dd-45d7-4375-bcb2-aec8703c05c2-registry-tls\") pod \"image-registry-74869c78fb-4snkc\" (UID: \"e834a3dd-45d7-4375-bcb2-aec8703c05c2\") " pod="openshift-image-registry/image-registry-74869c78fb-4snkc" Jul 13 14:53:49.537955 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.537751 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kqjs\" (UniqueName: \"kubernetes.io/projected/e834a3dd-45d7-4375-bcb2-aec8703c05c2-kube-api-access-6kqjs\") pod \"image-registry-74869c78fb-4snkc\" (UID: \"e834a3dd-45d7-4375-bcb2-aec8703c05c2\") " pod="openshift-image-registry/image-registry-74869c78fb-4snkc" Jul 13 14:53:49.537955 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.537796 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e6f7d3e1-80fb-4fb2-af95-146709ef0532-config-volume\") pod \"dns-default-l9jkc\" (UID: \"e6f7d3e1-80fb-4fb2-af95-146709ef0532\") " pod="openshift-dns/dns-default-l9jkc" Jul 13 14:53:49.537955 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.537831 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgld4\" (UniqueName: \"kubernetes.io/projected/c2127b3c-d4ef-48e7-887a-12892501daaf-kube-api-access-vgld4\") pod \"ingress-canary-gx4xs\" (UID: \"c2127b3c-d4ef-48e7-887a-12892501daaf\") " pod="openshift-ingress-canary/ingress-canary-gx4xs" Jul 13 14:53:49.538186 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.538043 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e834a3dd-45d7-4375-bcb2-aec8703c05c2-registry-certificates\") pod \"image-registry-74869c78fb-4snkc\" (UID: \"e834a3dd-45d7-4375-bcb2-aec8703c05c2\") " pod="openshift-image-registry/image-registry-74869c78fb-4snkc" Jul 13 14:53:49.538227 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.538184 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6f7d3e1-80fb-4fb2-af95-146709ef0532-tmp-dir\") pod \"dns-default-l9jkc\" (UID: \"e6f7d3e1-80fb-4fb2-af95-146709ef0532\") " pod="openshift-dns/dns-default-l9jkc" Jul 13 14:53:49.538678 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.538653 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e834a3dd-45d7-4375-bcb2-aec8703c05c2-trusted-ca\") pod \"image-registry-74869c78fb-4snkc\" (UID: \"e834a3dd-45d7-4375-bcb2-aec8703c05c2\") " pod="openshift-image-registry/image-registry-74869c78fb-4snkc" Jul 13 14:53:49.538795 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.538712 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e6f7d3e1-80fb-4fb2-af95-146709ef0532-config-volume\") pod \"dns-default-l9jkc\" (UID: \"e6f7d3e1-80fb-4fb2-af95-146709ef0532\") " pod="openshift-dns/dns-default-l9jkc" Jul 13 14:53:49.538857 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.538837 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e834a3dd-45d7-4375-bcb2-aec8703c05c2-registry-certificates\") pod \"image-registry-74869c78fb-4snkc\" (UID: \"e834a3dd-45d7-4375-bcb2-aec8703c05c2\") " pod="openshift-image-registry/image-registry-74869c78fb-4snkc" Jul 13 14:53:49.539181 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.539155 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e834a3dd-45d7-4375-bcb2-aec8703c05c2-ca-trust-extracted\") pod \"image-registry-74869c78fb-4snkc\" (UID: \"e834a3dd-45d7-4375-bcb2-aec8703c05c2\") " pod="openshift-image-registry/image-registry-74869c78fb-4snkc" Jul 13 14:53:49.541545 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.541511 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e834a3dd-45d7-4375-bcb2-aec8703c05c2-image-registry-private-configuration\") pod \"image-registry-74869c78fb-4snkc\" (UID: \"e834a3dd-45d7-4375-bcb2-aec8703c05c2\") " pod="openshift-image-registry/image-registry-74869c78fb-4snkc" Jul 13 14:53:49.541645 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.541553 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6f7d3e1-80fb-4fb2-af95-146709ef0532-metrics-tls\") pod \"dns-default-l9jkc\" (UID: \"e6f7d3e1-80fb-4fb2-af95-146709ef0532\") " pod="openshift-dns/dns-default-l9jkc" Jul 13 14:53:49.541645 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.541560 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2127b3c-d4ef-48e7-887a-12892501daaf-cert\") pod \"ingress-canary-gx4xs\" (UID: \"c2127b3c-d4ef-48e7-887a-12892501daaf\") " pod="openshift-ingress-canary/ingress-canary-gx4xs" Jul 13 14:53:49.541645 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.541568 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e834a3dd-45d7-4375-bcb2-aec8703c05c2-installation-pull-secrets\") pod \"image-registry-74869c78fb-4snkc\" (UID: \"e834a3dd-45d7-4375-bcb2-aec8703c05c2\") " pod="openshift-image-registry/image-registry-74869c78fb-4snkc" Jul 13 14:53:49.541645 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.541627 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e834a3dd-45d7-4375-bcb2-aec8703c05c2-registry-tls\") pod \"image-registry-74869c78fb-4snkc\" (UID: \"e834a3dd-45d7-4375-bcb2-aec8703c05c2\") " pod="openshift-image-registry/image-registry-74869c78fb-4snkc" Jul 13 14:53:49.551052 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.551034 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpqfm\" (UniqueName: \"kubernetes.io/projected/e6f7d3e1-80fb-4fb2-af95-146709ef0532-kube-api-access-dpqfm\") pod \"dns-default-l9jkc\" (UID: \"e6f7d3e1-80fb-4fb2-af95-146709ef0532\") " pod="openshift-dns/dns-default-l9jkc" Jul 13 14:53:49.560073 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.560050 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgld4\" (UniqueName: \"kubernetes.io/projected/c2127b3c-d4ef-48e7-887a-12892501daaf-kube-api-access-vgld4\") pod \"ingress-canary-gx4xs\" (UID: \"c2127b3c-d4ef-48e7-887a-12892501daaf\") " pod="openshift-ingress-canary/ingress-canary-gx4xs" Jul 13 14:53:49.564425 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.564397 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e834a3dd-45d7-4375-bcb2-aec8703c05c2-bound-sa-token\") pod \"image-registry-74869c78fb-4snkc\" (UID: \"e834a3dd-45d7-4375-bcb2-aec8703c05c2\") " pod="openshift-image-registry/image-registry-74869c78fb-4snkc" Jul 13 14:53:49.573379 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.573357 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kqjs\" (UniqueName: \"kubernetes.io/projected/e834a3dd-45d7-4375-bcb2-aec8703c05c2-kube-api-access-6kqjs\") pod \"image-registry-74869c78fb-4snkc\" (UID: \"e834a3dd-45d7-4375-bcb2-aec8703c05c2\") " pod="openshift-image-registry/image-registry-74869c78fb-4snkc" Jul 13 14:53:49.639034 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.638987 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e90d2eb-57e0-4e48-8167-aa16764b612a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pxbb4\" (UID: \"1e90d2eb-57e0-4e48-8167-aa16764b612a\") " pod="openshift-insights/insights-runtime-extractor-pxbb4" Jul 13 14:53:49.639201 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.639059 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e90d2eb-57e0-4e48-8167-aa16764b612a-data-volume\") pod \"insights-runtime-extractor-pxbb4\" (UID: \"1e90d2eb-57e0-4e48-8167-aa16764b612a\") " pod="openshift-insights/insights-runtime-extractor-pxbb4" Jul 13 14:53:49.639201 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.639102 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khtgx\" (UniqueName: \"kubernetes.io/projected/1e90d2eb-57e0-4e48-8167-aa16764b612a-kube-api-access-khtgx\") pod \"insights-runtime-extractor-pxbb4\" (UID: \"1e90d2eb-57e0-4e48-8167-aa16764b612a\") " pod="openshift-insights/insights-runtime-extractor-pxbb4" Jul 13 14:53:49.639201 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.639128 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e90d2eb-57e0-4e48-8167-aa16764b612a-crio-socket\") pod \"insights-runtime-extractor-pxbb4\" (UID: \"1e90d2eb-57e0-4e48-8167-aa16764b612a\") " pod="openshift-insights/insights-runtime-extractor-pxbb4" Jul 13 14:53:49.639347 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.639243 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e90d2eb-57e0-4e48-8167-aa16764b612a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pxbb4\" (UID: \"1e90d2eb-57e0-4e48-8167-aa16764b612a\") " pod="openshift-insights/insights-runtime-extractor-pxbb4" Jul 13 14:53:49.639347 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.639293 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e90d2eb-57e0-4e48-8167-aa16764b612a-crio-socket\") pod \"insights-runtime-extractor-pxbb4\" (UID: \"1e90d2eb-57e0-4e48-8167-aa16764b612a\") " pod="openshift-insights/insights-runtime-extractor-pxbb4" Jul 13 14:53:49.639501 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.639481 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e90d2eb-57e0-4e48-8167-aa16764b612a-data-volume\") pod \"insights-runtime-extractor-pxbb4\" (UID: \"1e90d2eb-57e0-4e48-8167-aa16764b612a\") " pod="openshift-insights/insights-runtime-extractor-pxbb4" Jul 13 14:53:49.639725 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.639707 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e90d2eb-57e0-4e48-8167-aa16764b612a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pxbb4\" (UID: \"1e90d2eb-57e0-4e48-8167-aa16764b612a\") " pod="openshift-insights/insights-runtime-extractor-pxbb4" Jul 13 14:53:49.641195 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.641176 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e90d2eb-57e0-4e48-8167-aa16764b612a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pxbb4\" (UID: \"1e90d2eb-57e0-4e48-8167-aa16764b612a\") " pod="openshift-insights/insights-runtime-extractor-pxbb4" Jul 13 14:53:49.649264 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.649237 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khtgx\" (UniqueName: \"kubernetes.io/projected/1e90d2eb-57e0-4e48-8167-aa16764b612a-kube-api-access-khtgx\") pod \"insights-runtime-extractor-pxbb4\" (UID: \"1e90d2eb-57e0-4e48-8167-aa16764b612a\") " pod="openshift-insights/insights-runtime-extractor-pxbb4" Jul 13 14:53:49.668565 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.668541 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74869c78fb-4snkc" Jul 13 14:53:49.687388 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.687361 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l9jkc" Jul 13 14:53:49.693786 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.693750 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gx4xs" Jul 13 14:53:49.804391 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.804316 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pxbb4" Jul 13 14:53:49.859260 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.856958 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l9jkc"] Jul 13 14:53:49.861256 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.861128 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74869c78fb-4snkc"] Jul 13 14:53:49.885105 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:53:49.885063 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2127b3c_d4ef_48e7_887a_12892501daaf.slice/crio-ebe1a754319f8f75b4a16ba584bc9b2f044411aeeb0d7b1be418caac3feb66ae WatchSource:0}: Error finding container ebe1a754319f8f75b4a16ba584bc9b2f044411aeeb0d7b1be418caac3feb66ae: Status 404 returned error can't find the container with id ebe1a754319f8f75b4a16ba584bc9b2f044411aeeb0d7b1be418caac3feb66ae Jul 13 14:53:49.889797 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.889755 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gx4xs"] Jul 13 14:53:49.984213 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:49.984184 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pxbb4"] Jul 13 14:53:49.989298 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:53:49.989274 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e90d2eb_57e0_4e48_8167_aa16764b612a.slice/crio-10c790303b26c9b8ef39c69d504771f4b65cde9a57b1bcb6bccbbcc9a3fe54db WatchSource:0}: Error finding container 10c790303b26c9b8ef39c69d504771f4b65cde9a57b1bcb6bccbbcc9a3fe54db: Status 404 returned error can't find the container with id 10c790303b26c9b8ef39c69d504771f4b65cde9a57b1bcb6bccbbcc9a3fe54db Jul 13 14:53:50.610846 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:50.610811 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74869c78fb-4snkc" event={"ID":"e834a3dd-45d7-4375-bcb2-aec8703c05c2","Type":"ContainerStarted","Data":"cf6e776d8da097e157e5115b8e038e70ea574b99caacb8737f22ce67ab9efda7"} Jul 13 14:53:50.611278 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:50.610876 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74869c78fb-4snkc" event={"ID":"e834a3dd-45d7-4375-bcb2-aec8703c05c2","Type":"ContainerStarted","Data":"c49ae8f3702aaa7f184347198550a25c68f74ba64c6864127d5301bd8aa1ce2f"} Jul 13 14:53:50.611278 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:50.610920 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74869c78fb-4snkc" Jul 13 14:53:50.612541 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:50.612469 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l9jkc" event={"ID":"e6f7d3e1-80fb-4fb2-af95-146709ef0532","Type":"ContainerStarted","Data":"7ae13cdf50dcb164b5f44b26e5287aff3ed6e177261f40bdd81ead1efb213c1e"} Jul 13 14:53:50.613720 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:50.613693 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pxbb4" event={"ID":"1e90d2eb-57e0-4e48-8167-aa16764b612a","Type":"ContainerStarted","Data":"10c790303b26c9b8ef39c69d504771f4b65cde9a57b1bcb6bccbbcc9a3fe54db"} Jul 13 14:53:50.615679 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:50.615654 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gx4xs" event={"ID":"c2127b3c-d4ef-48e7-887a-12892501daaf","Type":"ContainerStarted","Data":"ebe1a754319f8f75b4a16ba584bc9b2f044411aeeb0d7b1be418caac3feb66ae"} Jul 13 14:53:50.646578 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:50.646460 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74869c78fb-4snkc" podStartSLOduration=6.646437049 podStartE2EDuration="6.646437049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:53:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:53:50.642270668 +0000 UTC m=+54.708843138" watchObservedRunningTime="2026-07-13 14:53:50.646437049 +0000 UTC m=+54.713009514" Jul 13 14:53:56.634304 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:56.634268 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l9jkc" event={"ID":"e6f7d3e1-80fb-4fb2-af95-146709ef0532","Type":"ContainerStarted","Data":"0df790472a071f935eeddd95b5c6cb9b209717f100c62619a425c62f44455e3b"} Jul 13 14:53:56.634729 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:56.634352 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l9jkc" event={"ID":"e6f7d3e1-80fb-4fb2-af95-146709ef0532","Type":"ContainerStarted","Data":"79990d48a9d5c690974d333ef67eefeffb050fd2f94f60b5d8df3d719b51e4d7"} Jul 13 14:53:56.634729 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:56.634396 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l9jkc" Jul 13 14:53:56.635706 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:56.635686 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pxbb4" event={"ID":"1e90d2eb-57e0-4e48-8167-aa16764b612a","Type":"ContainerStarted","Data":"9d9394cf183d905f3f7fc3b3a3311afc0012b8055fafd5e5ea021d3e53e2b103"} Jul 13 14:53:56.636885 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:56.636856 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gx4xs" event={"ID":"c2127b3c-d4ef-48e7-887a-12892501daaf","Type":"ContainerStarted","Data":"3a43af9dd24e58030437a0f25db0ebd43fa02aa852190047e1a0a97c35f12de3"} Jul 13 14:53:56.668845 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:56.668738 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gx4xs" podStartSLOduration=1.863120796 podStartE2EDuration="7.668718473s" totalImagesPullingTime="5.805597677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:53:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:53:56.668472262 +0000 UTC m=+60.735044728" watchObservedRunningTime="2026-07-13 14:53:56.668718473 +0000 UTC m=+60.735290938" Jul 13 14:53:56.669152 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:56.669125 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-l9jkc" podStartSLOduration=1.85069868 podStartE2EDuration="7.669115304s" totalImagesPullingTime="5.818416624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:53:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:53:56.652129442 +0000 UTC m=+60.718701907" watchObservedRunningTime="2026-07-13 14:53:56.669115304 +0000 UTC m=+60.735687770" Jul 13 14:53:57.642123 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:53:57.642025 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pxbb4" event={"ID":"1e90d2eb-57e0-4e48-8167-aa16764b612a","Type":"ContainerStarted","Data":"4e6e19c000ee730e894769e974d43717beb0dbd4c413c983fc84e6948324c4e1"} Jul 13 14:54:01.299077 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.299044 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tqltd"] Jul 13 14:54:01.316021 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.316000 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:01.319071 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.319049 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 13 14:54:01.319177 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.319132 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 13 14:54:01.319269 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.319228 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 13 14:54:01.320792 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.320758 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 13 14:54:01.320892 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.320804 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 13 14:54:01.320978 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.320941 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q98rp\"" Jul 13 14:54:01.323478 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.321225 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 13 14:54:01.329470 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.329447 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4113ffd-a496-4d76-9f75-942100b26c23-original-pull-secret\") pod \"global-pull-secret-syncer-vrbdc\" (UID: \"b4113ffd-a496-4d76-9f75-942100b26c23\") " pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:54:01.329565 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.329485 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40866c5d-2992-4d53-b839-e3dc5740b96d-metrics-certs\") pod \"network-metrics-daemon-8gcng\" (UID: \"40866c5d-2992-4d53-b839-e3dc5740b96d\") " pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:54:01.336357 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.336342 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 14:54:01.336608 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.336596 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 14:54:01.341851 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.341831 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40866c5d-2992-4d53-b839-e3dc5740b96d-metrics-certs\") pod \"network-metrics-daemon-8gcng\" (UID: \"40866c5d-2992-4d53-b839-e3dc5740b96d\") " pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:54:01.341851 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.341844 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4113ffd-a496-4d76-9f75-942100b26c23-original-pull-secret\") pod \"global-pull-secret-syncer-vrbdc\" (UID: \"b4113ffd-a496-4d76-9f75-942100b26c23\") " pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:54:01.356402 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.356384 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bz4r7\"" Jul 13 14:54:01.360983 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.360965 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gcng" Jul 13 14:54:01.364205 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.364189 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrbdc" Jul 13 14:54:01.430543 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.430502 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d02cc62c-036b-4674-acc7-798bfe7d4127-metrics-client-ca\") pod \"node-exporter-tqltd\" (UID: \"d02cc62c-036b-4674-acc7-798bfe7d4127\") " pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:01.430691 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.430550 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d02cc62c-036b-4674-acc7-798bfe7d4127-sys\") pod \"node-exporter-tqltd\" (UID: \"d02cc62c-036b-4674-acc7-798bfe7d4127\") " pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:01.430691 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.430585 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvqwn\" (UniqueName: \"kubernetes.io/projected/d02cc62c-036b-4674-acc7-798bfe7d4127-kube-api-access-hvqwn\") pod \"node-exporter-tqltd\" (UID: \"d02cc62c-036b-4674-acc7-798bfe7d4127\") " pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:01.430691 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.430615 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d02cc62c-036b-4674-acc7-798bfe7d4127-root\") pod \"node-exporter-tqltd\" (UID: \"d02cc62c-036b-4674-acc7-798bfe7d4127\") " pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:01.430691 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.430638 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d02cc62c-036b-4674-acc7-798bfe7d4127-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tqltd\" (UID: \"d02cc62c-036b-4674-acc7-798bfe7d4127\") " pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:01.430939 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.430692 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b9zw\" (UniqueName: \"kubernetes.io/projected/ecfa98f6-7abe-43a4-956d-b613d7e1d854-kube-api-access-9b9zw\") pod \"network-check-target-gvdvc\" (UID: \"ecfa98f6-7abe-43a4-956d-b613d7e1d854\") " pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:54:01.430939 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.430722 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d02cc62c-036b-4674-acc7-798bfe7d4127-node-exporter-accelerators-collector-config\") pod \"node-exporter-tqltd\" (UID: \"d02cc62c-036b-4674-acc7-798bfe7d4127\") " pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:01.430939 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.430754 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d02cc62c-036b-4674-acc7-798bfe7d4127-node-exporter-wtmp\") pod \"node-exporter-tqltd\" (UID: \"d02cc62c-036b-4674-acc7-798bfe7d4127\") " pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:01.430939 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.430866 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d02cc62c-036b-4674-acc7-798bfe7d4127-node-exporter-tls\") pod \"node-exporter-tqltd\" (UID: \"d02cc62c-036b-4674-acc7-798bfe7d4127\") " pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:01.430939 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.430895 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d02cc62c-036b-4674-acc7-798bfe7d4127-node-exporter-textfile\") pod \"node-exporter-tqltd\" (UID: \"d02cc62c-036b-4674-acc7-798bfe7d4127\") " pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:01.434770 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.434741 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 14:54:01.444195 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.443981 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 14:54:01.455854 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.455827 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b9zw\" (UniqueName: \"kubernetes.io/projected/ecfa98f6-7abe-43a4-956d-b613d7e1d854-kube-api-access-9b9zw\") pod \"network-check-target-gvdvc\" (UID: \"ecfa98f6-7abe-43a4-956d-b613d7e1d854\") " pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:54:01.509431 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.509401 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8gcng"] Jul 13 14:54:01.512906 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:54:01.512878 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40866c5d_2992_4d53_b839_e3dc5740b96d.slice/crio-d5f6d47008434f249adfacb616c2660a6284164d1df5168f513785c37bda6469 WatchSource:0}: Error finding container d5f6d47008434f249adfacb616c2660a6284164d1df5168f513785c37bda6469: Status 404 returned error can't find the container with id d5f6d47008434f249adfacb616c2660a6284164d1df5168f513785c37bda6469 Jul 13 14:54:01.525846 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.525747 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vrbdc"] Jul 13 14:54:01.527682 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:54:01.527659 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4113ffd_a496_4d76_9f75_942100b26c23.slice/crio-4d542c41c89b54e05cac4676937fa4f3489c93f801b7f1b907c2d57d65af682e WatchSource:0}: Error finding container 4d542c41c89b54e05cac4676937fa4f3489c93f801b7f1b907c2d57d65af682e: Status 404 returned error can't find the container with id 4d542c41c89b54e05cac4676937fa4f3489c93f801b7f1b907c2d57d65af682e Jul 13 14:54:01.531945 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.531925 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d02cc62c-036b-4674-acc7-798bfe7d4127-node-exporter-tls\") pod \"node-exporter-tqltd\" (UID: \"d02cc62c-036b-4674-acc7-798bfe7d4127\") " pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:01.532011 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.531954 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d02cc62c-036b-4674-acc7-798bfe7d4127-node-exporter-textfile\") pod \"node-exporter-tqltd\" (UID: \"d02cc62c-036b-4674-acc7-798bfe7d4127\") " pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:01.532011 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.531987 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d02cc62c-036b-4674-acc7-798bfe7d4127-metrics-client-ca\") pod \"node-exporter-tqltd\" (UID: \"d02cc62c-036b-4674-acc7-798bfe7d4127\") " pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:01.532147 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.532015 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d02cc62c-036b-4674-acc7-798bfe7d4127-sys\") pod \"node-exporter-tqltd\" (UID: \"d02cc62c-036b-4674-acc7-798bfe7d4127\") " pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:01.532147 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.532050 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvqwn\" (UniqueName: \"kubernetes.io/projected/d02cc62c-036b-4674-acc7-798bfe7d4127-kube-api-access-hvqwn\") pod \"node-exporter-tqltd\" (UID: \"d02cc62c-036b-4674-acc7-798bfe7d4127\") " pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:01.532147 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:54:01.532063 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 13 14:54:01.532147 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.532074 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d02cc62c-036b-4674-acc7-798bfe7d4127-root\") pod \"node-exporter-tqltd\" (UID: \"d02cc62c-036b-4674-acc7-798bfe7d4127\") " pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:01.532147 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.532097 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d02cc62c-036b-4674-acc7-798bfe7d4127-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tqltd\" (UID: \"d02cc62c-036b-4674-acc7-798bfe7d4127\") " pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:01.532147 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:54:01.532127 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d02cc62c-036b-4674-acc7-798bfe7d4127-node-exporter-tls podName:d02cc62c-036b-4674-acc7-798bfe7d4127 nodeName:}" failed. No retries permitted until 2026-07-13 14:54:02.032106637 +0000 UTC m=+66.098679082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d02cc62c-036b-4674-acc7-798bfe7d4127-node-exporter-tls") pod "node-exporter-tqltd" (UID: "d02cc62c-036b-4674-acc7-798bfe7d4127") : secret "node-exporter-tls" not found Jul 13 14:54:01.532147 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.532139 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d02cc62c-036b-4674-acc7-798bfe7d4127-root\") pod \"node-exporter-tqltd\" (UID: \"d02cc62c-036b-4674-acc7-798bfe7d4127\") " pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:01.532456 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.532149 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d02cc62c-036b-4674-acc7-798bfe7d4127-sys\") pod \"node-exporter-tqltd\" (UID: \"d02cc62c-036b-4674-acc7-798bfe7d4127\") " pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:01.532456 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.532215 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d02cc62c-036b-4674-acc7-798bfe7d4127-node-exporter-accelerators-collector-config\") pod \"node-exporter-tqltd\" (UID: \"d02cc62c-036b-4674-acc7-798bfe7d4127\") " pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:01.532456 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.532257 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d02cc62c-036b-4674-acc7-798bfe7d4127-node-exporter-wtmp\") pod \"node-exporter-tqltd\" (UID: \"d02cc62c-036b-4674-acc7-798bfe7d4127\") " pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:01.532456 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.532286 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d02cc62c-036b-4674-acc7-798bfe7d4127-node-exporter-textfile\") pod \"node-exporter-tqltd\" (UID: \"d02cc62c-036b-4674-acc7-798bfe7d4127\") " pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:01.532597 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.532467 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d02cc62c-036b-4674-acc7-798bfe7d4127-node-exporter-wtmp\") pod \"node-exporter-tqltd\" (UID: \"d02cc62c-036b-4674-acc7-798bfe7d4127\") " pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:01.532597 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.532572 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d02cc62c-036b-4674-acc7-798bfe7d4127-metrics-client-ca\") pod \"node-exporter-tqltd\" (UID: \"d02cc62c-036b-4674-acc7-798bfe7d4127\") " pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:01.532665 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.532639 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d02cc62c-036b-4674-acc7-798bfe7d4127-node-exporter-accelerators-collector-config\") pod \"node-exporter-tqltd\" (UID: \"d02cc62c-036b-4674-acc7-798bfe7d4127\") " pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:01.534184 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.534166 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d02cc62c-036b-4674-acc7-798bfe7d4127-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tqltd\" (UID: \"d02cc62c-036b-4674-acc7-798bfe7d4127\") " pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:01.546046 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.546028 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvqwn\" (UniqueName: \"kubernetes.io/projected/d02cc62c-036b-4674-acc7-798bfe7d4127-kube-api-access-hvqwn\") pod \"node-exporter-tqltd\" (UID: \"d02cc62c-036b-4674-acc7-798bfe7d4127\") " pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:01.657024 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.656999 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pxbb4" event={"ID":"1e90d2eb-57e0-4e48-8167-aa16764b612a","Type":"ContainerStarted","Data":"9c6064b0b4ad9110deb44cc448570d7e67b137c381a4ced47a12dff931133a18"} Jul 13 14:54:01.658216 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.658195 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8gcng" event={"ID":"40866c5d-2992-4d53-b839-e3dc5740b96d","Type":"ContainerStarted","Data":"d5f6d47008434f249adfacb616c2660a6284164d1df5168f513785c37bda6469"} Jul 13 14:54:01.659241 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.659223 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vrbdc" event={"ID":"b4113ffd-a496-4d76-9f75-942100b26c23","Type":"ContainerStarted","Data":"4d542c41c89b54e05cac4676937fa4f3489c93f801b7f1b907c2d57d65af682e"} Jul 13 14:54:01.659496 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.659481 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hw4cv\"" Jul 13 14:54:01.667259 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.667243 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:54:01.678816 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.678762 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pxbb4" podStartSLOduration=1.594859402 podStartE2EDuration="12.678749961s" totalImagesPullingTime="11.083890559s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:53:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:54:01.678322909 +0000 UTC m=+65.744895410" watchObservedRunningTime="2026-07-13 14:54:01.678749961 +0000 UTC m=+65.745322461" Jul 13 14:54:01.821967 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:01.821895 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gvdvc"] Jul 13 14:54:01.824455 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:54:01.824432 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecfa98f6_7abe_43a4_956d_b613d7e1d854.slice/crio-bb4fac5fead2aae90768b255b9423f6a0c84234a85ddfcbfc915691082736195 WatchSource:0}: Error finding container bb4fac5fead2aae90768b255b9423f6a0c84234a85ddfcbfc915691082736195: Status 404 returned error can't find the container with id bb4fac5fead2aae90768b255b9423f6a0c84234a85ddfcbfc915691082736195 Jul 13 14:54:02.036249 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.036212 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d02cc62c-036b-4674-acc7-798bfe7d4127-node-exporter-tls\") pod \"node-exporter-tqltd\" (UID: \"d02cc62c-036b-4674-acc7-798bfe7d4127\") " pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:02.039129 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.039100 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d02cc62c-036b-4674-acc7-798bfe7d4127-node-exporter-tls\") pod \"node-exporter-tqltd\" (UID: \"d02cc62c-036b-4674-acc7-798bfe7d4127\") " pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:02.250953 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.250921 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tqltd" Jul 13 14:54:02.272459 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:54:02.272428 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd02cc62c_036b_4674_acc7_798bfe7d4127.slice/crio-5db8a6bc5a8357b6dfc132280e07b4bda8d392e7ee7f77d688db8c815a81fa0a WatchSource:0}: Error finding container 5db8a6bc5a8357b6dfc132280e07b4bda8d392e7ee7f77d688db8c815a81fa0a: Status 404 returned error can't find the container with id 5db8a6bc5a8357b6dfc132280e07b4bda8d392e7ee7f77d688db8c815a81fa0a Jul 13 14:54:02.322885 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.322818 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 14:54:02.336403 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.336380 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.339176 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.339103 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 13 14:54:02.339176 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.339127 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 13 14:54:02.339357 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.339291 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 13 14:54:02.339412 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.339356 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 13 14:54:02.339908 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.339874 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 13 14:54:02.340636 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.340598 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 13 14:54:02.340759 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.340732 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 13 14:54:02.341474 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.341056 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 13 14:54:02.341474 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.341175 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jrfsv\"" Jul 13 14:54:02.341474 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.341310 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 13 14:54:02.352293 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.352270 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 14:54:02.439562 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.439521 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-web-config\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.439720 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.439569 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8874e6f6-1107-463c-9c0b-296d87f076d0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.439720 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.439591 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8874e6f6-1107-463c-9c0b-296d87f076d0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.439720 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.439678 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8874e6f6-1107-463c-9c0b-296d87f076d0-config-out\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.439720 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.439713 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.439968 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.439741 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.439968 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.439768 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7pmn\" (UniqueName: \"kubernetes.io/projected/8874e6f6-1107-463c-9c0b-296d87f076d0-kube-api-access-w7pmn\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.439968 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.439815 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.439968 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.439854 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8874e6f6-1107-463c-9c0b-296d87f076d0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.439968 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.439884 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.439968 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.439924 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.440322 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.439973 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-config-volume\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.440322 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.440023 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8874e6f6-1107-463c-9c0b-296d87f076d0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.541318 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.541228 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-web-config\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.541318 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.541289 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8874e6f6-1107-463c-9c0b-296d87f076d0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.541539 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.541333 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8874e6f6-1107-463c-9c0b-296d87f076d0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.541539 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.541367 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8874e6f6-1107-463c-9c0b-296d87f076d0-config-out\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.541539 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.541393 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.541539 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.541420 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.541539 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.541444 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7pmn\" (UniqueName: \"kubernetes.io/projected/8874e6f6-1107-463c-9c0b-296d87f076d0-kube-api-access-w7pmn\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.541539 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.541473 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.541539 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.541508 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8874e6f6-1107-463c-9c0b-296d87f076d0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.541539 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.541538 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.542040 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.541561 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.542040 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.541584 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-config-volume\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.542040 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.541611 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8874e6f6-1107-463c-9c0b-296d87f076d0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.542194 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.542052 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8874e6f6-1107-463c-9c0b-296d87f076d0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.542851 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:54:02.542741 2577 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 13 14:54:02.542851 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:54:02.542828 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-secret-alertmanager-main-tls podName:8874e6f6-1107-463c-9c0b-296d87f076d0 nodeName:}" failed. No retries permitted until 2026-07-13 14:54:03.042806603 +0000 UTC m=+67.109379061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "8874e6f6-1107-463c-9c0b-296d87f076d0") : secret "alertmanager-main-tls" not found Jul 13 14:54:02.543864 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:54:02.543146 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8874e6f6-1107-463c-9c0b-296d87f076d0-alertmanager-trusted-ca-bundle podName:8874e6f6-1107-463c-9c0b-296d87f076d0 nodeName:}" failed. No retries permitted until 2026-07-13 14:54:03.043127102 +0000 UTC m=+67.109699547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/8874e6f6-1107-463c-9c0b-296d87f076d0-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "8874e6f6-1107-463c-9c0b-296d87f076d0") : configmap references non-existent config key: ca-bundle.crt Jul 13 14:54:02.543864 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.543809 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8874e6f6-1107-463c-9c0b-296d87f076d0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.547170 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.547111 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-config-volume\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.547540 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.547514 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-web-config\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.548624 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.548547 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.548624 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.548586 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8874e6f6-1107-463c-9c0b-296d87f076d0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.549458 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.549032 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.549458 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.549421 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.549458 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.549439 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.551294 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.551269 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8874e6f6-1107-463c-9c0b-296d87f076d0-config-out\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.552536 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.552517 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7pmn\" (UniqueName: \"kubernetes.io/projected/8874e6f6-1107-463c-9c0b-296d87f076d0-kube-api-access-w7pmn\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:02.665487 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.665438 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gvdvc" event={"ID":"ecfa98f6-7abe-43a4-956d-b613d7e1d854","Type":"ContainerStarted","Data":"bb4fac5fead2aae90768b255b9423f6a0c84234a85ddfcbfc915691082736195"} Jul 13 14:54:02.666904 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:02.666867 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tqltd" event={"ID":"d02cc62c-036b-4674-acc7-798bfe7d4127","Type":"ContainerStarted","Data":"5db8a6bc5a8357b6dfc132280e07b4bda8d392e7ee7f77d688db8c815a81fa0a"} Jul 13 14:54:03.045428 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:03.045395 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8874e6f6-1107-463c-9c0b-296d87f076d0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:03.045551 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:03.045455 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:03.046566 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:03.046517 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8874e6f6-1107-463c-9c0b-296d87f076d0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:03.049236 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:03.049209 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:03.249729 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:03.249679 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:54:03.462308 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:03.462116 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 14:54:03.465481 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:54:03.465439 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8874e6f6_1107_463c_9c0b_296d87f076d0.slice/crio-7633c220f8e0334789935d772d00a2e39ff1cd043d0e48e347990cb52562dc85 WatchSource:0}: Error finding container 7633c220f8e0334789935d772d00a2e39ff1cd043d0e48e347990cb52562dc85: Status 404 returned error can't find the container with id 7633c220f8e0334789935d772d00a2e39ff1cd043d0e48e347990cb52562dc85 Jul 13 14:54:03.595367 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:03.595296 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hq8bg" Jul 13 14:54:03.674550 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:03.674441 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8gcng" event={"ID":"40866c5d-2992-4d53-b839-e3dc5740b96d","Type":"ContainerStarted","Data":"21f96003a83ad6cfb9073944896e606c3c03dc1df55b11eb1da431af8dae9d7e"} Jul 13 14:54:03.674550 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:03.674511 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8gcng" event={"ID":"40866c5d-2992-4d53-b839-e3dc5740b96d","Type":"ContainerStarted","Data":"d6f7575516318de769a1c8412b57261ee3fc7e6f13fc7d464edc638cd467aa2c"} Jul 13 14:54:03.676196 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:03.676167 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8874e6f6-1107-463c-9c0b-296d87f076d0","Type":"ContainerStarted","Data":"7633c220f8e0334789935d772d00a2e39ff1cd043d0e48e347990cb52562dc85"} Jul 13 14:54:04.682056 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:04.682018 2577 generic.go:356] "Generic (PLEG): container finished" podID="d02cc62c-036b-4674-acc7-798bfe7d4127" containerID="99d621262929d4b097251560f26ff9a4039255a7a3d311628b4fb4ac1f7e88dd" exitCode=0 Jul 13 14:54:04.682522 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:04.682113 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tqltd" event={"ID":"d02cc62c-036b-4674-acc7-798bfe7d4127","Type":"ContainerDied","Data":"99d621262929d4b097251560f26ff9a4039255a7a3d311628b4fb4ac1f7e88dd"} Jul 13 14:54:04.704492 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:04.704447 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8gcng" podStartSLOduration=66.214645208 podStartE2EDuration="1m7.7044316s" totalImagesPullingTime="1.489786392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:54:03.695548917 +0000 UTC m=+67.762121384" watchObservedRunningTime="2026-07-13 14:54:04.7044316 +0000 UTC m=+68.771004067" Jul 13 14:54:05.694894 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:05.694859 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-78c6d67dcf-2pml8"] Jul 13 14:54:05.697290 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:05.697265 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:05.720332 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:54:05.720297 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kubelet-serving-ca-bundle\" is forbidden: User \"system:node:ip-10-0-134-237.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-134-237.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" type="*v1.ConfigMap" Jul 13 14:54:05.721394 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:54:05.721364 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"metrics-server-8bu1mb3lojteh\" is forbidden: User \"system:node:ip-10-0-134-237.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-134-237.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"metrics-server-8bu1mb3lojteh\"" type="*v1.Secret" Jul 13 14:54:05.721394 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:54:05.721363 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"metrics-server-78c6d67dcf-2pml8\" is forbidden: User \"system:node:ip-10-0-134-237.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-134-237.ec2.internal' and this object" podUID="e0df991d-b78f-4144-85c7-9f7f9a9edc55" pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:05.721394 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:54:05.721366 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"metrics-server-audit-profiles\" is forbidden: User \"system:node:ip-10-0-134-237.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-134-237.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" type="*v1.ConfigMap" Jul 13 14:54:05.721604 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:54:05.721386 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"metrics-server-dockercfg-nz2wf\" is forbidden: User \"system:node:ip-10-0-134-237.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-134-237.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-nz2wf\"" type="*v1.Secret" Jul 13 14:54:05.721604 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:54:05.721398 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"metrics-server-client-certs\" is forbidden: User \"system:node:ip-10-0-134-237.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-134-237.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" type="*v1.Secret" Jul 13 14:54:05.724996 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:54:05.724967 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"metrics-server-tls\" is forbidden: User \"system:node:ip-10-0-134-237.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-134-237.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" type="*v1.Secret" Jul 13 14:54:05.734338 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:05.734314 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78c6d67dcf-2pml8"] Jul 13 14:54:05.766230 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:05.766211 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs5dh\" (UniqueName: \"kubernetes.io/projected/e0df991d-b78f-4144-85c7-9f7f9a9edc55-kube-api-access-gs5dh\") pod \"metrics-server-78c6d67dcf-2pml8\" (UID: \"e0df991d-b78f-4144-85c7-9f7f9a9edc55\") " pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:05.766343 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:05.766259 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e0df991d-b78f-4144-85c7-9f7f9a9edc55-metrics-server-audit-profiles\") pod \"metrics-server-78c6d67dcf-2pml8\" (UID: \"e0df991d-b78f-4144-85c7-9f7f9a9edc55\") " pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:05.766343 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:05.766294 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e0df991d-b78f-4144-85c7-9f7f9a9edc55-secret-metrics-server-tls\") pod \"metrics-server-78c6d67dcf-2pml8\" (UID: \"e0df991d-b78f-4144-85c7-9f7f9a9edc55\") " pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:05.766343 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:05.766321 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e0df991d-b78f-4144-85c7-9f7f9a9edc55-audit-log\") pod \"metrics-server-78c6d67dcf-2pml8\" (UID: \"e0df991d-b78f-4144-85c7-9f7f9a9edc55\") " pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:05.766465 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:05.766346 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0df991d-b78f-4144-85c7-9f7f9a9edc55-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78c6d67dcf-2pml8\" (UID: \"e0df991d-b78f-4144-85c7-9f7f9a9edc55\") " pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:05.766465 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:05.766366 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0df991d-b78f-4144-85c7-9f7f9a9edc55-client-ca-bundle\") pod \"metrics-server-78c6d67dcf-2pml8\" (UID: \"e0df991d-b78f-4144-85c7-9f7f9a9edc55\") " pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:05.766465 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:05.766390 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e0df991d-b78f-4144-85c7-9f7f9a9edc55-secret-metrics-server-client-certs\") pod \"metrics-server-78c6d67dcf-2pml8\" (UID: \"e0df991d-b78f-4144-85c7-9f7f9a9edc55\") " pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:05.867382 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:05.867335 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs5dh\" (UniqueName: \"kubernetes.io/projected/e0df991d-b78f-4144-85c7-9f7f9a9edc55-kube-api-access-gs5dh\") pod \"metrics-server-78c6d67dcf-2pml8\" (UID: \"e0df991d-b78f-4144-85c7-9f7f9a9edc55\") " pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:05.867584 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:05.867403 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e0df991d-b78f-4144-85c7-9f7f9a9edc55-metrics-server-audit-profiles\") pod \"metrics-server-78c6d67dcf-2pml8\" (UID: \"e0df991d-b78f-4144-85c7-9f7f9a9edc55\") " pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:05.867584 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:05.867434 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e0df991d-b78f-4144-85c7-9f7f9a9edc55-secret-metrics-server-tls\") pod \"metrics-server-78c6d67dcf-2pml8\" (UID: \"e0df991d-b78f-4144-85c7-9f7f9a9edc55\") " pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:05.867584 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:05.867458 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e0df991d-b78f-4144-85c7-9f7f9a9edc55-audit-log\") pod \"metrics-server-78c6d67dcf-2pml8\" (UID: \"e0df991d-b78f-4144-85c7-9f7f9a9edc55\") " pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:05.867584 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:05.867488 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0df991d-b78f-4144-85c7-9f7f9a9edc55-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78c6d67dcf-2pml8\" (UID: \"e0df991d-b78f-4144-85c7-9f7f9a9edc55\") " pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:05.867584 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:05.867513 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0df991d-b78f-4144-85c7-9f7f9a9edc55-client-ca-bundle\") pod \"metrics-server-78c6d67dcf-2pml8\" (UID: \"e0df991d-b78f-4144-85c7-9f7f9a9edc55\") " pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:05.867584 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:05.867542 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e0df991d-b78f-4144-85c7-9f7f9a9edc55-secret-metrics-server-client-certs\") pod \"metrics-server-78c6d67dcf-2pml8\" (UID: \"e0df991d-b78f-4144-85c7-9f7f9a9edc55\") " pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:05.867905 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:05.867883 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e0df991d-b78f-4144-85c7-9f7f9a9edc55-audit-log\") pod \"metrics-server-78c6d67dcf-2pml8\" (UID: \"e0df991d-b78f-4144-85c7-9f7f9a9edc55\") " pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:05.877618 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:05.877586 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs5dh\" (UniqueName: \"kubernetes.io/projected/e0df991d-b78f-4144-85c7-9f7f9a9edc55-kube-api-access-gs5dh\") pod \"metrics-server-78c6d67dcf-2pml8\" (UID: \"e0df991d-b78f-4144-85c7-9f7f9a9edc55\") " pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:06.480242 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.480199 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr"] Jul 13 14:54:06.482930 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.482910 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" Jul 13 14:54:06.486209 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.486182 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 13 14:54:06.486332 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.486230 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 13 14:54:06.486332 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.486297 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 13 14:54:06.486524 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.486476 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 13 14:54:06.486588 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.486544 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 13 14:54:06.486708 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.486689 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-78tmn\"" Jul 13 14:54:06.491493 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.491451 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 13 14:54:06.496487 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.496467 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr"] Jul 13 14:54:06.574791 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.574749 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b6fe734-5aae-408a-a26e-2793e4a7763b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f4bd6b4d-lncbr\" (UID: \"9b6fe734-5aae-408a-a26e-2793e4a7763b\") " pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" Jul 13 14:54:06.574971 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.574804 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b6fe734-5aae-408a-a26e-2793e4a7763b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f4bd6b4d-lncbr\" (UID: \"9b6fe734-5aae-408a-a26e-2793e4a7763b\") " pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" Jul 13 14:54:06.574971 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.574879 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9b6fe734-5aae-408a-a26e-2793e4a7763b-telemeter-client-tls\") pod \"telemeter-client-7f4bd6b4d-lncbr\" (UID: \"9b6fe734-5aae-408a-a26e-2793e4a7763b\") " pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" Jul 13 14:54:06.574971 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.574913 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9b6fe734-5aae-408a-a26e-2793e4a7763b-federate-client-tls\") pod \"telemeter-client-7f4bd6b4d-lncbr\" (UID: \"9b6fe734-5aae-408a-a26e-2793e4a7763b\") " pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" Jul 13 14:54:06.574971 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.574946 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b6fe734-5aae-408a-a26e-2793e4a7763b-metrics-client-ca\") pod \"telemeter-client-7f4bd6b4d-lncbr\" (UID: \"9b6fe734-5aae-408a-a26e-2793e4a7763b\") " pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" Jul 13 14:54:06.575157 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.574987 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9b6fe734-5aae-408a-a26e-2793e4a7763b-secret-telemeter-client\") pod \"telemeter-client-7f4bd6b4d-lncbr\" (UID: \"9b6fe734-5aae-408a-a26e-2793e4a7763b\") " pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" Jul 13 14:54:06.575157 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.575045 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh244\" (UniqueName: \"kubernetes.io/projected/9b6fe734-5aae-408a-a26e-2793e4a7763b-kube-api-access-fh244\") pod \"telemeter-client-7f4bd6b4d-lncbr\" (UID: \"9b6fe734-5aae-408a-a26e-2793e4a7763b\") " pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" Jul 13 14:54:06.575157 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.575063 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b6fe734-5aae-408a-a26e-2793e4a7763b-serving-certs-ca-bundle\") pod \"telemeter-client-7f4bd6b4d-lncbr\" (UID: \"9b6fe734-5aae-408a-a26e-2793e4a7763b\") " pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" Jul 13 14:54:06.598571 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.598550 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 13 14:54:06.611261 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.611234 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e0df991d-b78f-4144-85c7-9f7f9a9edc55-secret-metrics-server-tls\") pod \"metrics-server-78c6d67dcf-2pml8\" (UID: \"e0df991d-b78f-4144-85c7-9f7f9a9edc55\") " pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:06.644622 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.644591 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l9jkc" Jul 13 14:54:06.675979 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.675952 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9b6fe734-5aae-408a-a26e-2793e4a7763b-telemeter-client-tls\") pod \"telemeter-client-7f4bd6b4d-lncbr\" (UID: \"9b6fe734-5aae-408a-a26e-2793e4a7763b\") " pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" Jul 13 14:54:06.676117 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.676000 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9b6fe734-5aae-408a-a26e-2793e4a7763b-federate-client-tls\") pod \"telemeter-client-7f4bd6b4d-lncbr\" (UID: \"9b6fe734-5aae-408a-a26e-2793e4a7763b\") " pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" Jul 13 14:54:06.676175 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.676141 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b6fe734-5aae-408a-a26e-2793e4a7763b-metrics-client-ca\") pod \"telemeter-client-7f4bd6b4d-lncbr\" (UID: \"9b6fe734-5aae-408a-a26e-2793e4a7763b\") " pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" Jul 13 14:54:06.676227 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.676184 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9b6fe734-5aae-408a-a26e-2793e4a7763b-secret-telemeter-client\") pod \"telemeter-client-7f4bd6b4d-lncbr\" (UID: \"9b6fe734-5aae-408a-a26e-2793e4a7763b\") " pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" Jul 13 14:54:06.676278 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.676243 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh244\" (UniqueName: \"kubernetes.io/projected/9b6fe734-5aae-408a-a26e-2793e4a7763b-kube-api-access-fh244\") pod \"telemeter-client-7f4bd6b4d-lncbr\" (UID: \"9b6fe734-5aae-408a-a26e-2793e4a7763b\") " pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" Jul 13 14:54:06.676325 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.676273 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b6fe734-5aae-408a-a26e-2793e4a7763b-serving-certs-ca-bundle\") pod \"telemeter-client-7f4bd6b4d-lncbr\" (UID: \"9b6fe734-5aae-408a-a26e-2793e4a7763b\") " pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" Jul 13 14:54:06.676375 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.676335 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b6fe734-5aae-408a-a26e-2793e4a7763b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f4bd6b4d-lncbr\" (UID: \"9b6fe734-5aae-408a-a26e-2793e4a7763b\") " pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" Jul 13 14:54:06.676375 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.676365 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b6fe734-5aae-408a-a26e-2793e4a7763b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f4bd6b4d-lncbr\" (UID: \"9b6fe734-5aae-408a-a26e-2793e4a7763b\") " pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" Jul 13 14:54:06.677604 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.677538 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b6fe734-5aae-408a-a26e-2793e4a7763b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f4bd6b4d-lncbr\" (UID: \"9b6fe734-5aae-408a-a26e-2793e4a7763b\") " pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" Jul 13 14:54:06.678828 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.678278 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b6fe734-5aae-408a-a26e-2793e4a7763b-metrics-client-ca\") pod \"telemeter-client-7f4bd6b4d-lncbr\" (UID: \"9b6fe734-5aae-408a-a26e-2793e4a7763b\") " pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" Jul 13 14:54:06.678828 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.678791 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b6fe734-5aae-408a-a26e-2793e4a7763b-serving-certs-ca-bundle\") pod \"telemeter-client-7f4bd6b4d-lncbr\" (UID: \"9b6fe734-5aae-408a-a26e-2793e4a7763b\") " pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" Jul 13 14:54:06.678998 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.678955 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9b6fe734-5aae-408a-a26e-2793e4a7763b-federate-client-tls\") pod \"telemeter-client-7f4bd6b4d-lncbr\" (UID: \"9b6fe734-5aae-408a-a26e-2793e4a7763b\") " pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" Jul 13 14:54:06.679687 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.679354 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 13 14:54:06.679687 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.679649 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9b6fe734-5aae-408a-a26e-2793e4a7763b-secret-telemeter-client\") pod \"telemeter-client-7f4bd6b4d-lncbr\" (UID: \"9b6fe734-5aae-408a-a26e-2793e4a7763b\") " pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" Jul 13 14:54:06.679854 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.679716 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9b6fe734-5aae-408a-a26e-2793e4a7763b-telemeter-client-tls\") pod \"telemeter-client-7f4bd6b4d-lncbr\" (UID: \"9b6fe734-5aae-408a-a26e-2793e4a7763b\") " pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" Jul 13 14:54:06.680906 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.680861 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b6fe734-5aae-408a-a26e-2793e4a7763b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f4bd6b4d-lncbr\" (UID: \"9b6fe734-5aae-408a-a26e-2793e4a7763b\") " pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" Jul 13 14:54:06.688118 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.688095 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh244\" (UniqueName: \"kubernetes.io/projected/9b6fe734-5aae-408a-a26e-2793e4a7763b-kube-api-access-fh244\") pod \"telemeter-client-7f4bd6b4d-lncbr\" (UID: \"9b6fe734-5aae-408a-a26e-2793e4a7763b\") " pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" Jul 13 14:54:06.688254 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.688208 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0df991d-b78f-4144-85c7-9f7f9a9edc55-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78c6d67dcf-2pml8\" (UID: \"e0df991d-b78f-4144-85c7-9f7f9a9edc55\") " pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:06.794581 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.794561 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" Jul 13 14:54:06.868811 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:54:06.868033 2577 secret.go:189] Couldn't get secret openshift-monitoring/metrics-server-client-certs: failed to sync secret cache: timed out waiting for the condition Jul 13 14:54:06.868811 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:54:06.868119 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0df991d-b78f-4144-85c7-9f7f9a9edc55-secret-metrics-server-client-certs podName:e0df991d-b78f-4144-85c7-9f7f9a9edc55 nodeName:}" failed. No retries permitted until 2026-07-13 14:54:07.368095663 +0000 UTC m=+71.434668114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-metrics-server-client-certs" (UniqueName: "kubernetes.io/secret/e0df991d-b78f-4144-85c7-9f7f9a9edc55-secret-metrics-server-client-certs") pod "metrics-server-78c6d67dcf-2pml8" (UID: "e0df991d-b78f-4144-85c7-9f7f9a9edc55") : failed to sync secret cache: timed out waiting for the condition Jul 13 14:54:06.868811 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:54:06.868502 2577 secret.go:189] Couldn't get secret openshift-monitoring/metrics-server-8bu1mb3lojteh: failed to sync secret cache: timed out waiting for the condition Jul 13 14:54:06.868811 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:54:06.868557 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0df991d-b78f-4144-85c7-9f7f9a9edc55-client-ca-bundle podName:e0df991d-b78f-4144-85c7-9f7f9a9edc55 nodeName:}" failed. No retries permitted until 2026-07-13 14:54:07.368540735 +0000 UTC m=+71.435113184 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "client-ca-bundle" (UniqueName: "kubernetes.io/secret/e0df991d-b78f-4144-85c7-9f7f9a9edc55-client-ca-bundle") pod "metrics-server-78c6d67dcf-2pml8" (UID: "e0df991d-b78f-4144-85c7-9f7f9a9edc55") : failed to sync secret cache: timed out waiting for the condition Jul 13 14:54:06.868811 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:54:06.868587 2577 configmap.go:193] Couldn't get configMap openshift-monitoring/metrics-server-audit-profiles: failed to sync configmap cache: timed out waiting for the condition Jul 13 14:54:06.868811 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:54:06.868621 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0df991d-b78f-4144-85c7-9f7f9a9edc55-metrics-server-audit-profiles podName:e0df991d-b78f-4144-85c7-9f7f9a9edc55 nodeName:}" failed. No retries permitted until 2026-07-13 14:54:07.368610625 +0000 UTC m=+71.435183069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-server-audit-profiles" (UniqueName: "kubernetes.io/configmap/e0df991d-b78f-4144-85c7-9f7f9a9edc55-metrics-server-audit-profiles") pod "metrics-server-78c6d67dcf-2pml8" (UID: "e0df991d-b78f-4144-85c7-9f7f9a9edc55") : failed to sync configmap cache: timed out waiting for the condition Jul 13 14:54:06.946042 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.945571 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 13 14:54:06.965603 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.965575 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr"] Jul 13 14:54:06.989229 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:06.989208 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-nz2wf\"" Jul 13 14:54:06.994880 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:54:06.994861 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b6fe734_5aae_408a_a26e_2793e4a7763b.slice/crio-fc00bf74fa8fefbe72b5e195c9d40677e17a19bebfeaeb50278458baa6ae0a41 WatchSource:0}: Error finding container fc00bf74fa8fefbe72b5e195c9d40677e17a19bebfeaeb50278458baa6ae0a41: Status 404 returned error can't find the container with id fc00bf74fa8fefbe72b5e195c9d40677e17a19bebfeaeb50278458baa6ae0a41 Jul 13 14:54:07.108501 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.108410 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 13 14:54:07.163756 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.163725 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8bu1mb3lojteh\"" Jul 13 14:54:07.351441 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.351417 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b475547-2j9hs"] Jul 13 14:54:07.353877 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.353861 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b475547-2j9hs" Jul 13 14:54:07.356541 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.356519 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 13 14:54:07.356541 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.356532 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zvmr4\"" Jul 13 14:54:07.356750 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.356583 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 13 14:54:07.356750 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.356600 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 13 14:54:07.357112 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.357091 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 13 14:54:07.357112 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.357104 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 13 14:54:07.357263 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.357099 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 13 14:54:07.357440 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.357428 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 13 14:54:07.362765 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.362745 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 13 14:54:07.367041 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.367011 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b475547-2j9hs"] Jul 13 14:54:07.381230 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.381209 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e0df991d-b78f-4144-85c7-9f7f9a9edc55-metrics-server-audit-profiles\") pod \"metrics-server-78c6d67dcf-2pml8\" (UID: \"e0df991d-b78f-4144-85c7-9f7f9a9edc55\") " pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:07.381313 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.381246 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0df991d-b78f-4144-85c7-9f7f9a9edc55-client-ca-bundle\") pod \"metrics-server-78c6d67dcf-2pml8\" (UID: \"e0df991d-b78f-4144-85c7-9f7f9a9edc55\") " pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:07.381313 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.381265 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e0df991d-b78f-4144-85c7-9f7f9a9edc55-secret-metrics-server-client-certs\") pod \"metrics-server-78c6d67dcf-2pml8\" (UID: \"e0df991d-b78f-4144-85c7-9f7f9a9edc55\") " pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:07.381997 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.381979 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e0df991d-b78f-4144-85c7-9f7f9a9edc55-metrics-server-audit-profiles\") pod \"metrics-server-78c6d67dcf-2pml8\" (UID: \"e0df991d-b78f-4144-85c7-9f7f9a9edc55\") " pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:07.383511 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.383492 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0df991d-b78f-4144-85c7-9f7f9a9edc55-client-ca-bundle\") pod \"metrics-server-78c6d67dcf-2pml8\" (UID: \"e0df991d-b78f-4144-85c7-9f7f9a9edc55\") " pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:07.383573 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.383509 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e0df991d-b78f-4144-85c7-9f7f9a9edc55-secret-metrics-server-client-certs\") pod \"metrics-server-78c6d67dcf-2pml8\" (UID: \"e0df991d-b78f-4144-85c7-9f7f9a9edc55\") " pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:07.481699 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.481675 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-console-oauth-config\") pod \"console-5b475547-2j9hs\" (UID: \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\") " pod="openshift-console/console-5b475547-2j9hs" Jul 13 14:54:07.481825 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.481712 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-console-serving-cert\") pod \"console-5b475547-2j9hs\" (UID: \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\") " pod="openshift-console/console-5b475547-2j9hs" Jul 13 14:54:07.481825 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.481730 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-trusted-ca-bundle\") pod \"console-5b475547-2j9hs\" (UID: \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\") " pod="openshift-console/console-5b475547-2j9hs" Jul 13 14:54:07.481825 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.481752 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-oauth-serving-cert\") pod \"console-5b475547-2j9hs\" (UID: \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\") " pod="openshift-console/console-5b475547-2j9hs" Jul 13 14:54:07.482046 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.481874 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-service-ca\") pod \"console-5b475547-2j9hs\" (UID: \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\") " pod="openshift-console/console-5b475547-2j9hs" Jul 13 14:54:07.482046 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.481914 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-console-config\") pod \"console-5b475547-2j9hs\" (UID: \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\") " pod="openshift-console/console-5b475547-2j9hs" Jul 13 14:54:07.482046 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.481953 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqsvw\" (UniqueName: \"kubernetes.io/projected/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-kube-api-access-bqsvw\") pod \"console-5b475547-2j9hs\" (UID: \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\") " pod="openshift-console/console-5b475547-2j9hs" Jul 13 14:54:07.508549 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.508515 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:07.583288 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.583256 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-console-oauth-config\") pod \"console-5b475547-2j9hs\" (UID: \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\") " pod="openshift-console/console-5b475547-2j9hs" Jul 13 14:54:07.583410 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.583305 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-console-serving-cert\") pod \"console-5b475547-2j9hs\" (UID: \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\") " pod="openshift-console/console-5b475547-2j9hs" Jul 13 14:54:07.583410 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.583328 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-trusted-ca-bundle\") pod \"console-5b475547-2j9hs\" (UID: \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\") " pod="openshift-console/console-5b475547-2j9hs" Jul 13 14:54:07.583410 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.583371 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-oauth-serving-cert\") pod \"console-5b475547-2j9hs\" (UID: \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\") " pod="openshift-console/console-5b475547-2j9hs" Jul 13 14:54:07.583563 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.583418 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-service-ca\") pod \"console-5b475547-2j9hs\" (UID: \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\") " pod="openshift-console/console-5b475547-2j9hs" Jul 13 14:54:07.583563 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.583449 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-console-config\") pod \"console-5b475547-2j9hs\" (UID: \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\") " pod="openshift-console/console-5b475547-2j9hs" Jul 13 14:54:07.583563 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.583485 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqsvw\" (UniqueName: \"kubernetes.io/projected/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-kube-api-access-bqsvw\") pod \"console-5b475547-2j9hs\" (UID: \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\") " pod="openshift-console/console-5b475547-2j9hs" Jul 13 14:54:07.584632 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.584539 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-oauth-serving-cert\") pod \"console-5b475547-2j9hs\" (UID: \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\") " pod="openshift-console/console-5b475547-2j9hs" Jul 13 14:54:07.584750 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.584712 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-service-ca\") pod \"console-5b475547-2j9hs\" (UID: \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\") " pod="openshift-console/console-5b475547-2j9hs" Jul 13 14:54:07.584964 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.584940 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-trusted-ca-bundle\") pod \"console-5b475547-2j9hs\" (UID: \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\") " pod="openshift-console/console-5b475547-2j9hs" Jul 13 14:54:07.585204 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.585185 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-console-config\") pod \"console-5b475547-2j9hs\" (UID: \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\") " pod="openshift-console/console-5b475547-2j9hs" Jul 13 14:54:07.586312 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.586266 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-console-oauth-config\") pod \"console-5b475547-2j9hs\" (UID: \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\") " pod="openshift-console/console-5b475547-2j9hs" Jul 13 14:54:07.586948 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.586919 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-console-serving-cert\") pod \"console-5b475547-2j9hs\" (UID: \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\") " pod="openshift-console/console-5b475547-2j9hs" Jul 13 14:54:07.592573 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.592549 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqsvw\" (UniqueName: \"kubernetes.io/projected/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-kube-api-access-bqsvw\") pod \"console-5b475547-2j9hs\" (UID: \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\") " pod="openshift-console/console-5b475547-2j9hs" Jul 13 14:54:07.629431 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.629372 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78c6d67dcf-2pml8"] Jul 13 14:54:07.632357 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:54:07.632335 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0df991d_b78f_4144_85c7_9f7f9a9edc55.slice/crio-35978aa9ae9ab26b64bda9d0cdaced02ad1868c4507382afc69443298afc2e02 WatchSource:0}: Error finding container 35978aa9ae9ab26b64bda9d0cdaced02ad1868c4507382afc69443298afc2e02: Status 404 returned error can't find the container with id 35978aa9ae9ab26b64bda9d0cdaced02ad1868c4507382afc69443298afc2e02 Jul 13 14:54:07.663073 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.663047 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b475547-2j9hs" Jul 13 14:54:07.694842 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.694802 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vrbdc" event={"ID":"b4113ffd-a496-4d76-9f75-942100b26c23","Type":"ContainerStarted","Data":"e22432370ead8fccaa3651572c75ab7fef357a98ccc200f65cfa130509ff2129"} Jul 13 14:54:07.695970 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.695943 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" event={"ID":"e0df991d-b78f-4144-85c7-9f7f9a9edc55","Type":"ContainerStarted","Data":"35978aa9ae9ab26b64bda9d0cdaced02ad1868c4507382afc69443298afc2e02"} Jul 13 14:54:07.697456 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.697435 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gvdvc" event={"ID":"ecfa98f6-7abe-43a4-956d-b613d7e1d854","Type":"ContainerStarted","Data":"9629d29a3ec2402dcad45ecca6acd6f1381a73895cef5caf620b7192d3014206"} Jul 13 14:54:07.697539 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.697488 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:54:07.700199 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.700168 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tqltd" event={"ID":"d02cc62c-036b-4674-acc7-798bfe7d4127","Type":"ContainerStarted","Data":"1a57c49ed290a2a58f55f551aa884ce2be3dc88fb497667535000c7ce00e4892"} Jul 13 14:54:07.700304 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.700220 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tqltd" event={"ID":"d02cc62c-036b-4674-acc7-798bfe7d4127","Type":"ContainerStarted","Data":"f73c28dacf9dccc4f2b15b58e5e6379f92c3b622d3e5fa86cac970414e07b881"} Jul 13 14:54:07.702364 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.702340 2577 generic.go:356] "Generic (PLEG): container finished" podID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerID="b76db4f4686cdb0eef60eefb19492c1b4f1bc261ed0308bc3621385ff29c2eef" exitCode=0 Jul 13 14:54:07.702465 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.702416 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8874e6f6-1107-463c-9c0b-296d87f076d0","Type":"ContainerDied","Data":"b76db4f4686cdb0eef60eefb19492c1b4f1bc261ed0308bc3621385ff29c2eef"} Jul 13 14:54:07.703898 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.703874 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" event={"ID":"9b6fe734-5aae-408a-a26e-2793e4a7763b","Type":"ContainerStarted","Data":"fc00bf74fa8fefbe72b5e195c9d40677e17a19bebfeaeb50278458baa6ae0a41"} Jul 13 14:54:07.716531 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.716476 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vrbdc" podStartSLOduration=65.42963884 podStartE2EDuration="1m10.716459879s" totalImagesPullingTime="5.286821039s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:54:07.716363838 +0000 UTC m=+71.782936306" watchObservedRunningTime="2026-07-13 14:54:07.716459879 +0000 UTC m=+71.783032342" Jul 13 14:54:07.762358 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.762286 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gvdvc" podStartSLOduration=65.784444924 podStartE2EDuration="1m10.762266456s" totalImagesPullingTime="4.977821532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:54:07.734391229 +0000 UTC m=+71.800963695" watchObservedRunningTime="2026-07-13 14:54:07.762266456 +0000 UTC m=+71.828838921" Jul 13 14:54:07.762701 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.762671 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tqltd" podStartSLOduration=5.139064585 podStartE2EDuration="6.762662212s" totalImagesPullingTime="1.542588385s" totalInitContainerRuntime="81.009242ms" isStatefulPod=true podCreationTimestamp="2026-07-13 14:54:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:54:07.761370683 +0000 UTC m=+71.827943162" watchObservedRunningTime="2026-07-13 14:54:07.762662212 +0000 UTC m=+71.829234678" Jul 13 14:54:07.808178 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:07.807927 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b475547-2j9hs"] Jul 13 14:54:07.810863 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:54:07.810834 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc7eb7ff_4f64_41a9_acd3_5bee54131b50.slice/crio-13c48a71c80c1184b19cf5eb733863a296f788a3d6c967797c738ad923319469 WatchSource:0}: Error finding container 13c48a71c80c1184b19cf5eb733863a296f788a3d6c967797c738ad923319469: Status 404 returned error can't find the container with id 13c48a71c80c1184b19cf5eb733863a296f788a3d6c967797c738ad923319469 Jul 13 14:54:08.712804 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:08.712535 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b475547-2j9hs" event={"ID":"cc7eb7ff-4f64-41a9-acd3-5bee54131b50","Type":"ContainerStarted","Data":"13c48a71c80c1184b19cf5eb733863a296f788a3d6c967797c738ad923319469"} Jul 13 14:54:11.624267 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:11.624196 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-74869c78fb-4snkc" Jul 13 14:54:11.727164 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:11.727129 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" event={"ID":"9b6fe734-5aae-408a-a26e-2793e4a7763b","Type":"ContainerStarted","Data":"0629f2aa7790502a35777489409c895b698e386c64cd9c0f81d48e2f236e0865"} Jul 13 14:54:11.727318 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:11.727189 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" event={"ID":"9b6fe734-5aae-408a-a26e-2793e4a7763b","Type":"ContainerStarted","Data":"5f0d9c8c4029147cd2e8edba2938b57b00a2166c80ddcf2c54147442a585aa48"} Jul 13 14:54:11.727318 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:11.727214 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" event={"ID":"9b6fe734-5aae-408a-a26e-2793e4a7763b","Type":"ContainerStarted","Data":"68d9a4d89f9fa27dc27394e0ae46cfc0ed183668f3185eabc5d40c0c43762786"} Jul 13 14:54:11.728527 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:11.728499 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" event={"ID":"e0df991d-b78f-4144-85c7-9f7f9a9edc55","Type":"ContainerStarted","Data":"e26dc7ef2de19e8e41d7fb00a856352a8bf02c42c0987b98bd8d7add549eaf97"} Jul 13 14:54:11.729939 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:11.729917 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b475547-2j9hs" event={"ID":"cc7eb7ff-4f64-41a9-acd3-5bee54131b50","Type":"ContainerStarted","Data":"8c44f3008d10d48558e87d9b01bdd5c57d79356b8d2aa2c82e1a4b0b04a7ef39"} Jul 13 14:54:11.732868 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:11.732851 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8874e6f6-1107-463c-9c0b-296d87f076d0","Type":"ContainerStarted","Data":"57a523172dda083a0b7cc7225d724e5d502819763fa6aee9c90a6fa4cff96d59"} Jul 13 14:54:11.732963 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:11.732906 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8874e6f6-1107-463c-9c0b-296d87f076d0","Type":"ContainerStarted","Data":"6e1ba1703e8931e65805ee09dce4a61ef6bfabb46320f8a535b6b546d5474b8d"} Jul 13 14:54:11.732963 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:11.732931 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8874e6f6-1107-463c-9c0b-296d87f076d0","Type":"ContainerStarted","Data":"12686e5def575b75ad6d3cf5e2328b6951d2fe552ed7bb9bf234fbd6eaff3f84"} Jul 13 14:54:11.732963 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:11.732953 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8874e6f6-1107-463c-9c0b-296d87f076d0","Type":"ContainerStarted","Data":"139ac9471a50744c838518c92b9c8abb952cbbdb9a0813d7e8de820e8244f019"} Jul 13 14:54:11.733049 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:11.732976 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8874e6f6-1107-463c-9c0b-296d87f076d0","Type":"ContainerStarted","Data":"3a5e5dc45be24ff5e0f211fe803041259257fde117b8ab6a398b9b9195fbe874"} Jul 13 14:54:11.750683 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:11.750640 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7f4bd6b4d-lncbr" podStartSLOduration=1.6598670530000001 podStartE2EDuration="5.750627194s" totalImagesPullingTime="4.090760141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:54:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:54:11.749022298 +0000 UTC m=+75.815594764" watchObservedRunningTime="2026-07-13 14:54:11.750627194 +0000 UTC m=+75.817199659" Jul 13 14:54:11.766603 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:11.766553 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b475547-2j9hs" podStartSLOduration=1.462084279 podStartE2EDuration="4.766537012s" totalImagesPullingTime="3.304452733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:54:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:54:11.766270555 +0000 UTC m=+75.832843022" watchObservedRunningTime="2026-07-13 14:54:11.766537012 +0000 UTC m=+75.833109478" Jul 13 14:54:11.786163 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:11.786121 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" podStartSLOduration=3.328560227 podStartE2EDuration="6.78610781s" totalImagesPullingTime="3.457547583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:54:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:54:11.785223387 +0000 UTC m=+75.851795855" watchObservedRunningTime="2026-07-13 14:54:11.78610781 +0000 UTC m=+75.852680275" Jul 13 14:54:12.603704 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:12.603674 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b475547-2j9hs"] Jul 13 14:54:12.635832 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:12.635804 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c74fd575-fglnw"] Jul 13 14:54:12.641385 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:12.641363 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c74fd575-fglnw" Jul 13 14:54:12.649466 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:12.649444 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c74fd575-fglnw"] Jul 13 14:54:12.733856 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:12.733814 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrhcr\" (UniqueName: \"kubernetes.io/projected/ea4dc910-ae2d-49f1-ade8-57659294a7ea-kube-api-access-xrhcr\") pod \"console-c74fd575-fglnw\" (UID: \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\") " pod="openshift-console/console-c74fd575-fglnw" Jul 13 14:54:12.733974 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:12.733879 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea4dc910-ae2d-49f1-ade8-57659294a7ea-console-serving-cert\") pod \"console-c74fd575-fglnw\" (UID: \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\") " pod="openshift-console/console-c74fd575-fglnw" Jul 13 14:54:12.733974 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:12.733910 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea4dc910-ae2d-49f1-ade8-57659294a7ea-console-oauth-config\") pod \"console-c74fd575-fglnw\" (UID: \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\") " pod="openshift-console/console-c74fd575-fglnw" Jul 13 14:54:12.733974 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:12.733940 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea4dc910-ae2d-49f1-ade8-57659294a7ea-trusted-ca-bundle\") pod \"console-c74fd575-fglnw\" (UID: \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\") " pod="openshift-console/console-c74fd575-fglnw" Jul 13 14:54:12.734095 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:12.734003 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea4dc910-ae2d-49f1-ade8-57659294a7ea-console-config\") pod \"console-c74fd575-fglnw\" (UID: \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\") " pod="openshift-console/console-c74fd575-fglnw" Jul 13 14:54:12.734095 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:12.734049 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea4dc910-ae2d-49f1-ade8-57659294a7ea-service-ca\") pod \"console-c74fd575-fglnw\" (UID: \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\") " pod="openshift-console/console-c74fd575-fglnw" Jul 13 14:54:12.734095 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:12.734069 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea4dc910-ae2d-49f1-ade8-57659294a7ea-oauth-serving-cert\") pod \"console-c74fd575-fglnw\" (UID: \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\") " pod="openshift-console/console-c74fd575-fglnw" Jul 13 14:54:12.739793 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:12.739752 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8874e6f6-1107-463c-9c0b-296d87f076d0","Type":"ContainerStarted","Data":"1730a84e03f3bf613aff3aecbeae611a20b32872e1562eecfb6115caa281fb4d"} Jul 13 14:54:12.766536 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:12.766489 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.382133946 podStartE2EDuration="10.766472884s" totalImagesPullingTime="7.361554952s" totalInitContainerRuntime="22.783986ms" isStatefulPod=false podCreationTimestamp="2026-07-13 14:54:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:54:12.764712334 +0000 UTC m=+76.831284839" watchObservedRunningTime="2026-07-13 14:54:12.766472884 +0000 UTC m=+76.833045358" Jul 13 14:54:12.835243 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:12.835211 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrhcr\" (UniqueName: \"kubernetes.io/projected/ea4dc910-ae2d-49f1-ade8-57659294a7ea-kube-api-access-xrhcr\") pod \"console-c74fd575-fglnw\" (UID: \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\") " pod="openshift-console/console-c74fd575-fglnw" Jul 13 14:54:12.836381 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:12.835698 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea4dc910-ae2d-49f1-ade8-57659294a7ea-console-serving-cert\") pod \"console-c74fd575-fglnw\" (UID: \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\") " pod="openshift-console/console-c74fd575-fglnw" Jul 13 14:54:12.836381 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:12.835833 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea4dc910-ae2d-49f1-ade8-57659294a7ea-console-oauth-config\") pod \"console-c74fd575-fglnw\" (UID: \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\") " pod="openshift-console/console-c74fd575-fglnw" Jul 13 14:54:12.836381 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:12.835897 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea4dc910-ae2d-49f1-ade8-57659294a7ea-trusted-ca-bundle\") pod \"console-c74fd575-fglnw\" (UID: \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\") " pod="openshift-console/console-c74fd575-fglnw" Jul 13 14:54:12.836381 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:12.836105 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea4dc910-ae2d-49f1-ade8-57659294a7ea-console-config\") pod \"console-c74fd575-fglnw\" (UID: \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\") " pod="openshift-console/console-c74fd575-fglnw" Jul 13 14:54:12.836381 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:12.836205 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea4dc910-ae2d-49f1-ade8-57659294a7ea-service-ca\") pod \"console-c74fd575-fglnw\" (UID: \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\") " pod="openshift-console/console-c74fd575-fglnw" Jul 13 14:54:12.836716 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:12.836540 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea4dc910-ae2d-49f1-ade8-57659294a7ea-oauth-serving-cert\") pod \"console-c74fd575-fglnw\" (UID: \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\") " pod="openshift-console/console-c74fd575-fglnw" Jul 13 14:54:12.837322 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:12.836813 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea4dc910-ae2d-49f1-ade8-57659294a7ea-trusted-ca-bundle\") pod \"console-c74fd575-fglnw\" (UID: \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\") " pod="openshift-console/console-c74fd575-fglnw" Jul 13 14:54:12.837322 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:12.836895 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea4dc910-ae2d-49f1-ade8-57659294a7ea-console-config\") pod \"console-c74fd575-fglnw\" (UID: \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\") " pod="openshift-console/console-c74fd575-fglnw" Jul 13 14:54:12.837469 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:12.837362 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea4dc910-ae2d-49f1-ade8-57659294a7ea-service-ca\") pod \"console-c74fd575-fglnw\" (UID: \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\") " pod="openshift-console/console-c74fd575-fglnw" Jul 13 14:54:12.837469 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:12.837370 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea4dc910-ae2d-49f1-ade8-57659294a7ea-oauth-serving-cert\") pod \"console-c74fd575-fglnw\" (UID: \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\") " pod="openshift-console/console-c74fd575-fglnw" Jul 13 14:54:12.838375 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:12.838358 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea4dc910-ae2d-49f1-ade8-57659294a7ea-console-oauth-config\") pod \"console-c74fd575-fglnw\" (UID: \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\") " pod="openshift-console/console-c74fd575-fglnw" Jul 13 14:54:12.838455 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:12.838439 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea4dc910-ae2d-49f1-ade8-57659294a7ea-console-serving-cert\") pod \"console-c74fd575-fglnw\" (UID: \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\") " pod="openshift-console/console-c74fd575-fglnw" Jul 13 14:54:12.843851 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:12.843830 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrhcr\" (UniqueName: \"kubernetes.io/projected/ea4dc910-ae2d-49f1-ade8-57659294a7ea-kube-api-access-xrhcr\") pod \"console-c74fd575-fglnw\" (UID: \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\") " pod="openshift-console/console-c74fd575-fglnw" Jul 13 14:54:12.950132 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:12.950105 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c74fd575-fglnw" Jul 13 14:54:13.070332 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:13.070310 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c74fd575-fglnw"] Jul 13 14:54:13.072697 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:54:13.072676 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea4dc910_ae2d_49f1_ade8_57659294a7ea.slice/crio-f80010ad5d498e955696205d3b7b1b1db622fd883fa20a75722d4e5e91c87007 WatchSource:0}: Error finding container f80010ad5d498e955696205d3b7b1b1db622fd883fa20a75722d4e5e91c87007: Status 404 returned error can't find the container with id f80010ad5d498e955696205d3b7b1b1db622fd883fa20a75722d4e5e91c87007 Jul 13 14:54:13.744603 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:13.744562 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c74fd575-fglnw" event={"ID":"ea4dc910-ae2d-49f1-ade8-57659294a7ea","Type":"ContainerStarted","Data":"b8bc28af757e06805533666b645641e15b767095c74f5f66f57d0af06077cdfe"} Jul 13 14:54:13.745088 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:13.744622 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c74fd575-fglnw" event={"ID":"ea4dc910-ae2d-49f1-ade8-57659294a7ea","Type":"ContainerStarted","Data":"f80010ad5d498e955696205d3b7b1b1db622fd883fa20a75722d4e5e91c87007"} Jul 13 14:54:13.761754 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:13.761714 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c74fd575-fglnw" podStartSLOduration=1.761698738 podStartE2EDuration="1.761698738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:54:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:54:13.760916868 +0000 UTC m=+77.827489335" watchObservedRunningTime="2026-07-13 14:54:13.761698738 +0000 UTC m=+77.828271205" Jul 13 14:54:17.664117 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:17.664083 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b475547-2j9hs" Jul 13 14:54:22.950854 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:22.950815 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c74fd575-fglnw" Jul 13 14:54:22.951398 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:22.950871 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c74fd575-fglnw" Jul 13 14:54:22.955608 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:22.955588 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c74fd575-fglnw" Jul 13 14:54:23.785576 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:23.785548 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c74fd575-fglnw" Jul 13 14:54:27.509130 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:27.509097 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:27.509490 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:27.509151 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:38.715487 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:38.715454 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gvdvc" Jul 13 14:54:38.765053 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:38.765004 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5b475547-2j9hs" podUID="cc7eb7ff-4f64-41a9-acd3-5bee54131b50" containerName="console" containerID="cri-o://8c44f3008d10d48558e87d9b01bdd5c57d79356b8d2aa2c82e1a4b0b04a7ef39" gracePeriod=15 Jul 13 14:54:39.546002 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.545977 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b475547-2j9hs" Jul 13 14:54:39.636912 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.636881 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-console-oauth-config\") pod \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\" (UID: \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\") " Jul 13 14:54:39.637065 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.636924 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-trusted-ca-bundle\") pod \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\" (UID: \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\") " Jul 13 14:54:39.637065 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.636960 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-oauth-serving-cert\") pod \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\" (UID: \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\") " Jul 13 14:54:39.637065 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.636997 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-service-ca\") pod \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\" (UID: \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\") " Jul 13 14:54:39.637065 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.637026 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-console-serving-cert\") pod \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\" (UID: \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\") " Jul 13 14:54:39.637065 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.637052 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-console-config\") pod \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\" (UID: \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\") " Jul 13 14:54:39.637290 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.637079 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqsvw\" (UniqueName: \"kubernetes.io/projected/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-kube-api-access-bqsvw\") pod \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\" (UID: \"cc7eb7ff-4f64-41a9-acd3-5bee54131b50\") " Jul 13 14:54:39.637838 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.637634 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cc7eb7ff-4f64-41a9-acd3-5bee54131b50" (UID: "cc7eb7ff-4f64-41a9-acd3-5bee54131b50"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:54:39.637838 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.637688 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cc7eb7ff-4f64-41a9-acd3-5bee54131b50" (UID: "cc7eb7ff-4f64-41a9-acd3-5bee54131b50"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:54:39.637838 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.637713 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-console-config" (OuterVolumeSpecName: "console-config") pod "cc7eb7ff-4f64-41a9-acd3-5bee54131b50" (UID: "cc7eb7ff-4f64-41a9-acd3-5bee54131b50"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:54:39.638066 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.637970 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-service-ca" (OuterVolumeSpecName: "service-ca") pod "cc7eb7ff-4f64-41a9-acd3-5bee54131b50" (UID: "cc7eb7ff-4f64-41a9-acd3-5bee54131b50"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:54:39.640792 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.640748 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cc7eb7ff-4f64-41a9-acd3-5bee54131b50" (UID: "cc7eb7ff-4f64-41a9-acd3-5bee54131b50"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:54:39.640905 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.640766 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-kube-api-access-bqsvw" (OuterVolumeSpecName: "kube-api-access-bqsvw") pod "cc7eb7ff-4f64-41a9-acd3-5bee54131b50" (UID: "cc7eb7ff-4f64-41a9-acd3-5bee54131b50"). InnerVolumeSpecName "kube-api-access-bqsvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 14:54:39.641886 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.641858 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cc7eb7ff-4f64-41a9-acd3-5bee54131b50" (UID: "cc7eb7ff-4f64-41a9-acd3-5bee54131b50"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:54:39.738154 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.738088 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-oauth-serving-cert\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:54:39.738154 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.738112 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-service-ca\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:54:39.738154 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.738120 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-console-serving-cert\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:54:39.738154 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.738129 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-console-config\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:54:39.738154 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.738137 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqsvw\" (UniqueName: \"kubernetes.io/projected/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-kube-api-access-bqsvw\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:54:39.738154 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.738146 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-console-oauth-config\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:54:39.738154 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.738153 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc7eb7ff-4f64-41a9-acd3-5bee54131b50-trusted-ca-bundle\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:54:39.837676 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.837645 2577 generic.go:356] "Generic (PLEG): container finished" podID="cc7eb7ff-4f64-41a9-acd3-5bee54131b50" containerID="8c44f3008d10d48558e87d9b01bdd5c57d79356b8d2aa2c82e1a4b0b04a7ef39" exitCode=0 Jul 13 14:54:39.837850 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.837700 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b475547-2j9hs" Jul 13 14:54:39.837850 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.837719 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b475547-2j9hs" event={"ID":"cc7eb7ff-4f64-41a9-acd3-5bee54131b50","Type":"ContainerDied","Data":"8c44f3008d10d48558e87d9b01bdd5c57d79356b8d2aa2c82e1a4b0b04a7ef39"} Jul 13 14:54:39.837850 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.837816 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b475547-2j9hs" event={"ID":"cc7eb7ff-4f64-41a9-acd3-5bee54131b50","Type":"ContainerDied","Data":"13c48a71c80c1184b19cf5eb733863a296f788a3d6c967797c738ad923319469"} Jul 13 14:54:39.837850 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.837849 2577 scope.go:117] "RemoveContainer" containerID="8c44f3008d10d48558e87d9b01bdd5c57d79356b8d2aa2c82e1a4b0b04a7ef39" Jul 13 14:54:39.846339 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.846325 2577 scope.go:117] "RemoveContainer" containerID="8c44f3008d10d48558e87d9b01bdd5c57d79356b8d2aa2c82e1a4b0b04a7ef39" Jul 13 14:54:39.846587 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:54:39.846567 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c44f3008d10d48558e87d9b01bdd5c57d79356b8d2aa2c82e1a4b0b04a7ef39\": container with ID starting with 8c44f3008d10d48558e87d9b01bdd5c57d79356b8d2aa2c82e1a4b0b04a7ef39 not found: ID does not exist" containerID="8c44f3008d10d48558e87d9b01bdd5c57d79356b8d2aa2c82e1a4b0b04a7ef39" Jul 13 14:54:39.846653 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.846602 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c44f3008d10d48558e87d9b01bdd5c57d79356b8d2aa2c82e1a4b0b04a7ef39"} err="failed to get container status \"8c44f3008d10d48558e87d9b01bdd5c57d79356b8d2aa2c82e1a4b0b04a7ef39\": rpc error: code = NotFound desc = could not find container \"8c44f3008d10d48558e87d9b01bdd5c57d79356b8d2aa2c82e1a4b0b04a7ef39\": container with ID starting with 8c44f3008d10d48558e87d9b01bdd5c57d79356b8d2aa2c82e1a4b0b04a7ef39 not found: ID does not exist" Jul 13 14:54:39.858449 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.858428 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b475547-2j9hs"] Jul 13 14:54:39.864366 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:39.864345 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b475547-2j9hs"] Jul 13 14:54:41.343636 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:41.343603 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc7eb7ff-4f64-41a9-acd3-5bee54131b50" path="/var/lib/kubelet/pods/cc7eb7ff-4f64-41a9-acd3-5bee54131b50/volumes" Jul 13 14:54:47.515670 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:47.515638 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:54:47.519427 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:54:47.519406 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-78c6d67dcf-2pml8" Jul 13 14:55:21.629337 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:21.629308 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 14:55:21.629816 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:21.629584 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerName="alertmanager" containerID="cri-o://3a5e5dc45be24ff5e0f211fe803041259257fde117b8ab6a398b9b9195fbe874" gracePeriod=120 Jul 13 14:55:21.629816 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:21.629647 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerName="kube-rbac-proxy-metric" containerID="cri-o://57a523172dda083a0b7cc7225d724e5d502819763fa6aee9c90a6fa4cff96d59" gracePeriod=120 Jul 13 14:55:21.629816 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:21.629685 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerName="kube-rbac-proxy-web" containerID="cri-o://12686e5def575b75ad6d3cf5e2328b6951d2fe552ed7bb9bf234fbd6eaff3f84" gracePeriod=120 Jul 13 14:55:21.629816 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:21.629731 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerName="prom-label-proxy" containerID="cri-o://1730a84e03f3bf613aff3aecbeae611a20b32872e1562eecfb6115caa281fb4d" gracePeriod=120 Jul 13 14:55:21.629816 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:21.629720 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerName="config-reloader" containerID="cri-o://139ac9471a50744c838518c92b9c8abb952cbbdb9a0813d7e8de820e8244f019" gracePeriod=120 Jul 13 14:55:21.630087 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:21.629771 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerName="kube-rbac-proxy" containerID="cri-o://6e1ba1703e8931e65805ee09dce4a61ef6bfabb46320f8a535b6b546d5474b8d" gracePeriod=120 Jul 13 14:55:21.985091 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:21.985060 2577 generic.go:356] "Generic (PLEG): container finished" podID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerID="1730a84e03f3bf613aff3aecbeae611a20b32872e1562eecfb6115caa281fb4d" exitCode=0 Jul 13 14:55:21.985091 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:21.985083 2577 generic.go:356] "Generic (PLEG): container finished" podID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerID="57a523172dda083a0b7cc7225d724e5d502819763fa6aee9c90a6fa4cff96d59" exitCode=0 Jul 13 14:55:21.985091 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:21.985089 2577 generic.go:356] "Generic (PLEG): container finished" podID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerID="6e1ba1703e8931e65805ee09dce4a61ef6bfabb46320f8a535b6b546d5474b8d" exitCode=0 Jul 13 14:55:21.985091 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:21.985095 2577 generic.go:356] "Generic (PLEG): container finished" podID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerID="139ac9471a50744c838518c92b9c8abb952cbbdb9a0813d7e8de820e8244f019" exitCode=0 Jul 13 14:55:21.985091 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:21.985100 2577 generic.go:356] "Generic (PLEG): container finished" podID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerID="3a5e5dc45be24ff5e0f211fe803041259257fde117b8ab6a398b9b9195fbe874" exitCode=0 Jul 13 14:55:21.985441 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:21.985135 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8874e6f6-1107-463c-9c0b-296d87f076d0","Type":"ContainerDied","Data":"1730a84e03f3bf613aff3aecbeae611a20b32872e1562eecfb6115caa281fb4d"} Jul 13 14:55:21.985441 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:21.985214 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8874e6f6-1107-463c-9c0b-296d87f076d0","Type":"ContainerDied","Data":"57a523172dda083a0b7cc7225d724e5d502819763fa6aee9c90a6fa4cff96d59"} Jul 13 14:55:21.985441 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:21.985254 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8874e6f6-1107-463c-9c0b-296d87f076d0","Type":"ContainerDied","Data":"6e1ba1703e8931e65805ee09dce4a61ef6bfabb46320f8a535b6b546d5474b8d"} Jul 13 14:55:21.985441 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:21.985291 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8874e6f6-1107-463c-9c0b-296d87f076d0","Type":"ContainerDied","Data":"139ac9471a50744c838518c92b9c8abb952cbbdb9a0813d7e8de820e8244f019"} Jul 13 14:55:21.985441 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:21.985331 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8874e6f6-1107-463c-9c0b-296d87f076d0","Type":"ContainerDied","Data":"3a5e5dc45be24ff5e0f211fe803041259257fde117b8ab6a398b9b9195fbe874"} Jul 13 14:55:22.874648 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.874625 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:22.955965 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.955944 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-web-config\") pod \"8874e6f6-1107-463c-9c0b-296d87f076d0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " Jul 13 14:55:22.956102 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.955971 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-config-volume\") pod \"8874e6f6-1107-463c-9c0b-296d87f076d0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " Jul 13 14:55:22.956102 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.955991 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-secret-alertmanager-kube-rbac-proxy\") pod \"8874e6f6-1107-463c-9c0b-296d87f076d0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " Jul 13 14:55:22.956102 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.956026 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8874e6f6-1107-463c-9c0b-296d87f076d0-config-out\") pod \"8874e6f6-1107-463c-9c0b-296d87f076d0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " Jul 13 14:55:22.956102 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.956054 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7pmn\" (UniqueName: \"kubernetes.io/projected/8874e6f6-1107-463c-9c0b-296d87f076d0-kube-api-access-w7pmn\") pod \"8874e6f6-1107-463c-9c0b-296d87f076d0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " Jul 13 14:55:22.956102 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.956087 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8874e6f6-1107-463c-9c0b-296d87f076d0-alertmanager-trusted-ca-bundle\") pod \"8874e6f6-1107-463c-9c0b-296d87f076d0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " Jul 13 14:55:22.956375 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.956120 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8874e6f6-1107-463c-9c0b-296d87f076d0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " Jul 13 14:55:22.956375 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.956151 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-cluster-tls-config\") pod \"8874e6f6-1107-463c-9c0b-296d87f076d0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " Jul 13 14:55:22.956375 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.956173 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8874e6f6-1107-463c-9c0b-296d87f076d0-alertmanager-main-db\") pod \"8874e6f6-1107-463c-9c0b-296d87f076d0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " Jul 13 14:55:22.956375 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.956205 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8874e6f6-1107-463c-9c0b-296d87f076d0-metrics-client-ca\") pod \"8874e6f6-1107-463c-9c0b-296d87f076d0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " Jul 13 14:55:22.956375 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.956251 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8874e6f6-1107-463c-9c0b-296d87f076d0-tls-assets\") pod \"8874e6f6-1107-463c-9c0b-296d87f076d0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " Jul 13 14:55:22.956375 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.956284 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-secret-alertmanager-main-tls\") pod \"8874e6f6-1107-463c-9c0b-296d87f076d0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " Jul 13 14:55:22.956375 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.956308 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-secret-alertmanager-kube-rbac-proxy-web\") pod \"8874e6f6-1107-463c-9c0b-296d87f076d0\" (UID: \"8874e6f6-1107-463c-9c0b-296d87f076d0\") " Jul 13 14:55:22.956892 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.956814 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8874e6f6-1107-463c-9c0b-296d87f076d0-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8874e6f6-1107-463c-9c0b-296d87f076d0" (UID: "8874e6f6-1107-463c-9c0b-296d87f076d0"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:55:22.957007 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.956925 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8874e6f6-1107-463c-9c0b-296d87f076d0-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8874e6f6-1107-463c-9c0b-296d87f076d0" (UID: "8874e6f6-1107-463c-9c0b-296d87f076d0"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:55:22.957336 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.957288 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8874e6f6-1107-463c-9c0b-296d87f076d0-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8874e6f6-1107-463c-9c0b-296d87f076d0" (UID: "8874e6f6-1107-463c-9c0b-296d87f076d0"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 14:55:22.959696 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.959629 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8874e6f6-1107-463c-9c0b-296d87f076d0" (UID: "8874e6f6-1107-463c-9c0b-296d87f076d0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:55:22.959873 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.959744 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8874e6f6-1107-463c-9c0b-296d87f076d0" (UID: "8874e6f6-1107-463c-9c0b-296d87f076d0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:55:22.959994 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.959974 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8874e6f6-1107-463c-9c0b-296d87f076d0-config-out" (OuterVolumeSpecName: "config-out") pod "8874e6f6-1107-463c-9c0b-296d87f076d0" (UID: "8874e6f6-1107-463c-9c0b-296d87f076d0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 14:55:22.960306 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.960265 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8874e6f6-1107-463c-9c0b-296d87f076d0" (UID: "8874e6f6-1107-463c-9c0b-296d87f076d0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:55:22.960306 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.960273 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8874e6f6-1107-463c-9c0b-296d87f076d0-kube-api-access-w7pmn" (OuterVolumeSpecName: "kube-api-access-w7pmn") pod "8874e6f6-1107-463c-9c0b-296d87f076d0" (UID: "8874e6f6-1107-463c-9c0b-296d87f076d0"). InnerVolumeSpecName "kube-api-access-w7pmn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 14:55:22.960756 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.960733 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8874e6f6-1107-463c-9c0b-296d87f076d0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8874e6f6-1107-463c-9c0b-296d87f076d0" (UID: "8874e6f6-1107-463c-9c0b-296d87f076d0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 14:55:22.960853 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.960766 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-config-volume" (OuterVolumeSpecName: "config-volume") pod "8874e6f6-1107-463c-9c0b-296d87f076d0" (UID: "8874e6f6-1107-463c-9c0b-296d87f076d0"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:55:22.961271 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.961249 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8874e6f6-1107-463c-9c0b-296d87f076d0" (UID: "8874e6f6-1107-463c-9c0b-296d87f076d0"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:55:22.964432 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.964387 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8874e6f6-1107-463c-9c0b-296d87f076d0" (UID: "8874e6f6-1107-463c-9c0b-296d87f076d0"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:55:22.969328 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.969277 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-web-config" (OuterVolumeSpecName: "web-config") pod "8874e6f6-1107-463c-9c0b-296d87f076d0" (UID: "8874e6f6-1107-463c-9c0b-296d87f076d0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:55:22.995402 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.995376 2577 generic.go:356] "Generic (PLEG): container finished" podID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerID="12686e5def575b75ad6d3cf5e2328b6951d2fe552ed7bb9bf234fbd6eaff3f84" exitCode=0 Jul 13 14:55:22.995476 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.995420 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8874e6f6-1107-463c-9c0b-296d87f076d0","Type":"ContainerDied","Data":"12686e5def575b75ad6d3cf5e2328b6951d2fe552ed7bb9bf234fbd6eaff3f84"} Jul 13 14:55:22.995476 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.995464 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:22.995539 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.995494 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8874e6f6-1107-463c-9c0b-296d87f076d0","Type":"ContainerDied","Data":"7633c220f8e0334789935d772d00a2e39ff1cd043d0e48e347990cb52562dc85"} Jul 13 14:55:22.995539 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:22.995525 2577 scope.go:117] "RemoveContainer" containerID="1730a84e03f3bf613aff3aecbeae611a20b32872e1562eecfb6115caa281fb4d" Jul 13 14:55:23.002219 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.002190 2577 scope.go:117] "RemoveContainer" containerID="57a523172dda083a0b7cc7225d724e5d502819763fa6aee9c90a6fa4cff96d59" Jul 13 14:55:23.008370 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.008353 2577 scope.go:117] "RemoveContainer" containerID="6e1ba1703e8931e65805ee09dce4a61ef6bfabb46320f8a535b6b546d5474b8d" Jul 13 14:55:23.014413 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.014399 2577 scope.go:117] "RemoveContainer" containerID="12686e5def575b75ad6d3cf5e2328b6951d2fe552ed7bb9bf234fbd6eaff3f84" Jul 13 14:55:23.018493 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.018474 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 14:55:23.020473 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.020459 2577 scope.go:117] "RemoveContainer" containerID="139ac9471a50744c838518c92b9c8abb952cbbdb9a0813d7e8de820e8244f019" Jul 13 14:55:23.024509 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.024490 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 14:55:23.027109 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.027099 2577 scope.go:117] "RemoveContainer" containerID="3a5e5dc45be24ff5e0f211fe803041259257fde117b8ab6a398b9b9195fbe874" Jul 13 14:55:23.033210 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.033190 2577 scope.go:117] "RemoveContainer" containerID="b76db4f4686cdb0eef60eefb19492c1b4f1bc261ed0308bc3621385ff29c2eef" Jul 13 14:55:23.039429 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.039409 2577 scope.go:117] "RemoveContainer" containerID="1730a84e03f3bf613aff3aecbeae611a20b32872e1562eecfb6115caa281fb4d" Jul 13 14:55:23.039670 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:55:23.039649 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1730a84e03f3bf613aff3aecbeae611a20b32872e1562eecfb6115caa281fb4d\": container with ID starting with 1730a84e03f3bf613aff3aecbeae611a20b32872e1562eecfb6115caa281fb4d not found: ID does not exist" containerID="1730a84e03f3bf613aff3aecbeae611a20b32872e1562eecfb6115caa281fb4d" Jul 13 14:55:23.039738 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.039677 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1730a84e03f3bf613aff3aecbeae611a20b32872e1562eecfb6115caa281fb4d"} err="failed to get container status \"1730a84e03f3bf613aff3aecbeae611a20b32872e1562eecfb6115caa281fb4d\": rpc error: code = NotFound desc = could not find container \"1730a84e03f3bf613aff3aecbeae611a20b32872e1562eecfb6115caa281fb4d\": container with ID starting with 1730a84e03f3bf613aff3aecbeae611a20b32872e1562eecfb6115caa281fb4d not found: ID does not exist" Jul 13 14:55:23.039738 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.039697 2577 scope.go:117] "RemoveContainer" containerID="57a523172dda083a0b7cc7225d724e5d502819763fa6aee9c90a6fa4cff96d59" Jul 13 14:55:23.039956 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:55:23.039939 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57a523172dda083a0b7cc7225d724e5d502819763fa6aee9c90a6fa4cff96d59\": container with ID starting with 57a523172dda083a0b7cc7225d724e5d502819763fa6aee9c90a6fa4cff96d59 not found: ID does not exist" containerID="57a523172dda083a0b7cc7225d724e5d502819763fa6aee9c90a6fa4cff96d59" Jul 13 14:55:23.039995 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.039961 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57a523172dda083a0b7cc7225d724e5d502819763fa6aee9c90a6fa4cff96d59"} err="failed to get container status \"57a523172dda083a0b7cc7225d724e5d502819763fa6aee9c90a6fa4cff96d59\": rpc error: code = NotFound desc = could not find container \"57a523172dda083a0b7cc7225d724e5d502819763fa6aee9c90a6fa4cff96d59\": container with ID starting with 57a523172dda083a0b7cc7225d724e5d502819763fa6aee9c90a6fa4cff96d59 not found: ID does not exist" Jul 13 14:55:23.039995 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.039980 2577 scope.go:117] "RemoveContainer" containerID="6e1ba1703e8931e65805ee09dce4a61ef6bfabb46320f8a535b6b546d5474b8d" Jul 13 14:55:23.040184 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:55:23.040169 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e1ba1703e8931e65805ee09dce4a61ef6bfabb46320f8a535b6b546d5474b8d\": container with ID starting with 6e1ba1703e8931e65805ee09dce4a61ef6bfabb46320f8a535b6b546d5474b8d not found: ID does not exist" containerID="6e1ba1703e8931e65805ee09dce4a61ef6bfabb46320f8a535b6b546d5474b8d" Jul 13 14:55:23.040231 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.040186 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e1ba1703e8931e65805ee09dce4a61ef6bfabb46320f8a535b6b546d5474b8d"} err="failed to get container status \"6e1ba1703e8931e65805ee09dce4a61ef6bfabb46320f8a535b6b546d5474b8d\": rpc error: code = NotFound desc = could not find container \"6e1ba1703e8931e65805ee09dce4a61ef6bfabb46320f8a535b6b546d5474b8d\": container with ID starting with 6e1ba1703e8931e65805ee09dce4a61ef6bfabb46320f8a535b6b546d5474b8d not found: ID does not exist" Jul 13 14:55:23.040231 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.040198 2577 scope.go:117] "RemoveContainer" containerID="12686e5def575b75ad6d3cf5e2328b6951d2fe552ed7bb9bf234fbd6eaff3f84" Jul 13 14:55:23.040396 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:55:23.040381 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12686e5def575b75ad6d3cf5e2328b6951d2fe552ed7bb9bf234fbd6eaff3f84\": container with ID starting with 12686e5def575b75ad6d3cf5e2328b6951d2fe552ed7bb9bf234fbd6eaff3f84 not found: ID does not exist" containerID="12686e5def575b75ad6d3cf5e2328b6951d2fe552ed7bb9bf234fbd6eaff3f84" Jul 13 14:55:23.040433 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.040399 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12686e5def575b75ad6d3cf5e2328b6951d2fe552ed7bb9bf234fbd6eaff3f84"} err="failed to get container status \"12686e5def575b75ad6d3cf5e2328b6951d2fe552ed7bb9bf234fbd6eaff3f84\": rpc error: code = NotFound desc = could not find container \"12686e5def575b75ad6d3cf5e2328b6951d2fe552ed7bb9bf234fbd6eaff3f84\": container with ID starting with 12686e5def575b75ad6d3cf5e2328b6951d2fe552ed7bb9bf234fbd6eaff3f84 not found: ID does not exist" Jul 13 14:55:23.040433 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.040410 2577 scope.go:117] "RemoveContainer" containerID="139ac9471a50744c838518c92b9c8abb952cbbdb9a0813d7e8de820e8244f019" Jul 13 14:55:23.040572 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:55:23.040556 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"139ac9471a50744c838518c92b9c8abb952cbbdb9a0813d7e8de820e8244f019\": container with ID starting with 139ac9471a50744c838518c92b9c8abb952cbbdb9a0813d7e8de820e8244f019 not found: ID does not exist" containerID="139ac9471a50744c838518c92b9c8abb952cbbdb9a0813d7e8de820e8244f019" Jul 13 14:55:23.040629 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.040576 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"139ac9471a50744c838518c92b9c8abb952cbbdb9a0813d7e8de820e8244f019"} err="failed to get container status \"139ac9471a50744c838518c92b9c8abb952cbbdb9a0813d7e8de820e8244f019\": rpc error: code = NotFound desc = could not find container \"139ac9471a50744c838518c92b9c8abb952cbbdb9a0813d7e8de820e8244f019\": container with ID starting with 139ac9471a50744c838518c92b9c8abb952cbbdb9a0813d7e8de820e8244f019 not found: ID does not exist" Jul 13 14:55:23.040629 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.040589 2577 scope.go:117] "RemoveContainer" containerID="3a5e5dc45be24ff5e0f211fe803041259257fde117b8ab6a398b9b9195fbe874" Jul 13 14:55:23.040814 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:55:23.040796 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a5e5dc45be24ff5e0f211fe803041259257fde117b8ab6a398b9b9195fbe874\": container with ID starting with 3a5e5dc45be24ff5e0f211fe803041259257fde117b8ab6a398b9b9195fbe874 not found: ID does not exist" containerID="3a5e5dc45be24ff5e0f211fe803041259257fde117b8ab6a398b9b9195fbe874" Jul 13 14:55:23.040860 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.040820 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a5e5dc45be24ff5e0f211fe803041259257fde117b8ab6a398b9b9195fbe874"} err="failed to get container status \"3a5e5dc45be24ff5e0f211fe803041259257fde117b8ab6a398b9b9195fbe874\": rpc error: code = NotFound desc = could not find container \"3a5e5dc45be24ff5e0f211fe803041259257fde117b8ab6a398b9b9195fbe874\": container with ID starting with 3a5e5dc45be24ff5e0f211fe803041259257fde117b8ab6a398b9b9195fbe874 not found: ID does not exist" Jul 13 14:55:23.040860 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.040836 2577 scope.go:117] "RemoveContainer" containerID="b76db4f4686cdb0eef60eefb19492c1b4f1bc261ed0308bc3621385ff29c2eef" Jul 13 14:55:23.041091 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:55:23.041076 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b76db4f4686cdb0eef60eefb19492c1b4f1bc261ed0308bc3621385ff29c2eef\": container with ID starting with b76db4f4686cdb0eef60eefb19492c1b4f1bc261ed0308bc3621385ff29c2eef not found: ID does not exist" containerID="b76db4f4686cdb0eef60eefb19492c1b4f1bc261ed0308bc3621385ff29c2eef" Jul 13 14:55:23.041144 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.041095 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b76db4f4686cdb0eef60eefb19492c1b4f1bc261ed0308bc3621385ff29c2eef"} err="failed to get container status \"b76db4f4686cdb0eef60eefb19492c1b4f1bc261ed0308bc3621385ff29c2eef\": rpc error: code = NotFound desc = could not find container \"b76db4f4686cdb0eef60eefb19492c1b4f1bc261ed0308bc3621385ff29c2eef\": container with ID starting with b76db4f4686cdb0eef60eefb19492c1b4f1bc261ed0308bc3621385ff29c2eef not found: ID does not exist" Jul 13 14:55:23.056396 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.056373 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 14:55:23.056600 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.056589 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerName="alertmanager" Jul 13 14:55:23.056639 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.056602 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerName="alertmanager" Jul 13 14:55:23.056639 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.056609 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerName="config-reloader" Jul 13 14:55:23.056639 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.056615 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerName="config-reloader" Jul 13 14:55:23.056639 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.056622 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerName="kube-rbac-proxy-web" Jul 13 14:55:23.056639 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.056627 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerName="kube-rbac-proxy-web" Jul 13 14:55:23.056639 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.056633 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerName="kube-rbac-proxy" Jul 13 14:55:23.056639 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.056637 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerName="kube-rbac-proxy" Jul 13 14:55:23.056852 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.056646 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerName="init-config-reloader" Jul 13 14:55:23.056852 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.056651 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerName="init-config-reloader" Jul 13 14:55:23.056852 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.056658 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc7eb7ff-4f64-41a9-acd3-5bee54131b50" containerName="console" Jul 13 14:55:23.056852 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.056663 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc7eb7ff-4f64-41a9-acd3-5bee54131b50" containerName="console" Jul 13 14:55:23.056852 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.056669 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerName="kube-rbac-proxy-metric" Jul 13 14:55:23.056852 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.056674 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerName="kube-rbac-proxy-metric" Jul 13 14:55:23.056852 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.056679 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerName="prom-label-proxy" Jul 13 14:55:23.056852 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.056684 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerName="prom-label-proxy" Jul 13 14:55:23.056852 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.056724 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerName="alertmanager" Jul 13 14:55:23.056852 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.056731 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc7eb7ff-4f64-41a9-acd3-5bee54131b50" containerName="console" Jul 13 14:55:23.056852 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.056736 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerName="kube-rbac-proxy-web" Jul 13 14:55:23.056852 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.056741 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerName="kube-rbac-proxy-metric" Jul 13 14:55:23.056852 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.056745 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerName="prom-label-proxy" Jul 13 14:55:23.056852 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.056751 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerName="config-reloader" Jul 13 14:55:23.056852 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.056755 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8874e6f6-1107-463c-9c0b-296d87f076d0" containerName="kube-rbac-proxy" Jul 13 14:55:23.057276 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.057104 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8874e6f6-1107-463c-9c0b-296d87f076d0-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:55:23.057276 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.057121 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:55:23.057276 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.057132 2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-cluster-tls-config\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:55:23.057276 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.057141 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8874e6f6-1107-463c-9c0b-296d87f076d0-alertmanager-main-db\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:55:23.057276 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.057149 2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8874e6f6-1107-463c-9c0b-296d87f076d0-metrics-client-ca\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:55:23.057276 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.057157 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8874e6f6-1107-463c-9c0b-296d87f076d0-tls-assets\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:55:23.057276 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.057165 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-secret-alertmanager-main-tls\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:55:23.057276 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.057174 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:55:23.057276 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.057200 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-web-config\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:55:23.057276 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.057209 2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-config-volume\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:55:23.057276 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.057216 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8874e6f6-1107-463c-9c0b-296d87f076d0-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:55:23.057276 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.057224 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8874e6f6-1107-463c-9c0b-296d87f076d0-config-out\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:55:23.057276 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.057232 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7pmn\" (UniqueName: \"kubernetes.io/projected/8874e6f6-1107-463c-9c0b-296d87f076d0-kube-api-access-w7pmn\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:55:23.059814 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.059800 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.062764 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.062746 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 13 14:55:23.063005 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.062986 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 13 14:55:23.063083 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.063008 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 13 14:55:23.063083 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.062993 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jrfsv\"" Jul 13 14:55:23.063198 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.063184 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 13 14:55:23.063247 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.063202 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 13 14:55:23.063498 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.063482 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 13 14:55:23.063498 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.063489 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 13 14:55:23.063638 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.063500 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 13 14:55:23.070520 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.070502 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 13 14:55:23.077200 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.077178 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 14:55:23.157532 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.157512 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.157653 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.157547 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.157653 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.157576 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.157727 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.157655 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-web-config\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.157760 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.157721 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-config-volume\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.157760 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.157750 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.157843 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.157771 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.157843 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.157834 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.157908 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.157853 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.157908 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.157884 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.158005 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.157933 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.158005 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.157960 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dzf8\" (UniqueName: \"kubernetes.io/projected/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-kube-api-access-9dzf8\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.158005 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.157991 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-config-out\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.258990 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.258936 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.258990 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.258964 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.258990 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.258984 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.259149 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.259004 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.259149 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.259028 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dzf8\" (UniqueName: \"kubernetes.io/projected/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-kube-api-access-9dzf8\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.259149 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.259054 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-config-out\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.259291 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.259175 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.259291 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.259235 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.259291 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.259268 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.259430 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.259299 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-web-config\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.259430 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.259343 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-config-volume\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.259430 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.259377 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.259430 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.259404 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.260007 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.259977 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.260247 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.260223 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.260532 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.260504 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.262074 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.262050 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.262378 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.262350 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.262567 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.262541 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.262567 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.262558 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.262682 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.262544 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-config-volume\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.262682 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.262621 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.262682 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.262659 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-config-out\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.263251 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.263230 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.263822 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.263802 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-web-config\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.269347 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.269329 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dzf8\" (UniqueName: \"kubernetes.io/projected/ec89a4f4-701c-4b8e-9ab4-113c6e8e0003-kube-api-access-9dzf8\") pod \"alertmanager-main-0\" (UID: \"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003\") " pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.344516 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.344493 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8874e6f6-1107-463c-9c0b-296d87f076d0" path="/var/lib/kubelet/pods/8874e6f6-1107-463c-9c0b-296d87f076d0/volumes" Jul 13 14:55:23.368522 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.368504 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 13 14:55:23.500171 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:23.500149 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 13 14:55:23.502469 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:55:23.502443 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec89a4f4_701c_4b8e_9ab4_113c6e8e0003.slice/crio-023105c9dd007ba09d04d80024ffd967decc5f20b2cb3ce1906094ff65943275 WatchSource:0}: Error finding container 023105c9dd007ba09d04d80024ffd967decc5f20b2cb3ce1906094ff65943275: Status 404 returned error can't find the container with id 023105c9dd007ba09d04d80024ffd967decc5f20b2cb3ce1906094ff65943275 Jul 13 14:55:24.000841 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:24.000811 2577 generic.go:356] "Generic (PLEG): container finished" podID="ec89a4f4-701c-4b8e-9ab4-113c6e8e0003" containerID="67bc00f60d11919463a0016152cf91fc8907f1ef77fc777b396a7c565280a081" exitCode=0 Jul 13 14:55:24.001200 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:24.000879 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003","Type":"ContainerDied","Data":"67bc00f60d11919463a0016152cf91fc8907f1ef77fc777b396a7c565280a081"} Jul 13 14:55:24.001200 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:24.000934 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003","Type":"ContainerStarted","Data":"023105c9dd007ba09d04d80024ffd967decc5f20b2cb3ce1906094ff65943275"} Jul 13 14:55:25.009434 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:25.009398 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003","Type":"ContainerStarted","Data":"a136b49a2bf0e9bc2a4bb40885c049a079cc9f63ba3be6b01e4e14e8dadfc17f"} Jul 13 14:55:25.009960 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:25.009493 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003","Type":"ContainerStarted","Data":"64409ad2859b7ec90017922ca364f67fdcfd145f4c9e0a9a6eee9a2eb4dd89ca"} Jul 13 14:55:25.009960 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:25.009521 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003","Type":"ContainerStarted","Data":"2d75c1b849764374952a52ad8e556298541d467231d787ec6f0fb413fef18e5f"} Jul 13 14:55:25.009960 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:25.009547 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003","Type":"ContainerStarted","Data":"d66f6c7f1f61200e069f4faa06d36226910429f3d921530772d1943dfb869764"} Jul 13 14:55:25.009960 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:25.009569 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003","Type":"ContainerStarted","Data":"d92dccbdd94dd33319e024dcf616115f5b4b1d177709e6a0a9433a907eb0c3b1"} Jul 13 14:55:25.009960 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:25.009593 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec89a4f4-701c-4b8e-9ab4-113c6e8e0003","Type":"ContainerStarted","Data":"4befd29bfa110c885428d8df2cd2395e8620f0506f49d73d51332d2e19975ac0"} Jul 13 14:55:25.040865 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:25.040801 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.026086482 podStartE2EDuration="2.040762297s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.675815ms" isStatefulPod=false podCreationTimestamp="2026-07-13 14:55:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:55:25.04026987 +0000 UTC m=+149.106842334" watchObservedRunningTime="2026-07-13 14:55:25.040762297 +0000 UTC m=+149.107334765" Jul 13 14:55:38.457314 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:38.457284 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c77f6d798-vk8dx"] Jul 13 14:55:38.459614 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:38.459598 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c77f6d798-vk8dx" Jul 13 14:55:38.480619 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:38.480594 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c77f6d798-vk8dx"] Jul 13 14:55:38.571904 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:38.571875 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnp2p\" (UniqueName: \"kubernetes.io/projected/4f783bee-3b51-4f26-a438-2481add86752-kube-api-access-bnp2p\") pod \"console-6c77f6d798-vk8dx\" (UID: \"4f783bee-3b51-4f26-a438-2481add86752\") " pod="openshift-console/console-6c77f6d798-vk8dx" Jul 13 14:55:38.572065 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:38.571913 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f783bee-3b51-4f26-a438-2481add86752-service-ca\") pod \"console-6c77f6d798-vk8dx\" (UID: \"4f783bee-3b51-4f26-a438-2481add86752\") " pod="openshift-console/console-6c77f6d798-vk8dx" Jul 13 14:55:38.572065 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:38.571935 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f783bee-3b51-4f26-a438-2481add86752-console-oauth-config\") pod \"console-6c77f6d798-vk8dx\" (UID: \"4f783bee-3b51-4f26-a438-2481add86752\") " pod="openshift-console/console-6c77f6d798-vk8dx" Jul 13 14:55:38.572065 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:38.571954 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f783bee-3b51-4f26-a438-2481add86752-console-serving-cert\") pod \"console-6c77f6d798-vk8dx\" (UID: \"4f783bee-3b51-4f26-a438-2481add86752\") " pod="openshift-console/console-6c77f6d798-vk8dx" Jul 13 14:55:38.572065 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:38.572022 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f783bee-3b51-4f26-a438-2481add86752-oauth-serving-cert\") pod \"console-6c77f6d798-vk8dx\" (UID: \"4f783bee-3b51-4f26-a438-2481add86752\") " pod="openshift-console/console-6c77f6d798-vk8dx" Jul 13 14:55:38.572225 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:38.572073 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f783bee-3b51-4f26-a438-2481add86752-console-config\") pod \"console-6c77f6d798-vk8dx\" (UID: \"4f783bee-3b51-4f26-a438-2481add86752\") " pod="openshift-console/console-6c77f6d798-vk8dx" Jul 13 14:55:38.572225 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:38.572109 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f783bee-3b51-4f26-a438-2481add86752-trusted-ca-bundle\") pod \"console-6c77f6d798-vk8dx\" (UID: \"4f783bee-3b51-4f26-a438-2481add86752\") " pod="openshift-console/console-6c77f6d798-vk8dx" Jul 13 14:55:38.672556 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:38.672533 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f783bee-3b51-4f26-a438-2481add86752-console-oauth-config\") pod \"console-6c77f6d798-vk8dx\" (UID: \"4f783bee-3b51-4f26-a438-2481add86752\") " pod="openshift-console/console-6c77f6d798-vk8dx" Jul 13 14:55:38.672689 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:38.672561 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f783bee-3b51-4f26-a438-2481add86752-console-serving-cert\") pod \"console-6c77f6d798-vk8dx\" (UID: \"4f783bee-3b51-4f26-a438-2481add86752\") " pod="openshift-console/console-6c77f6d798-vk8dx" Jul 13 14:55:38.672689 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:38.672583 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f783bee-3b51-4f26-a438-2481add86752-oauth-serving-cert\") pod \"console-6c77f6d798-vk8dx\" (UID: \"4f783bee-3b51-4f26-a438-2481add86752\") " pod="openshift-console/console-6c77f6d798-vk8dx" Jul 13 14:55:38.672814 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:38.672694 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f783bee-3b51-4f26-a438-2481add86752-console-config\") pod \"console-6c77f6d798-vk8dx\" (UID: \"4f783bee-3b51-4f26-a438-2481add86752\") " pod="openshift-console/console-6c77f6d798-vk8dx" Jul 13 14:55:38.672814 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:38.672733 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f783bee-3b51-4f26-a438-2481add86752-trusted-ca-bundle\") pod \"console-6c77f6d798-vk8dx\" (UID: \"4f783bee-3b51-4f26-a438-2481add86752\") " pod="openshift-console/console-6c77f6d798-vk8dx" Jul 13 14:55:38.672814 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:38.672756 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnp2p\" (UniqueName: \"kubernetes.io/projected/4f783bee-3b51-4f26-a438-2481add86752-kube-api-access-bnp2p\") pod \"console-6c77f6d798-vk8dx\" (UID: \"4f783bee-3b51-4f26-a438-2481add86752\") " pod="openshift-console/console-6c77f6d798-vk8dx" Jul 13 14:55:38.672814 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:38.672795 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f783bee-3b51-4f26-a438-2481add86752-service-ca\") pod \"console-6c77f6d798-vk8dx\" (UID: \"4f783bee-3b51-4f26-a438-2481add86752\") " pod="openshift-console/console-6c77f6d798-vk8dx" Jul 13 14:55:38.673417 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:38.673392 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f783bee-3b51-4f26-a438-2481add86752-oauth-serving-cert\") pod \"console-6c77f6d798-vk8dx\" (UID: \"4f783bee-3b51-4f26-a438-2481add86752\") " pod="openshift-console/console-6c77f6d798-vk8dx" Jul 13 14:55:38.673417 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:38.673405 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f783bee-3b51-4f26-a438-2481add86752-console-config\") pod \"console-6c77f6d798-vk8dx\" (UID: \"4f783bee-3b51-4f26-a438-2481add86752\") " pod="openshift-console/console-6c77f6d798-vk8dx" Jul 13 14:55:38.673569 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:38.673501 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f783bee-3b51-4f26-a438-2481add86752-service-ca\") pod \"console-6c77f6d798-vk8dx\" (UID: \"4f783bee-3b51-4f26-a438-2481add86752\") " pod="openshift-console/console-6c77f6d798-vk8dx" Jul 13 14:55:38.673569 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:38.673545 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f783bee-3b51-4f26-a438-2481add86752-trusted-ca-bundle\") pod \"console-6c77f6d798-vk8dx\" (UID: \"4f783bee-3b51-4f26-a438-2481add86752\") " pod="openshift-console/console-6c77f6d798-vk8dx" Jul 13 14:55:38.675068 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:38.675047 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f783bee-3b51-4f26-a438-2481add86752-console-oauth-config\") pod \"console-6c77f6d798-vk8dx\" (UID: \"4f783bee-3b51-4f26-a438-2481add86752\") " pod="openshift-console/console-6c77f6d798-vk8dx" Jul 13 14:55:38.675166 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:38.675139 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f783bee-3b51-4f26-a438-2481add86752-console-serving-cert\") pod \"console-6c77f6d798-vk8dx\" (UID: \"4f783bee-3b51-4f26-a438-2481add86752\") " pod="openshift-console/console-6c77f6d798-vk8dx" Jul 13 14:55:38.681736 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:38.681717 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnp2p\" (UniqueName: \"kubernetes.io/projected/4f783bee-3b51-4f26-a438-2481add86752-kube-api-access-bnp2p\") pod \"console-6c77f6d798-vk8dx\" (UID: \"4f783bee-3b51-4f26-a438-2481add86752\") " pod="openshift-console/console-6c77f6d798-vk8dx" Jul 13 14:55:38.768682 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:38.768632 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c77f6d798-vk8dx" Jul 13 14:55:38.894038 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:38.893922 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c77f6d798-vk8dx"] Jul 13 14:55:38.896742 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:55:38.896712 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f783bee_3b51_4f26_a438_2481add86752.slice/crio-5673a0128c2084838c08a78acb78275a4a137b1ea7f53bea601c0a2b4213ef47 WatchSource:0}: Error finding container 5673a0128c2084838c08a78acb78275a4a137b1ea7f53bea601c0a2b4213ef47: Status 404 returned error can't find the container with id 5673a0128c2084838c08a78acb78275a4a137b1ea7f53bea601c0a2b4213ef47 Jul 13 14:55:39.062452 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:39.062369 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c77f6d798-vk8dx" event={"ID":"4f783bee-3b51-4f26-a438-2481add86752","Type":"ContainerStarted","Data":"935f6b3e0f29d436cb1399baeebdb401744cf8d6c53cea366004bdc5b978a4c8"} Jul 13 14:55:39.062452 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:39.062422 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c77f6d798-vk8dx" event={"ID":"4f783bee-3b51-4f26-a438-2481add86752","Type":"ContainerStarted","Data":"5673a0128c2084838c08a78acb78275a4a137b1ea7f53bea601c0a2b4213ef47"} Jul 13 14:55:39.085293 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:39.085244 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c77f6d798-vk8dx" podStartSLOduration=1.085229018 podStartE2EDuration="1.085229018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:55:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:55:39.084963993 +0000 UTC m=+163.151536482" watchObservedRunningTime="2026-07-13 14:55:39.085229018 +0000 UTC m=+163.151801483" Jul 13 14:55:48.769190 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:48.769102 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c77f6d798-vk8dx" Jul 13 14:55:48.769190 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:48.769169 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c77f6d798-vk8dx" Jul 13 14:55:48.773832 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:48.773811 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c77f6d798-vk8dx" Jul 13 14:55:49.101740 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:49.101660 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c77f6d798-vk8dx" Jul 13 14:55:49.154342 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:55:49.154313 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c74fd575-fglnw"] Jul 13 14:56:14.174551 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:14.174506 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c74fd575-fglnw" podUID="ea4dc910-ae2d-49f1-ade8-57659294a7ea" containerName="console" containerID="cri-o://b8bc28af757e06805533666b645641e15b767095c74f5f66f57d0af06077cdfe" gracePeriod=15 Jul 13 14:56:14.404085 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:14.404064 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c74fd575-fglnw" Jul 13 14:56:14.537457 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:14.537370 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea4dc910-ae2d-49f1-ade8-57659294a7ea-service-ca\") pod \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\" (UID: \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\") " Jul 13 14:56:14.537457 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:14.537434 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea4dc910-ae2d-49f1-ade8-57659294a7ea-trusted-ca-bundle\") pod \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\" (UID: \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\") " Jul 13 14:56:14.537670 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:14.537474 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea4dc910-ae2d-49f1-ade8-57659294a7ea-console-serving-cert\") pod \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\" (UID: \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\") " Jul 13 14:56:14.537670 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:14.537534 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea4dc910-ae2d-49f1-ade8-57659294a7ea-console-config\") pod \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\" (UID: \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\") " Jul 13 14:56:14.537670 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:14.537564 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrhcr\" (UniqueName: \"kubernetes.io/projected/ea4dc910-ae2d-49f1-ade8-57659294a7ea-kube-api-access-xrhcr\") pod \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\" (UID: \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\") " Jul 13 14:56:14.537670 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:14.537597 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea4dc910-ae2d-49f1-ade8-57659294a7ea-console-oauth-config\") pod \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\" (UID: \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\") " Jul 13 14:56:14.537670 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:14.537620 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea4dc910-ae2d-49f1-ade8-57659294a7ea-oauth-serving-cert\") pod \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\" (UID: \"ea4dc910-ae2d-49f1-ade8-57659294a7ea\") " Jul 13 14:56:14.537933 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:14.537802 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea4dc910-ae2d-49f1-ade8-57659294a7ea-service-ca" (OuterVolumeSpecName: "service-ca") pod "ea4dc910-ae2d-49f1-ade8-57659294a7ea" (UID: "ea4dc910-ae2d-49f1-ade8-57659294a7ea"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:56:14.537933 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:14.537891 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea4dc910-ae2d-49f1-ade8-57659294a7ea-service-ca\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:56:14.538037 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:14.537932 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea4dc910-ae2d-49f1-ade8-57659294a7ea-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ea4dc910-ae2d-49f1-ade8-57659294a7ea" (UID: "ea4dc910-ae2d-49f1-ade8-57659294a7ea"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:56:14.538037 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:14.537946 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea4dc910-ae2d-49f1-ade8-57659294a7ea-console-config" (OuterVolumeSpecName: "console-config") pod "ea4dc910-ae2d-49f1-ade8-57659294a7ea" (UID: "ea4dc910-ae2d-49f1-ade8-57659294a7ea"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:56:14.538167 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:14.538144 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea4dc910-ae2d-49f1-ade8-57659294a7ea-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ea4dc910-ae2d-49f1-ade8-57659294a7ea" (UID: "ea4dc910-ae2d-49f1-ade8-57659294a7ea"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:56:14.539757 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:14.539734 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea4dc910-ae2d-49f1-ade8-57659294a7ea-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ea4dc910-ae2d-49f1-ade8-57659294a7ea" (UID: "ea4dc910-ae2d-49f1-ade8-57659294a7ea"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:56:14.539869 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:14.539800 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea4dc910-ae2d-49f1-ade8-57659294a7ea-kube-api-access-xrhcr" (OuterVolumeSpecName: "kube-api-access-xrhcr") pod "ea4dc910-ae2d-49f1-ade8-57659294a7ea" (UID: "ea4dc910-ae2d-49f1-ade8-57659294a7ea"). InnerVolumeSpecName "kube-api-access-xrhcr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 14:56:14.539869 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:14.539856 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea4dc910-ae2d-49f1-ade8-57659294a7ea-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ea4dc910-ae2d-49f1-ade8-57659294a7ea" (UID: "ea4dc910-ae2d-49f1-ade8-57659294a7ea"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:56:14.638566 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:14.638532 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea4dc910-ae2d-49f1-ade8-57659294a7ea-trusted-ca-bundle\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:56:14.638566 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:14.638559 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea4dc910-ae2d-49f1-ade8-57659294a7ea-console-serving-cert\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:56:14.638566 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:14.638569 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea4dc910-ae2d-49f1-ade8-57659294a7ea-console-config\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:56:14.638771 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:14.638579 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrhcr\" (UniqueName: \"kubernetes.io/projected/ea4dc910-ae2d-49f1-ade8-57659294a7ea-kube-api-access-xrhcr\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:56:14.638771 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:14.638588 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea4dc910-ae2d-49f1-ade8-57659294a7ea-console-oauth-config\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:56:14.638771 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:14.638596 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea4dc910-ae2d-49f1-ade8-57659294a7ea-oauth-serving-cert\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:56:15.192304 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:15.192268 2577 generic.go:356] "Generic (PLEG): container finished" podID="ea4dc910-ae2d-49f1-ade8-57659294a7ea" containerID="b8bc28af757e06805533666b645641e15b767095c74f5f66f57d0af06077cdfe" exitCode=0 Jul 13 14:56:15.192768 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:15.192324 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c74fd575-fglnw" Jul 13 14:56:15.192768 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:15.192352 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c74fd575-fglnw" event={"ID":"ea4dc910-ae2d-49f1-ade8-57659294a7ea","Type":"ContainerDied","Data":"b8bc28af757e06805533666b645641e15b767095c74f5f66f57d0af06077cdfe"} Jul 13 14:56:15.192768 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:15.192409 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c74fd575-fglnw" event={"ID":"ea4dc910-ae2d-49f1-ade8-57659294a7ea","Type":"ContainerDied","Data":"f80010ad5d498e955696205d3b7b1b1db622fd883fa20a75722d4e5e91c87007"} Jul 13 14:56:15.192768 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:15.192431 2577 scope.go:117] "RemoveContainer" containerID="b8bc28af757e06805533666b645641e15b767095c74f5f66f57d0af06077cdfe" Jul 13 14:56:15.204881 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:15.204865 2577 scope.go:117] "RemoveContainer" containerID="b8bc28af757e06805533666b645641e15b767095c74f5f66f57d0af06077cdfe" Jul 13 14:56:15.205140 ip-10-0-134-237 kubenswrapper[2577]: E0713 14:56:15.205122 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8bc28af757e06805533666b645641e15b767095c74f5f66f57d0af06077cdfe\": container with ID starting with b8bc28af757e06805533666b645641e15b767095c74f5f66f57d0af06077cdfe not found: ID does not exist" containerID="b8bc28af757e06805533666b645641e15b767095c74f5f66f57d0af06077cdfe" Jul 13 14:56:15.205176 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:15.205148 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8bc28af757e06805533666b645641e15b767095c74f5f66f57d0af06077cdfe"} err="failed to get container status \"b8bc28af757e06805533666b645641e15b767095c74f5f66f57d0af06077cdfe\": rpc error: code = NotFound desc = could not find container \"b8bc28af757e06805533666b645641e15b767095c74f5f66f57d0af06077cdfe\": container with ID starting with b8bc28af757e06805533666b645641e15b767095c74f5f66f57d0af06077cdfe not found: ID does not exist" Jul 13 14:56:15.216529 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:15.216506 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c74fd575-fglnw"] Jul 13 14:56:15.220480 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:15.220462 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c74fd575-fglnw"] Jul 13 14:56:15.343479 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:15.343450 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea4dc910-ae2d-49f1-ade8-57659294a7ea" path="/var/lib/kubelet/pods/ea4dc910-ae2d-49f1-ade8-57659294a7ea/volumes" Jul 13 14:56:40.639969 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:40.639940 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2"] Jul 13 14:56:40.640416 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:40.640219 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea4dc910-ae2d-49f1-ade8-57659294a7ea" containerName="console" Jul 13 14:56:40.640416 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:40.640229 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea4dc910-ae2d-49f1-ade8-57659294a7ea" containerName="console" Jul 13 14:56:40.640416 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:40.640276 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea4dc910-ae2d-49f1-ade8-57659294a7ea" containerName="console" Jul 13 14:56:40.642481 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:40.642465 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2" Jul 13 14:56:40.644999 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:40.644975 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 14:56:40.644999 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:40.644992 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 14:56:40.645157 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:40.644992 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zgw9t\"" Jul 13 14:56:40.653907 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:40.653882 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2"] Jul 13 14:56:40.735606 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:40.735574 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4tx5\" (UniqueName: \"kubernetes.io/projected/748f5852-0848-4b86-97ea-d6c6d15755aa-kube-api-access-z4tx5\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2\" (UID: \"748f5852-0848-4b86-97ea-d6c6d15755aa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2" Jul 13 14:56:40.735745 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:40.735612 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/748f5852-0848-4b86-97ea-d6c6d15755aa-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2\" (UID: \"748f5852-0848-4b86-97ea-d6c6d15755aa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2" Jul 13 14:56:40.735745 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:40.735702 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/748f5852-0848-4b86-97ea-d6c6d15755aa-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2\" (UID: \"748f5852-0848-4b86-97ea-d6c6d15755aa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2" Jul 13 14:56:40.836242 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:40.836218 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4tx5\" (UniqueName: \"kubernetes.io/projected/748f5852-0848-4b86-97ea-d6c6d15755aa-kube-api-access-z4tx5\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2\" (UID: \"748f5852-0848-4b86-97ea-d6c6d15755aa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2" Jul 13 14:56:40.836313 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:40.836246 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/748f5852-0848-4b86-97ea-d6c6d15755aa-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2\" (UID: \"748f5852-0848-4b86-97ea-d6c6d15755aa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2" Jul 13 14:56:40.836313 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:40.836280 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/748f5852-0848-4b86-97ea-d6c6d15755aa-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2\" (UID: \"748f5852-0848-4b86-97ea-d6c6d15755aa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2" Jul 13 14:56:40.836588 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:40.836570 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/748f5852-0848-4b86-97ea-d6c6d15755aa-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2\" (UID: \"748f5852-0848-4b86-97ea-d6c6d15755aa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2" Jul 13 14:56:40.836660 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:40.836603 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/748f5852-0848-4b86-97ea-d6c6d15755aa-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2\" (UID: \"748f5852-0848-4b86-97ea-d6c6d15755aa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2" Jul 13 14:56:40.845333 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:40.845311 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4tx5\" (UniqueName: \"kubernetes.io/projected/748f5852-0848-4b86-97ea-d6c6d15755aa-kube-api-access-z4tx5\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2\" (UID: \"748f5852-0848-4b86-97ea-d6c6d15755aa\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2" Jul 13 14:56:40.951094 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:40.951066 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2" Jul 13 14:56:41.076568 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:41.076532 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2"] Jul 13 14:56:41.078948 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:56:41.078917 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod748f5852_0848_4b86_97ea_d6c6d15755aa.slice/crio-d2312d1ef1ff031c406c00a0aa2a9dda22423c6272231353f76034f7287571c6 WatchSource:0}: Error finding container d2312d1ef1ff031c406c00a0aa2a9dda22423c6272231353f76034f7287571c6: Status 404 returned error can't find the container with id d2312d1ef1ff031c406c00a0aa2a9dda22423c6272231353f76034f7287571c6 Jul 13 14:56:41.286969 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:41.286891 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2" event={"ID":"748f5852-0848-4b86-97ea-d6c6d15755aa","Type":"ContainerStarted","Data":"d2312d1ef1ff031c406c00a0aa2a9dda22423c6272231353f76034f7287571c6"} Jul 13 14:56:48.314657 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:48.314616 2577 generic.go:356] "Generic (PLEG): container finished" podID="748f5852-0848-4b86-97ea-d6c6d15755aa" containerID="a51636eeb935dc759fb9939ed25501c31dc6b23b9ff450b8e490b3ed3ae6d20a" exitCode=0 Jul 13 14:56:48.315045 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:48.314693 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2" event={"ID":"748f5852-0848-4b86-97ea-d6c6d15755aa","Type":"ContainerDied","Data":"a51636eeb935dc759fb9939ed25501c31dc6b23b9ff450b8e490b3ed3ae6d20a"} Jul 13 14:56:51.326522 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:51.326484 2577 generic.go:356] "Generic (PLEG): container finished" podID="748f5852-0848-4b86-97ea-d6c6d15755aa" containerID="d41ab183fe140facea34adc7789b0cf3860b75a9ef7f806156c4a52824565626" exitCode=0 Jul 13 14:56:51.326936 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:51.326575 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2" event={"ID":"748f5852-0848-4b86-97ea-d6c6d15755aa","Type":"ContainerDied","Data":"d41ab183fe140facea34adc7789b0cf3860b75a9ef7f806156c4a52824565626"} Jul 13 14:56:58.352329 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:58.352301 2577 generic.go:356] "Generic (PLEG): container finished" podID="748f5852-0848-4b86-97ea-d6c6d15755aa" containerID="f0dd4ec57c934145b82ebe155dd01928736691e2a6a999e03e565e5c7100d47f" exitCode=0 Jul 13 14:56:58.352650 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:58.352387 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2" event={"ID":"748f5852-0848-4b86-97ea-d6c6d15755aa","Type":"ContainerDied","Data":"f0dd4ec57c934145b82ebe155dd01928736691e2a6a999e03e565e5c7100d47f"} Jul 13 14:56:59.485499 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:59.485476 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2" Jul 13 14:56:59.598595 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:59.598566 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4tx5\" (UniqueName: \"kubernetes.io/projected/748f5852-0848-4b86-97ea-d6c6d15755aa-kube-api-access-z4tx5\") pod \"748f5852-0848-4b86-97ea-d6c6d15755aa\" (UID: \"748f5852-0848-4b86-97ea-d6c6d15755aa\") " Jul 13 14:56:59.598802 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:59.598620 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/748f5852-0848-4b86-97ea-d6c6d15755aa-util\") pod \"748f5852-0848-4b86-97ea-d6c6d15755aa\" (UID: \"748f5852-0848-4b86-97ea-d6c6d15755aa\") " Jul 13 14:56:59.598802 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:59.598650 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/748f5852-0848-4b86-97ea-d6c6d15755aa-bundle\") pod \"748f5852-0848-4b86-97ea-d6c6d15755aa\" (UID: \"748f5852-0848-4b86-97ea-d6c6d15755aa\") " Jul 13 14:56:59.599325 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:59.599301 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/748f5852-0848-4b86-97ea-d6c6d15755aa-bundle" (OuterVolumeSpecName: "bundle") pod "748f5852-0848-4b86-97ea-d6c6d15755aa" (UID: "748f5852-0848-4b86-97ea-d6c6d15755aa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 14:56:59.600842 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:59.600820 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/748f5852-0848-4b86-97ea-d6c6d15755aa-kube-api-access-z4tx5" (OuterVolumeSpecName: "kube-api-access-z4tx5") pod "748f5852-0848-4b86-97ea-d6c6d15755aa" (UID: "748f5852-0848-4b86-97ea-d6c6d15755aa"). InnerVolumeSpecName "kube-api-access-z4tx5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 14:56:59.603406 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:59.603386 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/748f5852-0848-4b86-97ea-d6c6d15755aa-util" (OuterVolumeSpecName: "util") pod "748f5852-0848-4b86-97ea-d6c6d15755aa" (UID: "748f5852-0848-4b86-97ea-d6c6d15755aa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 14:56:59.700054 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:59.700022 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4tx5\" (UniqueName: \"kubernetes.io/projected/748f5852-0848-4b86-97ea-d6c6d15755aa-kube-api-access-z4tx5\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:56:59.700054 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:59.700045 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/748f5852-0848-4b86-97ea-d6c6d15755aa-util\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:56:59.700054 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:56:59.700054 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/748f5852-0848-4b86-97ea-d6c6d15755aa-bundle\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:57:00.361288 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:00.361260 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2" Jul 13 14:57:00.361429 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:00.361260 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540c44n2" event={"ID":"748f5852-0848-4b86-97ea-d6c6d15755aa","Type":"ContainerDied","Data":"d2312d1ef1ff031c406c00a0aa2a9dda22423c6272231353f76034f7287571c6"} Jul 13 14:57:00.361429 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:00.361374 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2312d1ef1ff031c406c00a0aa2a9dda22423c6272231353f76034f7287571c6" Jul 13 14:57:03.361999 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:03.361968 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fn2hn"] Jul 13 14:57:03.362363 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:03.362222 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="748f5852-0848-4b86-97ea-d6c6d15755aa" containerName="util" Jul 13 14:57:03.362363 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:03.362233 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="748f5852-0848-4b86-97ea-d6c6d15755aa" containerName="util" Jul 13 14:57:03.362363 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:03.362243 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="748f5852-0848-4b86-97ea-d6c6d15755aa" containerName="pull" Jul 13 14:57:03.362363 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:03.362248 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="748f5852-0848-4b86-97ea-d6c6d15755aa" containerName="pull" Jul 13 14:57:03.362363 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:03.362256 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="748f5852-0848-4b86-97ea-d6c6d15755aa" containerName="extract" Jul 13 14:57:03.362363 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:03.362262 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="748f5852-0848-4b86-97ea-d6c6d15755aa" containerName="extract" Jul 13 14:57:03.362363 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:03.362303 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="748f5852-0848-4b86-97ea-d6c6d15755aa" containerName="extract" Jul 13 14:57:03.410159 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:03.410132 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fn2hn"] Jul 13 14:57:03.410306 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:03.410222 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fn2hn" Jul 13 14:57:03.412889 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:03.412867 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 13 14:57:03.413023 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:03.412892 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-zj8v2\"" Jul 13 14:57:03.413023 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:03.412898 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 13 14:57:03.529789 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:03.529741 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlwvm\" (UniqueName: \"kubernetes.io/projected/9bdec5f2-b63f-4172-b782-361367ef8bc0-kube-api-access-rlwvm\") pod \"cert-manager-operator-controller-manager-55c444bf86-fn2hn\" (UID: \"9bdec5f2-b63f-4172-b782-361367ef8bc0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fn2hn" Jul 13 14:57:03.529789 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:03.529794 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9bdec5f2-b63f-4172-b782-361367ef8bc0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fn2hn\" (UID: \"9bdec5f2-b63f-4172-b782-361367ef8bc0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fn2hn" Jul 13 14:57:03.630874 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:03.630753 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9bdec5f2-b63f-4172-b782-361367ef8bc0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fn2hn\" (UID: \"9bdec5f2-b63f-4172-b782-361367ef8bc0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fn2hn" Jul 13 14:57:03.631019 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:03.630872 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlwvm\" (UniqueName: \"kubernetes.io/projected/9bdec5f2-b63f-4172-b782-361367ef8bc0-kube-api-access-rlwvm\") pod \"cert-manager-operator-controller-manager-55c444bf86-fn2hn\" (UID: \"9bdec5f2-b63f-4172-b782-361367ef8bc0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fn2hn" Jul 13 14:57:03.631155 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:03.631133 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9bdec5f2-b63f-4172-b782-361367ef8bc0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fn2hn\" (UID: \"9bdec5f2-b63f-4172-b782-361367ef8bc0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fn2hn" Jul 13 14:57:03.643861 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:03.643832 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlwvm\" (UniqueName: \"kubernetes.io/projected/9bdec5f2-b63f-4172-b782-361367ef8bc0-kube-api-access-rlwvm\") pod \"cert-manager-operator-controller-manager-55c444bf86-fn2hn\" (UID: \"9bdec5f2-b63f-4172-b782-361367ef8bc0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fn2hn" Jul 13 14:57:03.718826 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:03.718790 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fn2hn" Jul 13 14:57:03.863279 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:03.863247 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fn2hn"] Jul 13 14:57:03.866840 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:57:03.866808 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bdec5f2_b63f_4172_b782_361367ef8bc0.slice/crio-f9e5816412c76aba90f490e5ae26724edc02fb50ebed25c8fa6482713993810e WatchSource:0}: Error finding container f9e5816412c76aba90f490e5ae26724edc02fb50ebed25c8fa6482713993810e: Status 404 returned error can't find the container with id f9e5816412c76aba90f490e5ae26724edc02fb50ebed25c8fa6482713993810e Jul 13 14:57:04.374647 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:04.374611 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fn2hn" event={"ID":"9bdec5f2-b63f-4172-b782-361367ef8bc0","Type":"ContainerStarted","Data":"f9e5816412c76aba90f490e5ae26724edc02fb50ebed25c8fa6482713993810e"} Jul 13 14:57:06.383811 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:06.383714 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fn2hn" event={"ID":"9bdec5f2-b63f-4172-b782-361367ef8bc0","Type":"ContainerStarted","Data":"47ee84911bad0c3a1ca34213a2dc7b680c4c513208f44dbdeb6af885b7bab8e5"} Jul 13 14:57:06.406292 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:06.406240 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fn2hn" podStartSLOduration=1.37202109 podStartE2EDuration="3.406224238s" totalImagesPullingTime="2.034203148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:57:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:57:06.403963165 +0000 UTC m=+250.470535630" watchObservedRunningTime="2026-07-13 14:57:06.406224238 +0000 UTC m=+250.472796704" Jul 13 14:57:07.496028 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:07.495992 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9"] Jul 13 14:57:07.516151 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:07.516125 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9"] Jul 13 14:57:07.516284 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:07.516220 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9" Jul 13 14:57:07.518895 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:07.518867 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 14:57:07.519014 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:07.518871 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 14:57:07.519880 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:07.519858 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zgw9t\"" Jul 13 14:57:07.564456 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:07.564432 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/271bdf44-944a-4457-8f18-16e9b9bfe67f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9\" (UID: \"271bdf44-944a-4457-8f18-16e9b9bfe67f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9" Jul 13 14:57:07.564598 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:07.564489 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfrvd\" (UniqueName: \"kubernetes.io/projected/271bdf44-944a-4457-8f18-16e9b9bfe67f-kube-api-access-dfrvd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9\" (UID: \"271bdf44-944a-4457-8f18-16e9b9bfe67f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9" Jul 13 14:57:07.564598 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:07.564526 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/271bdf44-944a-4457-8f18-16e9b9bfe67f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9\" (UID: \"271bdf44-944a-4457-8f18-16e9b9bfe67f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9" Jul 13 14:57:07.665738 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:07.665705 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfrvd\" (UniqueName: \"kubernetes.io/projected/271bdf44-944a-4457-8f18-16e9b9bfe67f-kube-api-access-dfrvd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9\" (UID: \"271bdf44-944a-4457-8f18-16e9b9bfe67f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9" Jul 13 14:57:07.665913 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:07.665744 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/271bdf44-944a-4457-8f18-16e9b9bfe67f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9\" (UID: \"271bdf44-944a-4457-8f18-16e9b9bfe67f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9" Jul 13 14:57:07.665913 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:07.665817 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/271bdf44-944a-4457-8f18-16e9b9bfe67f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9\" (UID: \"271bdf44-944a-4457-8f18-16e9b9bfe67f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9" Jul 13 14:57:07.666123 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:07.666105 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/271bdf44-944a-4457-8f18-16e9b9bfe67f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9\" (UID: \"271bdf44-944a-4457-8f18-16e9b9bfe67f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9" Jul 13 14:57:07.666175 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:07.666140 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/271bdf44-944a-4457-8f18-16e9b9bfe67f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9\" (UID: \"271bdf44-944a-4457-8f18-16e9b9bfe67f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9" Jul 13 14:57:07.678711 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:07.678689 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfrvd\" (UniqueName: \"kubernetes.io/projected/271bdf44-944a-4457-8f18-16e9b9bfe67f-kube-api-access-dfrvd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9\" (UID: \"271bdf44-944a-4457-8f18-16e9b9bfe67f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9" Jul 13 14:57:07.825848 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:07.825750 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9" Jul 13 14:57:07.977986 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:07.977963 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9"] Jul 13 14:57:07.980409 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:57:07.980381 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod271bdf44_944a_4457_8f18_16e9b9bfe67f.slice/crio-573a0681070c55cfe0cbbd73fbd31b7a11a356f43532e97389360bd3bb1d06c6 WatchSource:0}: Error finding container 573a0681070c55cfe0cbbd73fbd31b7a11a356f43532e97389360bd3bb1d06c6: Status 404 returned error can't find the container with id 573a0681070c55cfe0cbbd73fbd31b7a11a356f43532e97389360bd3bb1d06c6 Jul 13 14:57:08.177664 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:08.177630 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-d7h5c"] Jul 13 14:57:08.193636 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:08.193600 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-d7h5c"] Jul 13 14:57:08.193802 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:08.193701 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-d7h5c" Jul 13 14:57:08.196301 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:08.196280 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-c2pr6\"" Jul 13 14:57:08.196436 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:08.196280 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 13 14:57:08.196436 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:08.196370 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 13 14:57:08.271894 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:08.271868 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0134ebd-2015-4898-854c-0f15ccc34d47-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-d7h5c\" (UID: \"e0134ebd-2015-4898-854c-0f15ccc34d47\") " pod="cert-manager/cert-manager-webhook-6486ffd997-d7h5c" Jul 13 14:57:08.272045 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:08.271939 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mwlg\" (UniqueName: \"kubernetes.io/projected/e0134ebd-2015-4898-854c-0f15ccc34d47-kube-api-access-5mwlg\") pod \"cert-manager-webhook-6486ffd997-d7h5c\" (UID: \"e0134ebd-2015-4898-854c-0f15ccc34d47\") " pod="cert-manager/cert-manager-webhook-6486ffd997-d7h5c" Jul 13 14:57:08.373217 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:08.373141 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mwlg\" (UniqueName: \"kubernetes.io/projected/e0134ebd-2015-4898-854c-0f15ccc34d47-kube-api-access-5mwlg\") pod \"cert-manager-webhook-6486ffd997-d7h5c\" (UID: \"e0134ebd-2015-4898-854c-0f15ccc34d47\") " pod="cert-manager/cert-manager-webhook-6486ffd997-d7h5c" Jul 13 14:57:08.373217 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:08.373194 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0134ebd-2015-4898-854c-0f15ccc34d47-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-d7h5c\" (UID: \"e0134ebd-2015-4898-854c-0f15ccc34d47\") " pod="cert-manager/cert-manager-webhook-6486ffd997-d7h5c" Jul 13 14:57:08.382881 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:08.382850 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0134ebd-2015-4898-854c-0f15ccc34d47-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-d7h5c\" (UID: \"e0134ebd-2015-4898-854c-0f15ccc34d47\") " pod="cert-manager/cert-manager-webhook-6486ffd997-d7h5c" Jul 13 14:57:08.383009 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:08.382984 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mwlg\" (UniqueName: \"kubernetes.io/projected/e0134ebd-2015-4898-854c-0f15ccc34d47-kube-api-access-5mwlg\") pod \"cert-manager-webhook-6486ffd997-d7h5c\" (UID: \"e0134ebd-2015-4898-854c-0f15ccc34d47\") " pod="cert-manager/cert-manager-webhook-6486ffd997-d7h5c" Jul 13 14:57:08.392261 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:08.392233 2577 generic.go:356] "Generic (PLEG): container finished" podID="271bdf44-944a-4457-8f18-16e9b9bfe67f" containerID="cad28ab098bcd71abf2dd2a07f11be95517505de4d155dce3d9d5c21193d7675" exitCode=0 Jul 13 14:57:08.392384 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:08.392299 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9" event={"ID":"271bdf44-944a-4457-8f18-16e9b9bfe67f","Type":"ContainerDied","Data":"cad28ab098bcd71abf2dd2a07f11be95517505de4d155dce3d9d5c21193d7675"} Jul 13 14:57:08.392443 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:08.392403 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9" event={"ID":"271bdf44-944a-4457-8f18-16e9b9bfe67f","Type":"ContainerStarted","Data":"573a0681070c55cfe0cbbd73fbd31b7a11a356f43532e97389360bd3bb1d06c6"} Jul 13 14:57:08.516707 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:08.516668 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-d7h5c" Jul 13 14:57:08.666102 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:08.666072 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-d7h5c"] Jul 13 14:57:08.669029 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:57:08.668999 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0134ebd_2015_4898_854c_0f15ccc34d47.slice/crio-0d13d441e4f39284e848089bac08d5fd6a6ae56d9f46efce97c534dafcd543e2 WatchSource:0}: Error finding container 0d13d441e4f39284e848089bac08d5fd6a6ae56d9f46efce97c534dafcd543e2: Status 404 returned error can't find the container with id 0d13d441e4f39284e848089bac08d5fd6a6ae56d9f46efce97c534dafcd543e2 Jul 13 14:57:09.398790 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:09.398738 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-d7h5c" event={"ID":"e0134ebd-2015-4898-854c-0f15ccc34d47","Type":"ContainerStarted","Data":"0d13d441e4f39284e848089bac08d5fd6a6ae56d9f46efce97c534dafcd543e2"} Jul 13 14:57:12.414050 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:12.414023 2577 generic.go:356] "Generic (PLEG): container finished" podID="271bdf44-944a-4457-8f18-16e9b9bfe67f" containerID="54d240ab9bbcf4451bbfb4055905ef72794dac27a39688ff1f9f51b8e4af3700" exitCode=0 Jul 13 14:57:12.414499 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:12.414104 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9" event={"ID":"271bdf44-944a-4457-8f18-16e9b9bfe67f","Type":"ContainerDied","Data":"54d240ab9bbcf4451bbfb4055905ef72794dac27a39688ff1f9f51b8e4af3700"} Jul 13 14:57:12.415734 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:12.415707 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-d7h5c" event={"ID":"e0134ebd-2015-4898-854c-0f15ccc34d47","Type":"ContainerStarted","Data":"041c2123e938d04f20d479e7c95ac1528df5a4498602cb39e56ada07f8a87c31"} Jul 13 14:57:12.415850 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:12.415818 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-d7h5c" Jul 13 14:57:12.448346 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:12.448306 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-d7h5c" podStartSLOduration=1.45810351 podStartE2EDuration="4.448292565s" totalImagesPullingTime="2.990189055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:57:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:57:12.44751927 +0000 UTC m=+256.514091762" watchObservedRunningTime="2026-07-13 14:57:12.448292565 +0000 UTC m=+256.514865031" Jul 13 14:57:13.421003 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:13.420971 2577 generic.go:356] "Generic (PLEG): container finished" podID="271bdf44-944a-4457-8f18-16e9b9bfe67f" containerID="afd8fae81ac4bfa82fb07b1ff89575ce1b6311fff1c78c169e5a609adf99cfdf" exitCode=0 Jul 13 14:57:13.421427 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:13.421035 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9" event={"ID":"271bdf44-944a-4457-8f18-16e9b9bfe67f","Type":"ContainerDied","Data":"afd8fae81ac4bfa82fb07b1ff89575ce1b6311fff1c78c169e5a609adf99cfdf"} Jul 13 14:57:14.545213 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:14.545191 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9" Jul 13 14:57:14.625203 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:14.625179 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/271bdf44-944a-4457-8f18-16e9b9bfe67f-bundle\") pod \"271bdf44-944a-4457-8f18-16e9b9bfe67f\" (UID: \"271bdf44-944a-4457-8f18-16e9b9bfe67f\") " Jul 13 14:57:14.625343 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:14.625258 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfrvd\" (UniqueName: \"kubernetes.io/projected/271bdf44-944a-4457-8f18-16e9b9bfe67f-kube-api-access-dfrvd\") pod \"271bdf44-944a-4457-8f18-16e9b9bfe67f\" (UID: \"271bdf44-944a-4457-8f18-16e9b9bfe67f\") " Jul 13 14:57:14.625343 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:14.625293 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/271bdf44-944a-4457-8f18-16e9b9bfe67f-util\") pod \"271bdf44-944a-4457-8f18-16e9b9bfe67f\" (UID: \"271bdf44-944a-4457-8f18-16e9b9bfe67f\") " Jul 13 14:57:14.625657 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:14.625623 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/271bdf44-944a-4457-8f18-16e9b9bfe67f-bundle" (OuterVolumeSpecName: "bundle") pod "271bdf44-944a-4457-8f18-16e9b9bfe67f" (UID: "271bdf44-944a-4457-8f18-16e9b9bfe67f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 14:57:14.627195 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:14.627171 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/271bdf44-944a-4457-8f18-16e9b9bfe67f-kube-api-access-dfrvd" (OuterVolumeSpecName: "kube-api-access-dfrvd") pod "271bdf44-944a-4457-8f18-16e9b9bfe67f" (UID: "271bdf44-944a-4457-8f18-16e9b9bfe67f"). InnerVolumeSpecName "kube-api-access-dfrvd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 14:57:14.629624 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:14.629599 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/271bdf44-944a-4457-8f18-16e9b9bfe67f-util" (OuterVolumeSpecName: "util") pod "271bdf44-944a-4457-8f18-16e9b9bfe67f" (UID: "271bdf44-944a-4457-8f18-16e9b9bfe67f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 14:57:14.726733 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:14.726675 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/271bdf44-944a-4457-8f18-16e9b9bfe67f-bundle\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:57:14.726733 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:14.726701 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfrvd\" (UniqueName: \"kubernetes.io/projected/271bdf44-944a-4457-8f18-16e9b9bfe67f-kube-api-access-dfrvd\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:57:14.726733 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:14.726712 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/271bdf44-944a-4457-8f18-16e9b9bfe67f-util\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:57:15.430658 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:15.430638 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9" Jul 13 14:57:15.430809 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:15.430636 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjkmq9" event={"ID":"271bdf44-944a-4457-8f18-16e9b9bfe67f","Type":"ContainerDied","Data":"573a0681070c55cfe0cbbd73fbd31b7a11a356f43532e97389360bd3bb1d06c6"} Jul 13 14:57:15.430809 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:15.430763 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="573a0681070c55cfe0cbbd73fbd31b7a11a356f43532e97389360bd3bb1d06c6" Jul 13 14:57:18.423167 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:18.423099 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-d7h5c" Jul 13 14:57:18.781054 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:18.780979 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8k4dq"] Jul 13 14:57:18.781273 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:18.781259 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="271bdf44-944a-4457-8f18-16e9b9bfe67f" containerName="extract" Jul 13 14:57:18.781317 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:18.781275 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="271bdf44-944a-4457-8f18-16e9b9bfe67f" containerName="extract" Jul 13 14:57:18.781317 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:18.781290 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="271bdf44-944a-4457-8f18-16e9b9bfe67f" containerName="pull" Jul 13 14:57:18.781317 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:18.781296 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="271bdf44-944a-4457-8f18-16e9b9bfe67f" containerName="pull" Jul 13 14:57:18.781317 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:18.781307 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="271bdf44-944a-4457-8f18-16e9b9bfe67f" containerName="util" Jul 13 14:57:18.781317 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:18.781313 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="271bdf44-944a-4457-8f18-16e9b9bfe67f" containerName="util" Jul 13 14:57:18.781458 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:18.781358 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="271bdf44-944a-4457-8f18-16e9b9bfe67f" containerName="extract" Jul 13 14:57:18.783231 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:18.783215 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8k4dq" Jul 13 14:57:18.785373 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:18.785351 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-8kl5j\"" Jul 13 14:57:18.790929 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:18.790906 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8k4dq"] Jul 13 14:57:18.852863 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:18.852834 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcfh9\" (UniqueName: \"kubernetes.io/projected/26feee93-e3bf-48df-a5e1-ea3128e6362b-kube-api-access-fcfh9\") pod \"cert-manager-cainjector-559cdd8c87-8k4dq\" (UID: \"26feee93-e3bf-48df-a5e1-ea3128e6362b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8k4dq" Jul 13 14:57:18.853002 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:18.852869 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26feee93-e3bf-48df-a5e1-ea3128e6362b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8k4dq\" (UID: \"26feee93-e3bf-48df-a5e1-ea3128e6362b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8k4dq" Jul 13 14:57:18.953956 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:18.953928 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcfh9\" (UniqueName: \"kubernetes.io/projected/26feee93-e3bf-48df-a5e1-ea3128e6362b-kube-api-access-fcfh9\") pod \"cert-manager-cainjector-559cdd8c87-8k4dq\" (UID: \"26feee93-e3bf-48df-a5e1-ea3128e6362b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8k4dq" Jul 13 14:57:18.954089 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:18.953969 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26feee93-e3bf-48df-a5e1-ea3128e6362b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8k4dq\" (UID: \"26feee93-e3bf-48df-a5e1-ea3128e6362b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8k4dq" Jul 13 14:57:18.962046 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:18.962026 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26feee93-e3bf-48df-a5e1-ea3128e6362b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8k4dq\" (UID: \"26feee93-e3bf-48df-a5e1-ea3128e6362b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8k4dq" Jul 13 14:57:18.962150 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:18.962131 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcfh9\" (UniqueName: \"kubernetes.io/projected/26feee93-e3bf-48df-a5e1-ea3128e6362b-kube-api-access-fcfh9\") pod \"cert-manager-cainjector-559cdd8c87-8k4dq\" (UID: \"26feee93-e3bf-48df-a5e1-ea3128e6362b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8k4dq" Jul 13 14:57:19.092272 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:19.092172 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8k4dq" Jul 13 14:57:19.218933 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:19.218910 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8k4dq"] Jul 13 14:57:19.220747 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:57:19.220711 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26feee93_e3bf_48df_a5e1_ea3128e6362b.slice/crio-23e20d8f601a1deb48c9c70d8882a52748a2ab9f1a0c505e8d34c9e7d049055c WatchSource:0}: Error finding container 23e20d8f601a1deb48c9c70d8882a52748a2ab9f1a0c505e8d34c9e7d049055c: Status 404 returned error can't find the container with id 23e20d8f601a1deb48c9c70d8882a52748a2ab9f1a0c505e8d34c9e7d049055c Jul 13 14:57:19.449389 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:19.449355 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8k4dq" event={"ID":"26feee93-e3bf-48df-a5e1-ea3128e6362b","Type":"ContainerStarted","Data":"524ce2d10b70400e7d3e0702ac065c1ffa82c6eda31a6a04fa0b416dd2390d2c"} Jul 13 14:57:19.449389 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:19.449395 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8k4dq" event={"ID":"26feee93-e3bf-48df-a5e1-ea3128e6362b","Type":"ContainerStarted","Data":"23e20d8f601a1deb48c9c70d8882a52748a2ab9f1a0c505e8d34c9e7d049055c"} Jul 13 14:57:19.468734 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:19.468681 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8k4dq" podStartSLOduration=1.468661348 podStartE2EDuration="1.468661348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:57:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:57:19.467982253 +0000 UTC m=+263.534554709" watchObservedRunningTime="2026-07-13 14:57:19.468661348 +0000 UTC m=+263.535233815" Jul 13 14:57:27.710912 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:27.710864 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-cs6tn"] Jul 13 14:57:27.713007 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:27.712991 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-cs6tn" Jul 13 14:57:27.715465 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:27.715442 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-w87wb\"" Jul 13 14:57:27.723573 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:27.723553 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-cs6tn"] Jul 13 14:57:27.828962 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:27.828918 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b06af7ae-f7bb-4729-90ba-6cbcaf001e7e-bound-sa-token\") pod \"cert-manager-55b4d954d5-cs6tn\" (UID: \"b06af7ae-f7bb-4729-90ba-6cbcaf001e7e\") " pod="cert-manager/cert-manager-55b4d954d5-cs6tn" Jul 13 14:57:27.828962 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:27.828967 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qr88\" (UniqueName: \"kubernetes.io/projected/b06af7ae-f7bb-4729-90ba-6cbcaf001e7e-kube-api-access-8qr88\") pod \"cert-manager-55b4d954d5-cs6tn\" (UID: \"b06af7ae-f7bb-4729-90ba-6cbcaf001e7e\") " pod="cert-manager/cert-manager-55b4d954d5-cs6tn" Jul 13 14:57:27.929835 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:27.929802 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b06af7ae-f7bb-4729-90ba-6cbcaf001e7e-bound-sa-token\") pod \"cert-manager-55b4d954d5-cs6tn\" (UID: \"b06af7ae-f7bb-4729-90ba-6cbcaf001e7e\") " pod="cert-manager/cert-manager-55b4d954d5-cs6tn" Jul 13 14:57:27.929835 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:27.929839 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qr88\" (UniqueName: \"kubernetes.io/projected/b06af7ae-f7bb-4729-90ba-6cbcaf001e7e-kube-api-access-8qr88\") pod \"cert-manager-55b4d954d5-cs6tn\" (UID: \"b06af7ae-f7bb-4729-90ba-6cbcaf001e7e\") " pod="cert-manager/cert-manager-55b4d954d5-cs6tn" Jul 13 14:57:27.938093 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:27.938057 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b06af7ae-f7bb-4729-90ba-6cbcaf001e7e-bound-sa-token\") pod \"cert-manager-55b4d954d5-cs6tn\" (UID: \"b06af7ae-f7bb-4729-90ba-6cbcaf001e7e\") " pod="cert-manager/cert-manager-55b4d954d5-cs6tn" Jul 13 14:57:27.938233 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:27.938174 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qr88\" (UniqueName: \"kubernetes.io/projected/b06af7ae-f7bb-4729-90ba-6cbcaf001e7e-kube-api-access-8qr88\") pod \"cert-manager-55b4d954d5-cs6tn\" (UID: \"b06af7ae-f7bb-4729-90ba-6cbcaf001e7e\") " pod="cert-manager/cert-manager-55b4d954d5-cs6tn" Jul 13 14:57:28.021580 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:28.021515 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-cs6tn" Jul 13 14:57:28.146043 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:28.146009 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-cs6tn"] Jul 13 14:57:28.149213 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:57:28.149179 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb06af7ae_f7bb_4729_90ba_6cbcaf001e7e.slice/crio-e6307bb1fd191b9b4cd2628542105ea665a910f8ca022341dbe5d71383d75eee WatchSource:0}: Error finding container e6307bb1fd191b9b4cd2628542105ea665a910f8ca022341dbe5d71383d75eee: Status 404 returned error can't find the container with id e6307bb1fd191b9b4cd2628542105ea665a910f8ca022341dbe5d71383d75eee Jul 13 14:57:28.243193 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:28.243163 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9"] Jul 13 14:57:28.245692 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:28.245675 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9" Jul 13 14:57:28.248052 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:28.248027 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 14:57:28.248143 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:28.248058 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zgw9t\"" Jul 13 14:57:28.248143 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:28.248079 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 14:57:28.254474 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:28.254451 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9"] Jul 13 14:57:28.332860 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:28.332762 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/caec5361-1017-4ab8-b802-8a9ef3aaef4c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9\" (UID: \"caec5361-1017-4ab8-b802-8a9ef3aaef4c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9" Jul 13 14:57:28.332860 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:28.332844 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/caec5361-1017-4ab8-b802-8a9ef3aaef4c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9\" (UID: \"caec5361-1017-4ab8-b802-8a9ef3aaef4c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9" Jul 13 14:57:28.333030 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:28.332868 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58tvn\" (UniqueName: \"kubernetes.io/projected/caec5361-1017-4ab8-b802-8a9ef3aaef4c-kube-api-access-58tvn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9\" (UID: \"caec5361-1017-4ab8-b802-8a9ef3aaef4c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9" Jul 13 14:57:28.433813 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:28.433757 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/caec5361-1017-4ab8-b802-8a9ef3aaef4c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9\" (UID: \"caec5361-1017-4ab8-b802-8a9ef3aaef4c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9" Jul 13 14:57:28.433955 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:28.433820 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58tvn\" (UniqueName: \"kubernetes.io/projected/caec5361-1017-4ab8-b802-8a9ef3aaef4c-kube-api-access-58tvn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9\" (UID: \"caec5361-1017-4ab8-b802-8a9ef3aaef4c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9" Jul 13 14:57:28.433955 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:28.433871 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/caec5361-1017-4ab8-b802-8a9ef3aaef4c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9\" (UID: \"caec5361-1017-4ab8-b802-8a9ef3aaef4c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9" Jul 13 14:57:28.434220 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:28.434200 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/caec5361-1017-4ab8-b802-8a9ef3aaef4c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9\" (UID: \"caec5361-1017-4ab8-b802-8a9ef3aaef4c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9" Jul 13 14:57:28.434220 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:28.434211 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/caec5361-1017-4ab8-b802-8a9ef3aaef4c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9\" (UID: \"caec5361-1017-4ab8-b802-8a9ef3aaef4c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9" Jul 13 14:57:28.442462 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:28.442440 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58tvn\" (UniqueName: \"kubernetes.io/projected/caec5361-1017-4ab8-b802-8a9ef3aaef4c-kube-api-access-58tvn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9\" (UID: \"caec5361-1017-4ab8-b802-8a9ef3aaef4c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9" Jul 13 14:57:28.484925 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:28.484893 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-cs6tn" event={"ID":"b06af7ae-f7bb-4729-90ba-6cbcaf001e7e","Type":"ContainerStarted","Data":"be55c2c61fd344391b6a41fac621db1cd242bd6676d7cf5ed081227e50241e51"} Jul 13 14:57:28.485058 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:28.484931 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-cs6tn" event={"ID":"b06af7ae-f7bb-4729-90ba-6cbcaf001e7e","Type":"ContainerStarted","Data":"e6307bb1fd191b9b4cd2628542105ea665a910f8ca022341dbe5d71383d75eee"} Jul 13 14:57:28.501863 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:28.501818 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-cs6tn" podStartSLOduration=1.501802766 podStartE2EDuration="1.501802766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:57:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:57:28.500978414 +0000 UTC m=+272.567550878" watchObservedRunningTime="2026-07-13 14:57:28.501802766 +0000 UTC m=+272.568375225" Jul 13 14:57:28.555039 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:28.555006 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9" Jul 13 14:57:28.698983 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:28.698952 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9"] Jul 13 14:57:28.701418 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:57:28.701391 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaec5361_1017_4ab8_b802_8a9ef3aaef4c.slice/crio-c479db3b41b9c817d86db44637da3d8a26836ca1242164c37764fd98a206c412 WatchSource:0}: Error finding container c479db3b41b9c817d86db44637da3d8a26836ca1242164c37764fd98a206c412: Status 404 returned error can't find the container with id c479db3b41b9c817d86db44637da3d8a26836ca1242164c37764fd98a206c412 Jul 13 14:57:29.490566 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:29.490530 2577 generic.go:356] "Generic (PLEG): container finished" podID="caec5361-1017-4ab8-b802-8a9ef3aaef4c" containerID="18e626879de3b8c663d70a030bbd9b4acd2fa83c3a1256532e5d0190b1276dea" exitCode=0 Jul 13 14:57:29.490980 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:29.490611 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9" event={"ID":"caec5361-1017-4ab8-b802-8a9ef3aaef4c","Type":"ContainerDied","Data":"18e626879de3b8c663d70a030bbd9b4acd2fa83c3a1256532e5d0190b1276dea"} Jul 13 14:57:29.490980 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:29.490654 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9" event={"ID":"caec5361-1017-4ab8-b802-8a9ef3aaef4c","Type":"ContainerStarted","Data":"c479db3b41b9c817d86db44637da3d8a26836ca1242164c37764fd98a206c412"} Jul 13 14:57:30.496606 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:30.496517 2577 generic.go:356] "Generic (PLEG): container finished" podID="caec5361-1017-4ab8-b802-8a9ef3aaef4c" containerID="d18f87214b86105b4e1ce9b61e2ac36520df1f218dd4d338956c172fbad08809" exitCode=0 Jul 13 14:57:30.496606 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:30.496579 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9" event={"ID":"caec5361-1017-4ab8-b802-8a9ef3aaef4c","Type":"ContainerDied","Data":"d18f87214b86105b4e1ce9b61e2ac36520df1f218dd4d338956c172fbad08809"} Jul 13 14:57:31.502901 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:31.502867 2577 generic.go:356] "Generic (PLEG): container finished" podID="caec5361-1017-4ab8-b802-8a9ef3aaef4c" containerID="db92fa64adba43d1017d055ffdb17fd461af34edca6913296adfbac52d34a00e" exitCode=0 Jul 13 14:57:31.503280 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:31.502925 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9" event={"ID":"caec5361-1017-4ab8-b802-8a9ef3aaef4c","Type":"ContainerDied","Data":"db92fa64adba43d1017d055ffdb17fd461af34edca6913296adfbac52d34a00e"} Jul 13 14:57:32.627951 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:32.627927 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9" Jul 13 14:57:32.770560 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:32.770479 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58tvn\" (UniqueName: \"kubernetes.io/projected/caec5361-1017-4ab8-b802-8a9ef3aaef4c-kube-api-access-58tvn\") pod \"caec5361-1017-4ab8-b802-8a9ef3aaef4c\" (UID: \"caec5361-1017-4ab8-b802-8a9ef3aaef4c\") " Jul 13 14:57:32.770708 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:32.770558 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/caec5361-1017-4ab8-b802-8a9ef3aaef4c-bundle\") pod \"caec5361-1017-4ab8-b802-8a9ef3aaef4c\" (UID: \"caec5361-1017-4ab8-b802-8a9ef3aaef4c\") " Jul 13 14:57:32.770708 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:32.770584 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/caec5361-1017-4ab8-b802-8a9ef3aaef4c-util\") pod \"caec5361-1017-4ab8-b802-8a9ef3aaef4c\" (UID: \"caec5361-1017-4ab8-b802-8a9ef3aaef4c\") " Jul 13 14:57:32.771346 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:32.771313 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caec5361-1017-4ab8-b802-8a9ef3aaef4c-bundle" (OuterVolumeSpecName: "bundle") pod "caec5361-1017-4ab8-b802-8a9ef3aaef4c" (UID: "caec5361-1017-4ab8-b802-8a9ef3aaef4c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 14:57:32.772549 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:32.772529 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caec5361-1017-4ab8-b802-8a9ef3aaef4c-kube-api-access-58tvn" (OuterVolumeSpecName: "kube-api-access-58tvn") pod "caec5361-1017-4ab8-b802-8a9ef3aaef4c" (UID: "caec5361-1017-4ab8-b802-8a9ef3aaef4c"). InnerVolumeSpecName "kube-api-access-58tvn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 14:57:32.778904 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:32.778880 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caec5361-1017-4ab8-b802-8a9ef3aaef4c-util" (OuterVolumeSpecName: "util") pod "caec5361-1017-4ab8-b802-8a9ef3aaef4c" (UID: "caec5361-1017-4ab8-b802-8a9ef3aaef4c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 14:57:32.871175 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:32.871145 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58tvn\" (UniqueName: \"kubernetes.io/projected/caec5361-1017-4ab8-b802-8a9ef3aaef4c-kube-api-access-58tvn\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:57:32.871175 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:32.871170 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/caec5361-1017-4ab8-b802-8a9ef3aaef4c-bundle\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:57:32.871175 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:32.871180 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/caec5361-1017-4ab8-b802-8a9ef3aaef4c-util\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:57:33.514174 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:33.514145 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9" event={"ID":"caec5361-1017-4ab8-b802-8a9ef3aaef4c","Type":"ContainerDied","Data":"c479db3b41b9c817d86db44637da3d8a26836ca1242164c37764fd98a206c412"} Jul 13 14:57:33.514329 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:33.514192 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c479db3b41b9c817d86db44637da3d8a26836ca1242164c37764fd98a206c412" Jul 13 14:57:33.514329 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:33.514153 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af62sc9" Jul 13 14:57:45.426305 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.426265 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67985f7df8-lztzg"] Jul 13 14:57:45.426917 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.426670 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caec5361-1017-4ab8-b802-8a9ef3aaef4c" containerName="util" Jul 13 14:57:45.426917 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.426687 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="caec5361-1017-4ab8-b802-8a9ef3aaef4c" containerName="util" Jul 13 14:57:45.426917 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.426716 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caec5361-1017-4ab8-b802-8a9ef3aaef4c" containerName="extract" Jul 13 14:57:45.426917 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.426726 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="caec5361-1017-4ab8-b802-8a9ef3aaef4c" containerName="extract" Jul 13 14:57:45.426917 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.426737 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caec5361-1017-4ab8-b802-8a9ef3aaef4c" containerName="pull" Jul 13 14:57:45.426917 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.426745 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="caec5361-1017-4ab8-b802-8a9ef3aaef4c" containerName="pull" Jul 13 14:57:45.426917 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.426839 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="caec5361-1017-4ab8-b802-8a9ef3aaef4c" containerName="extract" Jul 13 14:57:45.429978 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.429958 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67985f7df8-lztzg" Jul 13 14:57:45.435634 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.435608 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 13 14:57:45.435765 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.435651 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 13 14:57:45.435765 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.435699 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 13 14:57:45.435765 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.435740 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 13 14:57:45.436021 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.436005 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4qfmz\"" Jul 13 14:57:45.456544 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.456519 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67985f7df8-lztzg"] Jul 13 14:57:45.460848 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.460822 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f74dfc69-9adf-4e16-87a2-70419fd392ec-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67985f7df8-lztzg\" (UID: \"f74dfc69-9adf-4e16-87a2-70419fd392ec\") " pod="opendatahub/opendatahub-operator-controller-manager-67985f7df8-lztzg" Jul 13 14:57:45.460943 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.460866 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f74dfc69-9adf-4e16-87a2-70419fd392ec-manifests\") pod \"opendatahub-operator-controller-manager-67985f7df8-lztzg\" (UID: \"f74dfc69-9adf-4e16-87a2-70419fd392ec\") " pod="opendatahub/opendatahub-operator-controller-manager-67985f7df8-lztzg" Jul 13 14:57:45.460943 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.460893 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92zv2\" (UniqueName: \"kubernetes.io/projected/f74dfc69-9adf-4e16-87a2-70419fd392ec-kube-api-access-92zv2\") pod \"opendatahub-operator-controller-manager-67985f7df8-lztzg\" (UID: \"f74dfc69-9adf-4e16-87a2-70419fd392ec\") " pod="opendatahub/opendatahub-operator-controller-manager-67985f7df8-lztzg" Jul 13 14:57:45.460943 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.460924 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f74dfc69-9adf-4e16-87a2-70419fd392ec-webhook-cert\") pod \"opendatahub-operator-controller-manager-67985f7df8-lztzg\" (UID: \"f74dfc69-9adf-4e16-87a2-70419fd392ec\") " pod="opendatahub/opendatahub-operator-controller-manager-67985f7df8-lztzg" Jul 13 14:57:45.461050 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.460960 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f74dfc69-9adf-4e16-87a2-70419fd392ec-tmp\") pod \"opendatahub-operator-controller-manager-67985f7df8-lztzg\" (UID: \"f74dfc69-9adf-4e16-87a2-70419fd392ec\") " pod="opendatahub/opendatahub-operator-controller-manager-67985f7df8-lztzg" Jul 13 14:57:45.561620 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.561592 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f74dfc69-9adf-4e16-87a2-70419fd392ec-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67985f7df8-lztzg\" (UID: \"f74dfc69-9adf-4e16-87a2-70419fd392ec\") " pod="opendatahub/opendatahub-operator-controller-manager-67985f7df8-lztzg" Jul 13 14:57:45.561620 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.561623 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f74dfc69-9adf-4e16-87a2-70419fd392ec-manifests\") pod \"opendatahub-operator-controller-manager-67985f7df8-lztzg\" (UID: \"f74dfc69-9adf-4e16-87a2-70419fd392ec\") " pod="opendatahub/opendatahub-operator-controller-manager-67985f7df8-lztzg" Jul 13 14:57:45.562012 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.561643 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92zv2\" (UniqueName: \"kubernetes.io/projected/f74dfc69-9adf-4e16-87a2-70419fd392ec-kube-api-access-92zv2\") pod \"opendatahub-operator-controller-manager-67985f7df8-lztzg\" (UID: \"f74dfc69-9adf-4e16-87a2-70419fd392ec\") " pod="opendatahub/opendatahub-operator-controller-manager-67985f7df8-lztzg" Jul 13 14:57:45.562012 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.561797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f74dfc69-9adf-4e16-87a2-70419fd392ec-webhook-cert\") pod \"opendatahub-operator-controller-manager-67985f7df8-lztzg\" (UID: \"f74dfc69-9adf-4e16-87a2-70419fd392ec\") " pod="opendatahub/opendatahub-operator-controller-manager-67985f7df8-lztzg" Jul 13 14:57:45.562012 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.561862 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f74dfc69-9adf-4e16-87a2-70419fd392ec-tmp\") pod \"opendatahub-operator-controller-manager-67985f7df8-lztzg\" (UID: \"f74dfc69-9adf-4e16-87a2-70419fd392ec\") " pod="opendatahub/opendatahub-operator-controller-manager-67985f7df8-lztzg" Jul 13 14:57:45.562166 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.562091 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f74dfc69-9adf-4e16-87a2-70419fd392ec-manifests\") pod \"opendatahub-operator-controller-manager-67985f7df8-lztzg\" (UID: \"f74dfc69-9adf-4e16-87a2-70419fd392ec\") " pod="opendatahub/opendatahub-operator-controller-manager-67985f7df8-lztzg" Jul 13 14:57:45.564075 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.564055 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f74dfc69-9adf-4e16-87a2-70419fd392ec-tmp\") pod \"opendatahub-operator-controller-manager-67985f7df8-lztzg\" (UID: \"f74dfc69-9adf-4e16-87a2-70419fd392ec\") " pod="opendatahub/opendatahub-operator-controller-manager-67985f7df8-lztzg" Jul 13 14:57:45.564362 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.564346 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f74dfc69-9adf-4e16-87a2-70419fd392ec-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67985f7df8-lztzg\" (UID: \"f74dfc69-9adf-4e16-87a2-70419fd392ec\") " pod="opendatahub/opendatahub-operator-controller-manager-67985f7df8-lztzg" Jul 13 14:57:45.564405 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.564370 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f74dfc69-9adf-4e16-87a2-70419fd392ec-webhook-cert\") pod \"opendatahub-operator-controller-manager-67985f7df8-lztzg\" (UID: \"f74dfc69-9adf-4e16-87a2-70419fd392ec\") " pod="opendatahub/opendatahub-operator-controller-manager-67985f7df8-lztzg" Jul 13 14:57:45.570793 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.570750 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92zv2\" (UniqueName: \"kubernetes.io/projected/f74dfc69-9adf-4e16-87a2-70419fd392ec-kube-api-access-92zv2\") pod \"opendatahub-operator-controller-manager-67985f7df8-lztzg\" (UID: \"f74dfc69-9adf-4e16-87a2-70419fd392ec\") " pod="opendatahub/opendatahub-operator-controller-manager-67985f7df8-lztzg" Jul 13 14:57:45.744976 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.744902 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67985f7df8-lztzg" Jul 13 14:57:45.888283 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:45.888251 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67985f7df8-lztzg"] Jul 13 14:57:45.891570 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:57:45.891546 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf74dfc69_9adf_4e16_87a2_70419fd392ec.slice/crio-ad5dcc1b9eea21c33c10d0b03b7d8ceb9f5615e2cfc913e7ba8d716caabfbdd2 WatchSource:0}: Error finding container ad5dcc1b9eea21c33c10d0b03b7d8ceb9f5615e2cfc913e7ba8d716caabfbdd2: Status 404 returned error can't find the container with id ad5dcc1b9eea21c33c10d0b03b7d8ceb9f5615e2cfc913e7ba8d716caabfbdd2 Jul 13 14:57:46.569739 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:46.569703 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67985f7df8-lztzg" event={"ID":"f74dfc69-9adf-4e16-87a2-70419fd392ec","Type":"ContainerStarted","Data":"ad5dcc1b9eea21c33c10d0b03b7d8ceb9f5615e2cfc913e7ba8d716caabfbdd2"} Jul 13 14:57:49.584895 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:49.584859 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67985f7df8-lztzg" event={"ID":"f74dfc69-9adf-4e16-87a2-70419fd392ec","Type":"ContainerStarted","Data":"794bdbbe6646543528d77576b1e2cceb55f2fe0c6bcde54b6400d0b262ce3641"} Jul 13 14:57:50.590235 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:50.590201 2577 generic.go:356] "Generic (PLEG): container finished" podID="f74dfc69-9adf-4e16-87a2-70419fd392ec" containerID="794bdbbe6646543528d77576b1e2cceb55f2fe0c6bcde54b6400d0b262ce3641" exitCode=0 Jul 13 14:57:50.590611 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:50.590236 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67985f7df8-lztzg" event={"ID":"f74dfc69-9adf-4e16-87a2-70419fd392ec","Type":"ContainerDied","Data":"794bdbbe6646543528d77576b1e2cceb55f2fe0c6bcde54b6400d0b262ce3641"} Jul 13 14:57:51.597261 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:51.597229 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67985f7df8-lztzg" event={"ID":"f74dfc69-9adf-4e16-87a2-70419fd392ec","Type":"ContainerStarted","Data":"5035347b69db47f61fcd81ea103cf0265ffaa99d80e14b0bf0b683a0ff285286"} Jul 13 14:57:51.597603 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:51.597327 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67985f7df8-lztzg" Jul 13 14:57:51.620387 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:51.620343 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67985f7df8-lztzg" podStartSLOduration=2.094734941 podStartE2EDuration="6.620326585s" totalImagesPullingTime="3.433405833s" totalInitContainerRuntime="1.092185811s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:57:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:57:51.618585991 +0000 UTC m=+295.685158458" watchObservedRunningTime="2026-07-13 14:57:51.620326585 +0000 UTC m=+295.686899050" Jul 13 14:57:56.449870 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:57:56.449841 2577 kubelet.go:1648] "Image garbage collection succeeded" Jul 13 14:58:02.603916 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:02.603880 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67985f7df8-lztzg" Jul 13 14:58:03.354229 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:03.354198 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-677c5d8dc-qmwgd"] Jul 13 14:58:03.356695 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:03.356678 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-677c5d8dc-qmwgd" Jul 13 14:58:03.359941 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:03.359919 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 13 14:58:03.360764 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:03.360738 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 13 14:58:03.360764 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:03.360755 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 13 14:58:03.360916 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:03.360761 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 13 14:58:03.360916 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:03.360839 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bfjm7\"" Jul 13 14:58:03.360916 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:03.360861 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 13 14:58:03.377971 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:03.377946 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-677c5d8dc-qmwgd"] Jul 13 14:58:03.419627 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:03.419588 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85835492-7bc1-46c5-bf21-e6af4ce80f85-cert\") pod \"lws-controller-manager-677c5d8dc-qmwgd\" (UID: \"85835492-7bc1-46c5-bf21-e6af4ce80f85\") " pod="openshift-lws-operator/lws-controller-manager-677c5d8dc-qmwgd" Jul 13 14:58:03.419627 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:03.419622 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/85835492-7bc1-46c5-bf21-e6af4ce80f85-metrics-cert\") pod \"lws-controller-manager-677c5d8dc-qmwgd\" (UID: \"85835492-7bc1-46c5-bf21-e6af4ce80f85\") " pod="openshift-lws-operator/lws-controller-manager-677c5d8dc-qmwgd" Jul 13 14:58:03.419908 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:03.419660 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbpsf\" (UniqueName: \"kubernetes.io/projected/85835492-7bc1-46c5-bf21-e6af4ce80f85-kube-api-access-mbpsf\") pod \"lws-controller-manager-677c5d8dc-qmwgd\" (UID: \"85835492-7bc1-46c5-bf21-e6af4ce80f85\") " pod="openshift-lws-operator/lws-controller-manager-677c5d8dc-qmwgd" Jul 13 14:58:03.419908 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:03.419682 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/85835492-7bc1-46c5-bf21-e6af4ce80f85-manager-config\") pod \"lws-controller-manager-677c5d8dc-qmwgd\" (UID: \"85835492-7bc1-46c5-bf21-e6af4ce80f85\") " pod="openshift-lws-operator/lws-controller-manager-677c5d8dc-qmwgd" Jul 13 14:58:03.520685 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:03.520646 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbpsf\" (UniqueName: \"kubernetes.io/projected/85835492-7bc1-46c5-bf21-e6af4ce80f85-kube-api-access-mbpsf\") pod \"lws-controller-manager-677c5d8dc-qmwgd\" (UID: \"85835492-7bc1-46c5-bf21-e6af4ce80f85\") " pod="openshift-lws-operator/lws-controller-manager-677c5d8dc-qmwgd" Jul 13 14:58:03.520685 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:03.520687 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/85835492-7bc1-46c5-bf21-e6af4ce80f85-manager-config\") pod \"lws-controller-manager-677c5d8dc-qmwgd\" (UID: \"85835492-7bc1-46c5-bf21-e6af4ce80f85\") " pod="openshift-lws-operator/lws-controller-manager-677c5d8dc-qmwgd" Jul 13 14:58:03.520939 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:03.520737 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85835492-7bc1-46c5-bf21-e6af4ce80f85-cert\") pod \"lws-controller-manager-677c5d8dc-qmwgd\" (UID: \"85835492-7bc1-46c5-bf21-e6af4ce80f85\") " pod="openshift-lws-operator/lws-controller-manager-677c5d8dc-qmwgd" Jul 13 14:58:03.520939 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:03.520753 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/85835492-7bc1-46c5-bf21-e6af4ce80f85-metrics-cert\") pod \"lws-controller-manager-677c5d8dc-qmwgd\" (UID: \"85835492-7bc1-46c5-bf21-e6af4ce80f85\") " pod="openshift-lws-operator/lws-controller-manager-677c5d8dc-qmwgd" Jul 13 14:58:03.521438 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:03.521415 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/85835492-7bc1-46c5-bf21-e6af4ce80f85-manager-config\") pod \"lws-controller-manager-677c5d8dc-qmwgd\" (UID: \"85835492-7bc1-46c5-bf21-e6af4ce80f85\") " pod="openshift-lws-operator/lws-controller-manager-677c5d8dc-qmwgd" Jul 13 14:58:03.523383 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:03.523363 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/85835492-7bc1-46c5-bf21-e6af4ce80f85-metrics-cert\") pod \"lws-controller-manager-677c5d8dc-qmwgd\" (UID: \"85835492-7bc1-46c5-bf21-e6af4ce80f85\") " pod="openshift-lws-operator/lws-controller-manager-677c5d8dc-qmwgd" Jul 13 14:58:03.523472 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:03.523417 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85835492-7bc1-46c5-bf21-e6af4ce80f85-cert\") pod \"lws-controller-manager-677c5d8dc-qmwgd\" (UID: \"85835492-7bc1-46c5-bf21-e6af4ce80f85\") " pod="openshift-lws-operator/lws-controller-manager-677c5d8dc-qmwgd" Jul 13 14:58:03.529456 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:03.529423 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbpsf\" (UniqueName: \"kubernetes.io/projected/85835492-7bc1-46c5-bf21-e6af4ce80f85-kube-api-access-mbpsf\") pod \"lws-controller-manager-677c5d8dc-qmwgd\" (UID: \"85835492-7bc1-46c5-bf21-e6af4ce80f85\") " pod="openshift-lws-operator/lws-controller-manager-677c5d8dc-qmwgd" Jul 13 14:58:03.666625 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:03.666583 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-677c5d8dc-qmwgd" Jul 13 14:58:03.798009 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:03.797983 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-677c5d8dc-qmwgd"] Jul 13 14:58:03.800475 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:58:03.800436 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85835492_7bc1_46c5_bf21_e6af4ce80f85.slice/crio-65952cb2d1c3c9d8d4110a8a5eff548594ade99d8ef35c955685c46f1ba65a81 WatchSource:0}: Error finding container 65952cb2d1c3c9d8d4110a8a5eff548594ade99d8ef35c955685c46f1ba65a81: Status 404 returned error can't find the container with id 65952cb2d1c3c9d8d4110a8a5eff548594ade99d8ef35c955685c46f1ba65a81 Jul 13 14:58:03.802500 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:03.802485 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 14:58:04.658820 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:04.658761 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-677c5d8dc-qmwgd" event={"ID":"85835492-7bc1-46c5-bf21-e6af4ce80f85","Type":"ContainerStarted","Data":"65952cb2d1c3c9d8d4110a8a5eff548594ade99d8ef35c955685c46f1ba65a81"} Jul 13 14:58:06.668234 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:06.668193 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-677c5d8dc-qmwgd" event={"ID":"85835492-7bc1-46c5-bf21-e6af4ce80f85","Type":"ContainerStarted","Data":"92d33729ea7a69ba49609e241b9e28411e09f13e4cecf3d737530d3b6a874909"} Jul 13 14:58:06.668630 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:06.668309 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-677c5d8dc-qmwgd" Jul 13 14:58:06.686706 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:06.686653 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-677c5d8dc-qmwgd" podStartSLOduration=1.7759648129999999 podStartE2EDuration="3.686634202s" totalImagesPullingTime="1.910669389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:58:06.68496402 +0000 UTC m=+310.751536479" watchObservedRunningTime="2026-07-13 14:58:06.686634202 +0000 UTC m=+310.753206668" Jul 13 14:58:13.117273 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.117242 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27"] Jul 13 14:58:13.120687 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.120665 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:13.123968 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.123947 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 13 14:58:13.124528 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.124510 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-m558h\"" Jul 13 14:58:13.124591 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.124515 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 13 14:58:13.124591 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.124516 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 13 14:58:13.146432 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.146406 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27"] Jul 13 14:58:13.204358 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.204321 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/657068e3-f65c-49dd-b86f-1ce127d85fd0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nhj27\" (UID: \"657068e3-f65c-49dd-b86f-1ce127d85fd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:13.204529 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.204366 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/657068e3-f65c-49dd-b86f-1ce127d85fd0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nhj27\" (UID: \"657068e3-f65c-49dd-b86f-1ce127d85fd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:13.204529 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.204439 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/657068e3-f65c-49dd-b86f-1ce127d85fd0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nhj27\" (UID: \"657068e3-f65c-49dd-b86f-1ce127d85fd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:13.204652 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.204527 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42ftj\" (UniqueName: \"kubernetes.io/projected/657068e3-f65c-49dd-b86f-1ce127d85fd0-kube-api-access-42ftj\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nhj27\" (UID: \"657068e3-f65c-49dd-b86f-1ce127d85fd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:13.204652 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.204552 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/657068e3-f65c-49dd-b86f-1ce127d85fd0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nhj27\" (UID: \"657068e3-f65c-49dd-b86f-1ce127d85fd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:13.204652 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.204582 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/657068e3-f65c-49dd-b86f-1ce127d85fd0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nhj27\" (UID: \"657068e3-f65c-49dd-b86f-1ce127d85fd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:13.204652 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.204648 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/657068e3-f65c-49dd-b86f-1ce127d85fd0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nhj27\" (UID: \"657068e3-f65c-49dd-b86f-1ce127d85fd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:13.204820 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.204669 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/657068e3-f65c-49dd-b86f-1ce127d85fd0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nhj27\" (UID: \"657068e3-f65c-49dd-b86f-1ce127d85fd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:13.204820 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.204691 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/657068e3-f65c-49dd-b86f-1ce127d85fd0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nhj27\" (UID: \"657068e3-f65c-49dd-b86f-1ce127d85fd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:13.306058 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.306023 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/657068e3-f65c-49dd-b86f-1ce127d85fd0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nhj27\" (UID: \"657068e3-f65c-49dd-b86f-1ce127d85fd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:13.306240 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.306064 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/657068e3-f65c-49dd-b86f-1ce127d85fd0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nhj27\" (UID: \"657068e3-f65c-49dd-b86f-1ce127d85fd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:13.306240 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.306094 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/657068e3-f65c-49dd-b86f-1ce127d85fd0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nhj27\" (UID: \"657068e3-f65c-49dd-b86f-1ce127d85fd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:13.306240 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.306220 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/657068e3-f65c-49dd-b86f-1ce127d85fd0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nhj27\" (UID: \"657068e3-f65c-49dd-b86f-1ce127d85fd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:13.306411 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.306266 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/657068e3-f65c-49dd-b86f-1ce127d85fd0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nhj27\" (UID: \"657068e3-f65c-49dd-b86f-1ce127d85fd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:13.306411 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.306314 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/657068e3-f65c-49dd-b86f-1ce127d85fd0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nhj27\" (UID: \"657068e3-f65c-49dd-b86f-1ce127d85fd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:13.306502 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.306452 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/657068e3-f65c-49dd-b86f-1ce127d85fd0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nhj27\" (UID: \"657068e3-f65c-49dd-b86f-1ce127d85fd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:13.306502 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.306480 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/657068e3-f65c-49dd-b86f-1ce127d85fd0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nhj27\" (UID: \"657068e3-f65c-49dd-b86f-1ce127d85fd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:13.306607 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.306513 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/657068e3-f65c-49dd-b86f-1ce127d85fd0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nhj27\" (UID: \"657068e3-f65c-49dd-b86f-1ce127d85fd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:13.306607 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.306520 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/657068e3-f65c-49dd-b86f-1ce127d85fd0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nhj27\" (UID: \"657068e3-f65c-49dd-b86f-1ce127d85fd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:13.306607 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.306565 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42ftj\" (UniqueName: \"kubernetes.io/projected/657068e3-f65c-49dd-b86f-1ce127d85fd0-kube-api-access-42ftj\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nhj27\" (UID: \"657068e3-f65c-49dd-b86f-1ce127d85fd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:13.306763 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.306665 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/657068e3-f65c-49dd-b86f-1ce127d85fd0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nhj27\" (UID: \"657068e3-f65c-49dd-b86f-1ce127d85fd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:13.306763 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.306708 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/657068e3-f65c-49dd-b86f-1ce127d85fd0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nhj27\" (UID: \"657068e3-f65c-49dd-b86f-1ce127d85fd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:13.307092 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.307065 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/657068e3-f65c-49dd-b86f-1ce127d85fd0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nhj27\" (UID: \"657068e3-f65c-49dd-b86f-1ce127d85fd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:13.308425 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.308401 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/657068e3-f65c-49dd-b86f-1ce127d85fd0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nhj27\" (UID: \"657068e3-f65c-49dd-b86f-1ce127d85fd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:13.308830 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.308808 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/657068e3-f65c-49dd-b86f-1ce127d85fd0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nhj27\" (UID: \"657068e3-f65c-49dd-b86f-1ce127d85fd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:13.315024 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.315002 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/657068e3-f65c-49dd-b86f-1ce127d85fd0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nhj27\" (UID: \"657068e3-f65c-49dd-b86f-1ce127d85fd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:13.315474 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.315449 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42ftj\" (UniqueName: \"kubernetes.io/projected/657068e3-f65c-49dd-b86f-1ce127d85fd0-kube-api-access-42ftj\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nhj27\" (UID: \"657068e3-f65c-49dd-b86f-1ce127d85fd0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:13.430995 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.430955 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:13.566969 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.566944 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27"] Jul 13 14:58:13.569181 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:58:13.569151 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod657068e3_f65c_49dd_b86f_1ce127d85fd0.slice/crio-de30a4050c5eed1b626045378c93242155f0a79b732a3ebf39c92a08d11c8e6c WatchSource:0}: Error finding container de30a4050c5eed1b626045378c93242155f0a79b732a3ebf39c92a08d11c8e6c: Status 404 returned error can't find the container with id de30a4050c5eed1b626045378c93242155f0a79b732a3ebf39c92a08d11c8e6c Jul 13 14:58:13.699254 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:13.699154 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" event={"ID":"657068e3-f65c-49dd-b86f-1ce127d85fd0","Type":"ContainerStarted","Data":"de30a4050c5eed1b626045378c93242155f0a79b732a3ebf39c92a08d11c8e6c"} Jul 13 14:58:15.181157 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:15.181120 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw"] Jul 13 14:58:15.184937 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:15.184913 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw" Jul 13 14:58:15.187795 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:15.187708 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 13 14:58:15.187795 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:15.187718 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 13 14:58:15.188013 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:15.187816 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 13 14:58:15.188013 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:15.187916 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-9gpjz\"" Jul 13 14:58:15.200851 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:15.200824 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw"] Jul 13 14:58:15.327694 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:15.327655 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/41529d43-505a-448f-acaa-a627230fb3d8-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-65kfw\" (UID: \"41529d43-505a-448f-acaa-a627230fb3d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw" Jul 13 14:58:15.327898 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:15.327718 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/41529d43-505a-448f-acaa-a627230fb3d8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-65kfw\" (UID: \"41529d43-505a-448f-acaa-a627230fb3d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw" Jul 13 14:58:15.327898 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:15.327814 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/41529d43-505a-448f-acaa-a627230fb3d8-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-65kfw\" (UID: \"41529d43-505a-448f-acaa-a627230fb3d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw" Jul 13 14:58:15.327898 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:15.327887 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/41529d43-505a-448f-acaa-a627230fb3d8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-65kfw\" (UID: \"41529d43-505a-448f-acaa-a627230fb3d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw" Jul 13 14:58:15.328068 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:15.327940 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z79kx\" (UniqueName: \"kubernetes.io/projected/41529d43-505a-448f-acaa-a627230fb3d8-kube-api-access-z79kx\") pod \"istiod-openshift-gateway-94bb8fbfd-65kfw\" (UID: \"41529d43-505a-448f-acaa-a627230fb3d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw" Jul 13 14:58:15.328068 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:15.327997 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41529d43-505a-448f-acaa-a627230fb3d8-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-65kfw\" (UID: \"41529d43-505a-448f-acaa-a627230fb3d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw" Jul 13 14:58:15.328068 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:15.328043 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/41529d43-505a-448f-acaa-a627230fb3d8-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-65kfw\" (UID: \"41529d43-505a-448f-acaa-a627230fb3d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw" Jul 13 14:58:15.428851 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:15.428808 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/41529d43-505a-448f-acaa-a627230fb3d8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-65kfw\" (UID: \"41529d43-505a-448f-acaa-a627230fb3d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw" Jul 13 14:58:15.429114 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:15.429083 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z79kx\" (UniqueName: \"kubernetes.io/projected/41529d43-505a-448f-acaa-a627230fb3d8-kube-api-access-z79kx\") pod \"istiod-openshift-gateway-94bb8fbfd-65kfw\" (UID: \"41529d43-505a-448f-acaa-a627230fb3d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw" Jul 13 14:58:15.429210 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:15.429133 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41529d43-505a-448f-acaa-a627230fb3d8-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-65kfw\" (UID: \"41529d43-505a-448f-acaa-a627230fb3d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw" Jul 13 14:58:15.429429 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:15.429387 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/41529d43-505a-448f-acaa-a627230fb3d8-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-65kfw\" (UID: \"41529d43-505a-448f-acaa-a627230fb3d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw" Jul 13 14:58:15.429550 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:15.429528 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/41529d43-505a-448f-acaa-a627230fb3d8-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-65kfw\" (UID: \"41529d43-505a-448f-acaa-a627230fb3d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw" Jul 13 14:58:15.429595 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:15.429555 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/41529d43-505a-448f-acaa-a627230fb3d8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-65kfw\" (UID: \"41529d43-505a-448f-acaa-a627230fb3d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw" Jul 13 14:58:15.429648 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:15.429614 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/41529d43-505a-448f-acaa-a627230fb3d8-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-65kfw\" (UID: \"41529d43-505a-448f-acaa-a627230fb3d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw" Jul 13 14:58:15.430666 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:15.430640 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/41529d43-505a-448f-acaa-a627230fb3d8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-65kfw\" (UID: \"41529d43-505a-448f-acaa-a627230fb3d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw" Jul 13 14:58:15.432105 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:15.432027 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/41529d43-505a-448f-acaa-a627230fb3d8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-65kfw\" (UID: \"41529d43-505a-448f-acaa-a627230fb3d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw" Jul 13 14:58:15.432204 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:15.432136 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/41529d43-505a-448f-acaa-a627230fb3d8-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-65kfw\" (UID: \"41529d43-505a-448f-acaa-a627230fb3d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw" Jul 13 14:58:15.432270 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:15.432215 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/41529d43-505a-448f-acaa-a627230fb3d8-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-65kfw\" (UID: \"41529d43-505a-448f-acaa-a627230fb3d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw" Jul 13 14:58:15.432327 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:15.432273 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/41529d43-505a-448f-acaa-a627230fb3d8-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-65kfw\" (UID: \"41529d43-505a-448f-acaa-a627230fb3d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw" Jul 13 14:58:15.441999 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:15.441975 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z79kx\" (UniqueName: \"kubernetes.io/projected/41529d43-505a-448f-acaa-a627230fb3d8-kube-api-access-z79kx\") pod \"istiod-openshift-gateway-94bb8fbfd-65kfw\" (UID: \"41529d43-505a-448f-acaa-a627230fb3d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw" Jul 13 14:58:15.442879 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:15.442856 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41529d43-505a-448f-acaa-a627230fb3d8-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-65kfw\" (UID: \"41529d43-505a-448f-acaa-a627230fb3d8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw" Jul 13 14:58:15.497010 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:15.496979 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw" Jul 13 14:58:16.549413 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:16.549361 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 14:58:16.549746 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:16.549468 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 14:58:16.549746 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:16.549499 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 14:58:16.624223 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:16.624200 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw"] Jul 13 14:58:16.626361 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:58:16.626335 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41529d43_505a_448f_acaa_a627230fb3d8.slice/crio-466e072b8ecfc09e731b6079652610a6956077e37b27f17c83e05dcd3590f3de WatchSource:0}: Error finding container 466e072b8ecfc09e731b6079652610a6956077e37b27f17c83e05dcd3590f3de: Status 404 returned error can't find the container with id 466e072b8ecfc09e731b6079652610a6956077e37b27f17c83e05dcd3590f3de Jul 13 14:58:16.715208 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:16.715169 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" event={"ID":"657068e3-f65c-49dd-b86f-1ce127d85fd0","Type":"ContainerStarted","Data":"9bd0c91ed6d8f2195bf3ec4265a9b93c1ecf2f6b9929ffed7ea0f56441a40fa2"} Jul 13 14:58:16.716541 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:16.716511 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw" event={"ID":"41529d43-505a-448f-acaa-a627230fb3d8","Type":"ContainerStarted","Data":"466e072b8ecfc09e731b6079652610a6956077e37b27f17c83e05dcd3590f3de"} Jul 13 14:58:16.748851 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:16.748037 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" podStartSLOduration=0.770191276 podStartE2EDuration="3.748016717s" totalImagesPullingTime="2.977825441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:58:16.746056753 +0000 UTC m=+320.812629221" watchObservedRunningTime="2026-07-13 14:58:16.748016717 +0000 UTC m=+320.814589184" Jul 13 14:58:17.431303 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:17.431266 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:17.436656 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:17.436629 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:17.675228 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:17.675197 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-677c5d8dc-qmwgd" Jul 13 14:58:17.723113 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:17.723030 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:17.724170 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:17.724147 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nhj27" Jul 13 14:58:18.964572 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:18.964534 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 14:58:18.964895 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:18.964606 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 14:58:19.732994 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:19.732954 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw" event={"ID":"41529d43-505a-448f-acaa-a627230fb3d8","Type":"ContainerStarted","Data":"f57cd65f3acd05d8c0e71d06455124270e89d763e847a3574d5bd4427ac7d417"} Jul 13 14:58:19.770164 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:19.770113 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw" podStartSLOduration=2.434213813 podStartE2EDuration="4.770097033s" totalImagesPullingTime="2.33588322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:58:19.767528138 +0000 UTC m=+323.834100604" watchObservedRunningTime="2026-07-13 14:58:19.770097033 +0000 UTC m=+323.836669498" Jul 13 14:58:20.738161 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:20.738124 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw" Jul 13 14:58:20.739934 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:58:20.739914 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-65kfw" Jul 13 14:59:18.810484 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:18.810454 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr"] Jul 13 14:59:18.812785 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:18.812760 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr" Jul 13 14:59:18.815432 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:18.815399 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 13 14:59:18.816365 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:18.816347 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 13 14:59:18.816438 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:18.816389 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ndlxh\"" Jul 13 14:59:18.825991 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:18.825971 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr"] Jul 13 14:59:18.889554 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:18.889516 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5k5r\" (UniqueName: \"kubernetes.io/projected/4f790422-5e97-4ad3-93b9-facea9f10f74-kube-api-access-v5k5r\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr\" (UID: \"4f790422-5e97-4ad3-93b9-facea9f10f74\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr" Jul 13 14:59:18.889554 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:18.889559 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f790422-5e97-4ad3-93b9-facea9f10f74-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr\" (UID: \"4f790422-5e97-4ad3-93b9-facea9f10f74\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr" Jul 13 14:59:18.889765 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:18.889625 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f790422-5e97-4ad3-93b9-facea9f10f74-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr\" (UID: \"4f790422-5e97-4ad3-93b9-facea9f10f74\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr" Jul 13 14:59:18.990527 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:18.990484 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f790422-5e97-4ad3-93b9-facea9f10f74-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr\" (UID: \"4f790422-5e97-4ad3-93b9-facea9f10f74\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr" Jul 13 14:59:18.990686 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:18.990562 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5k5r\" (UniqueName: \"kubernetes.io/projected/4f790422-5e97-4ad3-93b9-facea9f10f74-kube-api-access-v5k5r\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr\" (UID: \"4f790422-5e97-4ad3-93b9-facea9f10f74\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr" Jul 13 14:59:18.990686 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:18.990595 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f790422-5e97-4ad3-93b9-facea9f10f74-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr\" (UID: \"4f790422-5e97-4ad3-93b9-facea9f10f74\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr" Jul 13 14:59:18.991014 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:18.990989 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f790422-5e97-4ad3-93b9-facea9f10f74-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr\" (UID: \"4f790422-5e97-4ad3-93b9-facea9f10f74\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr" Jul 13 14:59:18.991140 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:18.991016 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f790422-5e97-4ad3-93b9-facea9f10f74-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr\" (UID: \"4f790422-5e97-4ad3-93b9-facea9f10f74\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr" Jul 13 14:59:19.000388 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:19.000366 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5k5r\" (UniqueName: \"kubernetes.io/projected/4f790422-5e97-4ad3-93b9-facea9f10f74-kube-api-access-v5k5r\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr\" (UID: \"4f790422-5e97-4ad3-93b9-facea9f10f74\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr" Jul 13 14:59:19.122007 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:19.121943 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr" Jul 13 14:59:19.248052 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:19.248025 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr"] Jul 13 14:59:19.250083 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:59:19.250053 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f790422_5e97_4ad3_93b9_facea9f10f74.slice/crio-11696db927040b041a75e56ece81fa544308deb63b0ed9b19795c42d779e3188 WatchSource:0}: Error finding container 11696db927040b041a75e56ece81fa544308deb63b0ed9b19795c42d779e3188: Status 404 returned error can't find the container with id 11696db927040b041a75e56ece81fa544308deb63b0ed9b19795c42d779e3188 Jul 13 14:59:19.317764 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:19.317736 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s"] Jul 13 14:59:19.320592 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:19.320575 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s" Jul 13 14:59:19.330527 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:19.330502 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s"] Jul 13 14:59:19.394131 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:19.394059 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhlxj\" (UniqueName: \"kubernetes.io/projected/c3c73acb-0441-4ecc-9395-025f4dfc2c9a-kube-api-access-zhlxj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s\" (UID: \"c3c73acb-0441-4ecc-9395-025f4dfc2c9a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s" Jul 13 14:59:19.394131 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:19.394102 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3c73acb-0441-4ecc-9395-025f4dfc2c9a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s\" (UID: \"c3c73acb-0441-4ecc-9395-025f4dfc2c9a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s" Jul 13 14:59:19.394302 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:19.394164 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3c73acb-0441-4ecc-9395-025f4dfc2c9a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s\" (UID: \"c3c73acb-0441-4ecc-9395-025f4dfc2c9a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s" Jul 13 14:59:19.495087 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:19.495049 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhlxj\" (UniqueName: \"kubernetes.io/projected/c3c73acb-0441-4ecc-9395-025f4dfc2c9a-kube-api-access-zhlxj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s\" (UID: \"c3c73acb-0441-4ecc-9395-025f4dfc2c9a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s" Jul 13 14:59:19.495263 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:19.495099 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3c73acb-0441-4ecc-9395-025f4dfc2c9a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s\" (UID: \"c3c73acb-0441-4ecc-9395-025f4dfc2c9a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s" Jul 13 14:59:19.495263 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:19.495133 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3c73acb-0441-4ecc-9395-025f4dfc2c9a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s\" (UID: \"c3c73acb-0441-4ecc-9395-025f4dfc2c9a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s" Jul 13 14:59:19.495481 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:19.495462 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3c73acb-0441-4ecc-9395-025f4dfc2c9a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s\" (UID: \"c3c73acb-0441-4ecc-9395-025f4dfc2c9a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s" Jul 13 14:59:19.495521 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:19.495491 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3c73acb-0441-4ecc-9395-025f4dfc2c9a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s\" (UID: \"c3c73acb-0441-4ecc-9395-025f4dfc2c9a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s" Jul 13 14:59:19.503945 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:19.503922 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhlxj\" (UniqueName: \"kubernetes.io/projected/c3c73acb-0441-4ecc-9395-025f4dfc2c9a-kube-api-access-zhlxj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s\" (UID: \"c3c73acb-0441-4ecc-9395-025f4dfc2c9a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s" Jul 13 14:59:19.630738 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:19.630703 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s" Jul 13 14:59:19.756924 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:19.756901 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s"] Jul 13 14:59:19.758293 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:59:19.758262 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3c73acb_0441_4ecc_9395_025f4dfc2c9a.slice/crio-2be9a437d5c2a3efcf8bf09d9f0fa4313daa0751662efdf5635b271e4fd92a0b WatchSource:0}: Error finding container 2be9a437d5c2a3efcf8bf09d9f0fa4313daa0751662efdf5635b271e4fd92a0b: Status 404 returned error can't find the container with id 2be9a437d5c2a3efcf8bf09d9f0fa4313daa0751662efdf5635b271e4fd92a0b Jul 13 14:59:19.918153 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:19.918122 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz"] Jul 13 14:59:19.920830 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:19.920813 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz" Jul 13 14:59:19.931091 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:19.931036 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz"] Jul 13 14:59:19.999081 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:19.999048 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be4308da-c131-41d2-a355-e2bd2ee87645-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz\" (UID: \"be4308da-c131-41d2-a355-e2bd2ee87645\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz" Jul 13 14:59:19.999197 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:19.999083 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbh57\" (UniqueName: \"kubernetes.io/projected/be4308da-c131-41d2-a355-e2bd2ee87645-kube-api-access-mbh57\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz\" (UID: \"be4308da-c131-41d2-a355-e2bd2ee87645\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz" Jul 13 14:59:19.999247 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:19.999193 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be4308da-c131-41d2-a355-e2bd2ee87645-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz\" (UID: \"be4308da-c131-41d2-a355-e2bd2ee87645\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz" Jul 13 14:59:20.000326 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:20.000301 2577 generic.go:356] "Generic (PLEG): container finished" podID="c3c73acb-0441-4ecc-9395-025f4dfc2c9a" containerID="60fd6be32d2b9378a0a5d049ca80b2979d1440b2b81eab9e9dbe0ebdb65c5437" exitCode=0 Jul 13 14:59:20.000416 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:20.000384 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s" event={"ID":"c3c73acb-0441-4ecc-9395-025f4dfc2c9a","Type":"ContainerDied","Data":"60fd6be32d2b9378a0a5d049ca80b2979d1440b2b81eab9e9dbe0ebdb65c5437"} Jul 13 14:59:20.000455 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:20.000424 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s" event={"ID":"c3c73acb-0441-4ecc-9395-025f4dfc2c9a","Type":"ContainerStarted","Data":"2be9a437d5c2a3efcf8bf09d9f0fa4313daa0751662efdf5635b271e4fd92a0b"} Jul 13 14:59:20.001960 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:20.001926 2577 generic.go:356] "Generic (PLEG): container finished" podID="4f790422-5e97-4ad3-93b9-facea9f10f74" containerID="6bb0eef72b80ccbec629d12cad5c83487f97d45178902e8a5b5d3828e2b6fabb" exitCode=0 Jul 13 14:59:20.001960 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:20.001952 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr" event={"ID":"4f790422-5e97-4ad3-93b9-facea9f10f74","Type":"ContainerDied","Data":"6bb0eef72b80ccbec629d12cad5c83487f97d45178902e8a5b5d3828e2b6fabb"} Jul 13 14:59:20.002140 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:20.001990 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr" event={"ID":"4f790422-5e97-4ad3-93b9-facea9f10f74","Type":"ContainerStarted","Data":"11696db927040b041a75e56ece81fa544308deb63b0ed9b19795c42d779e3188"} Jul 13 14:59:20.100353 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:20.100322 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be4308da-c131-41d2-a355-e2bd2ee87645-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz\" (UID: \"be4308da-c131-41d2-a355-e2bd2ee87645\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz" Jul 13 14:59:20.100475 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:20.100358 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbh57\" (UniqueName: \"kubernetes.io/projected/be4308da-c131-41d2-a355-e2bd2ee87645-kube-api-access-mbh57\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz\" (UID: \"be4308da-c131-41d2-a355-e2bd2ee87645\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz" Jul 13 14:59:20.100516 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:20.100501 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be4308da-c131-41d2-a355-e2bd2ee87645-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz\" (UID: \"be4308da-c131-41d2-a355-e2bd2ee87645\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz" Jul 13 14:59:20.100748 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:20.100728 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be4308da-c131-41d2-a355-e2bd2ee87645-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz\" (UID: \"be4308da-c131-41d2-a355-e2bd2ee87645\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz" Jul 13 14:59:20.100822 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:20.100805 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be4308da-c131-41d2-a355-e2bd2ee87645-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz\" (UID: \"be4308da-c131-41d2-a355-e2bd2ee87645\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz" Jul 13 14:59:20.109373 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:20.109352 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbh57\" (UniqueName: \"kubernetes.io/projected/be4308da-c131-41d2-a355-e2bd2ee87645-kube-api-access-mbh57\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz\" (UID: \"be4308da-c131-41d2-a355-e2bd2ee87645\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz" Jul 13 14:59:20.252411 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:20.252356 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz" Jul 13 14:59:20.380961 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:20.380936 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz"] Jul 13 14:59:20.383421 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:59:20.383393 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe4308da_c131_41d2_a355_e2bd2ee87645.slice/crio-3347630ace664f78cb7d690a74a691b4044de8e381555abd53823558f12d31e9 WatchSource:0}: Error finding container 3347630ace664f78cb7d690a74a691b4044de8e381555abd53823558f12d31e9: Status 404 returned error can't find the container with id 3347630ace664f78cb7d690a74a691b4044de8e381555abd53823558f12d31e9 Jul 13 14:59:20.522961 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:20.522893 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf"] Jul 13 14:59:20.525157 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:20.525140 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf" Jul 13 14:59:20.535134 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:20.535112 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf"] Jul 13 14:59:20.604215 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:20.604185 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpgsh\" (UniqueName: \"kubernetes.io/projected/7670c86e-475b-4a57-a382-4a25a9467fc0-kube-api-access-kpgsh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf\" (UID: \"7670c86e-475b-4a57-a382-4a25a9467fc0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf" Jul 13 14:59:20.604361 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:20.604223 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7670c86e-475b-4a57-a382-4a25a9467fc0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf\" (UID: \"7670c86e-475b-4a57-a382-4a25a9467fc0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf" Jul 13 14:59:20.604361 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:20.604242 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7670c86e-475b-4a57-a382-4a25a9467fc0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf\" (UID: \"7670c86e-475b-4a57-a382-4a25a9467fc0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf" Jul 13 14:59:20.705239 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:20.705205 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpgsh\" (UniqueName: \"kubernetes.io/projected/7670c86e-475b-4a57-a382-4a25a9467fc0-kube-api-access-kpgsh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf\" (UID: \"7670c86e-475b-4a57-a382-4a25a9467fc0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf" Jul 13 14:59:20.705402 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:20.705247 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7670c86e-475b-4a57-a382-4a25a9467fc0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf\" (UID: \"7670c86e-475b-4a57-a382-4a25a9467fc0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf" Jul 13 14:59:20.705402 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:20.705376 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7670c86e-475b-4a57-a382-4a25a9467fc0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf\" (UID: \"7670c86e-475b-4a57-a382-4a25a9467fc0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf" Jul 13 14:59:20.705615 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:20.705597 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7670c86e-475b-4a57-a382-4a25a9467fc0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf\" (UID: \"7670c86e-475b-4a57-a382-4a25a9467fc0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf" Jul 13 14:59:20.705674 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:20.705656 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7670c86e-475b-4a57-a382-4a25a9467fc0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf\" (UID: \"7670c86e-475b-4a57-a382-4a25a9467fc0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf" Jul 13 14:59:20.714689 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:20.714664 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpgsh\" (UniqueName: \"kubernetes.io/projected/7670c86e-475b-4a57-a382-4a25a9467fc0-kube-api-access-kpgsh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf\" (UID: \"7670c86e-475b-4a57-a382-4a25a9467fc0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf" Jul 13 14:59:20.839072 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:20.839000 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf" Jul 13 14:59:20.979877 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:20.979853 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf"] Jul 13 14:59:21.008813 ip-10-0-134-237 kubenswrapper[2577]: W0713 14:59:21.008753 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7670c86e_475b_4a57_a382_4a25a9467fc0.slice/crio-8bf1de17e10337d965060e5c5efc29e4f13aa1240d2854b8ea2ad6bd4b3071da WatchSource:0}: Error finding container 8bf1de17e10337d965060e5c5efc29e4f13aa1240d2854b8ea2ad6bd4b3071da: Status 404 returned error can't find the container with id 8bf1de17e10337d965060e5c5efc29e4f13aa1240d2854b8ea2ad6bd4b3071da Jul 13 14:59:21.010048 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:21.010018 2577 generic.go:356] "Generic (PLEG): container finished" podID="c3c73acb-0441-4ecc-9395-025f4dfc2c9a" containerID="8ad4b8583c0367074688bf82f7b82ba381639a7fddb40088ca751d508d768687" exitCode=0 Jul 13 14:59:21.010160 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:21.010111 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s" event={"ID":"c3c73acb-0441-4ecc-9395-025f4dfc2c9a","Type":"ContainerDied","Data":"8ad4b8583c0367074688bf82f7b82ba381639a7fddb40088ca751d508d768687"} Jul 13 14:59:21.012417 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:21.012387 2577 generic.go:356] "Generic (PLEG): container finished" podID="4f790422-5e97-4ad3-93b9-facea9f10f74" containerID="d01a0bd5f45a2511a698661ff5b6da38e46ba8cf78860ad80ede6b6ae1e7a9ee" exitCode=0 Jul 13 14:59:21.012527 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:21.012433 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr" event={"ID":"4f790422-5e97-4ad3-93b9-facea9f10f74","Type":"ContainerDied","Data":"d01a0bd5f45a2511a698661ff5b6da38e46ba8cf78860ad80ede6b6ae1e7a9ee"} Jul 13 14:59:21.014111 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:21.014089 2577 generic.go:356] "Generic (PLEG): container finished" podID="be4308da-c131-41d2-a355-e2bd2ee87645" containerID="fad344288af714b39f5a9d637c48aae3cca2367e453eb810382371f58bbc5fc8" exitCode=0 Jul 13 14:59:21.014191 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:21.014148 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz" event={"ID":"be4308da-c131-41d2-a355-e2bd2ee87645","Type":"ContainerDied","Data":"fad344288af714b39f5a9d637c48aae3cca2367e453eb810382371f58bbc5fc8"} Jul 13 14:59:21.014191 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:21.014182 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz" event={"ID":"be4308da-c131-41d2-a355-e2bd2ee87645","Type":"ContainerStarted","Data":"3347630ace664f78cb7d690a74a691b4044de8e381555abd53823558f12d31e9"} Jul 13 14:59:22.020316 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:22.020249 2577 generic.go:356] "Generic (PLEG): container finished" podID="7670c86e-475b-4a57-a382-4a25a9467fc0" containerID="b41531120b2bfc9265b1926d3b0c7be3bad1bd2ec24db0963453d69c6f361e94" exitCode=0 Jul 13 14:59:22.020670 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:22.020344 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf" event={"ID":"7670c86e-475b-4a57-a382-4a25a9467fc0","Type":"ContainerDied","Data":"b41531120b2bfc9265b1926d3b0c7be3bad1bd2ec24db0963453d69c6f361e94"} Jul 13 14:59:22.020670 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:22.020447 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf" event={"ID":"7670c86e-475b-4a57-a382-4a25a9467fc0","Type":"ContainerStarted","Data":"8bf1de17e10337d965060e5c5efc29e4f13aa1240d2854b8ea2ad6bd4b3071da"} Jul 13 14:59:22.022519 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:22.022497 2577 generic.go:356] "Generic (PLEG): container finished" podID="c3c73acb-0441-4ecc-9395-025f4dfc2c9a" containerID="5aa6dfd41828456db1bad9154a16dd71320b231d4631d50f47258591f8e9e63b" exitCode=0 Jul 13 14:59:22.022605 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:22.022581 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s" event={"ID":"c3c73acb-0441-4ecc-9395-025f4dfc2c9a","Type":"ContainerDied","Data":"5aa6dfd41828456db1bad9154a16dd71320b231d4631d50f47258591f8e9e63b"} Jul 13 14:59:22.024846 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:22.024821 2577 generic.go:356] "Generic (PLEG): container finished" podID="4f790422-5e97-4ad3-93b9-facea9f10f74" containerID="8a8a61fb690be41f4cf6051ee643793224e2c44f92632aa4b86e66bbbb48c9a1" exitCode=0 Jul 13 14:59:22.024948 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:22.024903 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr" event={"ID":"4f790422-5e97-4ad3-93b9-facea9f10f74","Type":"ContainerDied","Data":"8a8a61fb690be41f4cf6051ee643793224e2c44f92632aa4b86e66bbbb48c9a1"} Jul 13 14:59:22.029439 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:22.029417 2577 generic.go:356] "Generic (PLEG): container finished" podID="be4308da-c131-41d2-a355-e2bd2ee87645" containerID="ba46dd6627153d5403b1345dedaf10da81b1b5a2d48ddd894990d0db0eccac0a" exitCode=0 Jul 13 14:59:22.029556 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:22.029458 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz" event={"ID":"be4308da-c131-41d2-a355-e2bd2ee87645","Type":"ContainerDied","Data":"ba46dd6627153d5403b1345dedaf10da81b1b5a2d48ddd894990d0db0eccac0a"} Jul 13 14:59:23.037256 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:23.037222 2577 generic.go:356] "Generic (PLEG): container finished" podID="be4308da-c131-41d2-a355-e2bd2ee87645" containerID="e41bf6d95994b41894e21b946b28fccb7657cd4b132d4417a0a6819c560dd7da" exitCode=0 Jul 13 14:59:23.037690 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:23.037298 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz" event={"ID":"be4308da-c131-41d2-a355-e2bd2ee87645","Type":"ContainerDied","Data":"e41bf6d95994b41894e21b946b28fccb7657cd4b132d4417a0a6819c560dd7da"} Jul 13 14:59:23.039145 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:23.039124 2577 generic.go:356] "Generic (PLEG): container finished" podID="7670c86e-475b-4a57-a382-4a25a9467fc0" containerID="3518b00df87c5b44395388a2fa5c44a87c49fe749e26acd0e66c99d307104082" exitCode=0 Jul 13 14:59:23.039225 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:23.039190 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf" event={"ID":"7670c86e-475b-4a57-a382-4a25a9467fc0","Type":"ContainerDied","Data":"3518b00df87c5b44395388a2fa5c44a87c49fe749e26acd0e66c99d307104082"} Jul 13 14:59:23.183960 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:23.183934 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr" Jul 13 14:59:23.210333 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:23.210306 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s" Jul 13 14:59:23.229616 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:23.229593 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f790422-5e97-4ad3-93b9-facea9f10f74-bundle\") pod \"4f790422-5e97-4ad3-93b9-facea9f10f74\" (UID: \"4f790422-5e97-4ad3-93b9-facea9f10f74\") " Jul 13 14:59:23.229811 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:23.229649 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f790422-5e97-4ad3-93b9-facea9f10f74-util\") pod \"4f790422-5e97-4ad3-93b9-facea9f10f74\" (UID: \"4f790422-5e97-4ad3-93b9-facea9f10f74\") " Jul 13 14:59:23.229811 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:23.229689 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5k5r\" (UniqueName: \"kubernetes.io/projected/4f790422-5e97-4ad3-93b9-facea9f10f74-kube-api-access-v5k5r\") pod \"4f790422-5e97-4ad3-93b9-facea9f10f74\" (UID: \"4f790422-5e97-4ad3-93b9-facea9f10f74\") " Jul 13 14:59:23.230393 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:23.230353 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f790422-5e97-4ad3-93b9-facea9f10f74-bundle" (OuterVolumeSpecName: "bundle") pod "4f790422-5e97-4ad3-93b9-facea9f10f74" (UID: "4f790422-5e97-4ad3-93b9-facea9f10f74"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 14:59:23.232354 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:23.232325 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f790422-5e97-4ad3-93b9-facea9f10f74-kube-api-access-v5k5r" (OuterVolumeSpecName: "kube-api-access-v5k5r") pod "4f790422-5e97-4ad3-93b9-facea9f10f74" (UID: "4f790422-5e97-4ad3-93b9-facea9f10f74"). InnerVolumeSpecName "kube-api-access-v5k5r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 14:59:23.235966 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:23.235940 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f790422-5e97-4ad3-93b9-facea9f10f74-util" (OuterVolumeSpecName: "util") pod "4f790422-5e97-4ad3-93b9-facea9f10f74" (UID: "4f790422-5e97-4ad3-93b9-facea9f10f74"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 14:59:23.330811 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:23.330729 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3c73acb-0441-4ecc-9395-025f4dfc2c9a-util\") pod \"c3c73acb-0441-4ecc-9395-025f4dfc2c9a\" (UID: \"c3c73acb-0441-4ecc-9395-025f4dfc2c9a\") " Jul 13 14:59:23.330811 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:23.330766 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3c73acb-0441-4ecc-9395-025f4dfc2c9a-bundle\") pod \"c3c73acb-0441-4ecc-9395-025f4dfc2c9a\" (UID: \"c3c73acb-0441-4ecc-9395-025f4dfc2c9a\") " Jul 13 14:59:23.330947 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:23.330816 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhlxj\" (UniqueName: \"kubernetes.io/projected/c3c73acb-0441-4ecc-9395-025f4dfc2c9a-kube-api-access-zhlxj\") pod \"c3c73acb-0441-4ecc-9395-025f4dfc2c9a\" (UID: \"c3c73acb-0441-4ecc-9395-025f4dfc2c9a\") " Jul 13 14:59:23.331069 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:23.331051 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f790422-5e97-4ad3-93b9-facea9f10f74-bundle\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:59:23.331101 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:23.331074 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f790422-5e97-4ad3-93b9-facea9f10f74-util\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:59:23.331101 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:23.331089 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5k5r\" (UniqueName: \"kubernetes.io/projected/4f790422-5e97-4ad3-93b9-facea9f10f74-kube-api-access-v5k5r\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:59:23.331365 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:23.331339 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3c73acb-0441-4ecc-9395-025f4dfc2c9a-bundle" (OuterVolumeSpecName: "bundle") pod "c3c73acb-0441-4ecc-9395-025f4dfc2c9a" (UID: "c3c73acb-0441-4ecc-9395-025f4dfc2c9a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 14:59:23.332770 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:23.332752 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3c73acb-0441-4ecc-9395-025f4dfc2c9a-kube-api-access-zhlxj" (OuterVolumeSpecName: "kube-api-access-zhlxj") pod "c3c73acb-0441-4ecc-9395-025f4dfc2c9a" (UID: "c3c73acb-0441-4ecc-9395-025f4dfc2c9a"). InnerVolumeSpecName "kube-api-access-zhlxj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 14:59:23.335844 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:23.335822 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3c73acb-0441-4ecc-9395-025f4dfc2c9a-util" (OuterVolumeSpecName: "util") pod "c3c73acb-0441-4ecc-9395-025f4dfc2c9a" (UID: "c3c73acb-0441-4ecc-9395-025f4dfc2c9a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 14:59:23.431912 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:23.431887 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3c73acb-0441-4ecc-9395-025f4dfc2c9a-util\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:59:23.431912 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:23.431913 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3c73acb-0441-4ecc-9395-025f4dfc2c9a-bundle\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:59:23.432028 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:23.431926 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhlxj\" (UniqueName: \"kubernetes.io/projected/c3c73acb-0441-4ecc-9395-025f4dfc2c9a-kube-api-access-zhlxj\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:59:24.046034 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:24.046003 2577 generic.go:356] "Generic (PLEG): container finished" podID="7670c86e-475b-4a57-a382-4a25a9467fc0" containerID="861a34678bd18a48b1aceadf6472e5364a77ba59abff209d08de841beeff9f18" exitCode=0 Jul 13 14:59:24.046453 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:24.046098 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf" event={"ID":"7670c86e-475b-4a57-a382-4a25a9467fc0","Type":"ContainerDied","Data":"861a34678bd18a48b1aceadf6472e5364a77ba59abff209d08de841beeff9f18"} Jul 13 14:59:24.047743 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:24.047727 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s" Jul 13 14:59:24.047862 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:24.047749 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s" event={"ID":"c3c73acb-0441-4ecc-9395-025f4dfc2c9a","Type":"ContainerDied","Data":"2be9a437d5c2a3efcf8bf09d9f0fa4313daa0751662efdf5635b271e4fd92a0b"} Jul 13 14:59:24.047862 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:24.047796 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2be9a437d5c2a3efcf8bf09d9f0fa4313daa0751662efdf5635b271e4fd92a0b" Jul 13 14:59:24.049611 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:24.049587 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr" event={"ID":"4f790422-5e97-4ad3-93b9-facea9f10f74","Type":"ContainerDied","Data":"11696db927040b041a75e56ece81fa544308deb63b0ed9b19795c42d779e3188"} Jul 13 14:59:24.049741 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:24.049628 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11696db927040b041a75e56ece81fa544308deb63b0ed9b19795c42d779e3188" Jul 13 14:59:24.049741 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:24.049637 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr" Jul 13 14:59:24.182812 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:24.179601 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz" Jul 13 14:59:24.239581 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:24.239553 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be4308da-c131-41d2-a355-e2bd2ee87645-bundle\") pod \"be4308da-c131-41d2-a355-e2bd2ee87645\" (UID: \"be4308da-c131-41d2-a355-e2bd2ee87645\") " Jul 13 14:59:24.239739 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:24.239653 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be4308da-c131-41d2-a355-e2bd2ee87645-util\") pod \"be4308da-c131-41d2-a355-e2bd2ee87645\" (UID: \"be4308da-c131-41d2-a355-e2bd2ee87645\") " Jul 13 14:59:24.239739 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:24.239700 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbh57\" (UniqueName: \"kubernetes.io/projected/be4308da-c131-41d2-a355-e2bd2ee87645-kube-api-access-mbh57\") pod \"be4308da-c131-41d2-a355-e2bd2ee87645\" (UID: \"be4308da-c131-41d2-a355-e2bd2ee87645\") " Jul 13 14:59:24.240086 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:24.240054 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be4308da-c131-41d2-a355-e2bd2ee87645-bundle" (OuterVolumeSpecName: "bundle") pod "be4308da-c131-41d2-a355-e2bd2ee87645" (UID: "be4308da-c131-41d2-a355-e2bd2ee87645"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 14:59:24.241765 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:24.241736 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be4308da-c131-41d2-a355-e2bd2ee87645-kube-api-access-mbh57" (OuterVolumeSpecName: "kube-api-access-mbh57") pod "be4308da-c131-41d2-a355-e2bd2ee87645" (UID: "be4308da-c131-41d2-a355-e2bd2ee87645"). InnerVolumeSpecName "kube-api-access-mbh57". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 14:59:24.247511 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:24.247485 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be4308da-c131-41d2-a355-e2bd2ee87645-util" (OuterVolumeSpecName: "util") pod "be4308da-c131-41d2-a355-e2bd2ee87645" (UID: "be4308da-c131-41d2-a355-e2bd2ee87645"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 14:59:24.340500 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:24.340445 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbh57\" (UniqueName: \"kubernetes.io/projected/be4308da-c131-41d2-a355-e2bd2ee87645-kube-api-access-mbh57\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:59:24.340500 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:24.340466 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be4308da-c131-41d2-a355-e2bd2ee87645-bundle\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:59:24.340500 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:24.340477 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be4308da-c131-41d2-a355-e2bd2ee87645-util\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:59:25.059236 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:25.059205 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz" Jul 13 14:59:25.059236 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:25.059227 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz" event={"ID":"be4308da-c131-41d2-a355-e2bd2ee87645","Type":"ContainerDied","Data":"3347630ace664f78cb7d690a74a691b4044de8e381555abd53823558f12d31e9"} Jul 13 14:59:25.059665 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:25.059277 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3347630ace664f78cb7d690a74a691b4044de8e381555abd53823558f12d31e9" Jul 13 14:59:25.178969 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:25.178948 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf" Jul 13 14:59:25.247875 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:25.247849 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7670c86e-475b-4a57-a382-4a25a9467fc0-util\") pod \"7670c86e-475b-4a57-a382-4a25a9467fc0\" (UID: \"7670c86e-475b-4a57-a382-4a25a9467fc0\") " Jul 13 14:59:25.248023 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:25.247909 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7670c86e-475b-4a57-a382-4a25a9467fc0-bundle\") pod \"7670c86e-475b-4a57-a382-4a25a9467fc0\" (UID: \"7670c86e-475b-4a57-a382-4a25a9467fc0\") " Jul 13 14:59:25.248023 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:25.247969 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpgsh\" (UniqueName: \"kubernetes.io/projected/7670c86e-475b-4a57-a382-4a25a9467fc0-kube-api-access-kpgsh\") pod \"7670c86e-475b-4a57-a382-4a25a9467fc0\" (UID: \"7670c86e-475b-4a57-a382-4a25a9467fc0\") " Jul 13 14:59:25.248511 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:25.248479 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7670c86e-475b-4a57-a382-4a25a9467fc0-bundle" (OuterVolumeSpecName: "bundle") pod "7670c86e-475b-4a57-a382-4a25a9467fc0" (UID: "7670c86e-475b-4a57-a382-4a25a9467fc0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 14:59:25.250061 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:25.250036 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7670c86e-475b-4a57-a382-4a25a9467fc0-kube-api-access-kpgsh" (OuterVolumeSpecName: "kube-api-access-kpgsh") pod "7670c86e-475b-4a57-a382-4a25a9467fc0" (UID: "7670c86e-475b-4a57-a382-4a25a9467fc0"). InnerVolumeSpecName "kube-api-access-kpgsh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 14:59:25.253647 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:25.253623 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7670c86e-475b-4a57-a382-4a25a9467fc0-util" (OuterVolumeSpecName: "util") pod "7670c86e-475b-4a57-a382-4a25a9467fc0" (UID: "7670c86e-475b-4a57-a382-4a25a9467fc0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 14:59:25.349529 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:25.349469 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpgsh\" (UniqueName: \"kubernetes.io/projected/7670c86e-475b-4a57-a382-4a25a9467fc0-kube-api-access-kpgsh\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:59:25.349529 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:25.349493 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7670c86e-475b-4a57-a382-4a25a9467fc0-util\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:59:25.349529 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:25.349506 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7670c86e-475b-4a57-a382-4a25a9467fc0-bundle\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 14:59:26.066346 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:26.066312 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf" event={"ID":"7670c86e-475b-4a57-a382-4a25a9467fc0","Type":"ContainerDied","Data":"8bf1de17e10337d965060e5c5efc29e4f13aa1240d2854b8ea2ad6bd4b3071da"} Jul 13 14:59:26.066772 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:26.066357 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8bf1de17e10337d965060e5c5efc29e4f13aa1240d2854b8ea2ad6bd4b3071da" Jul 13 14:59:26.066772 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:26.066361 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf" Jul 13 14:59:36.761159 ip-10-0-134-237 kubenswrapper[2577]: I0713 14:59:36.761128 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c77f6d798-vk8dx"] Jul 13 15:00:01.781761 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:01.781706 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c77f6d798-vk8dx" podUID="4f783bee-3b51-4f26-a438-2481add86752" containerName="console" containerID="cri-o://935f6b3e0f29d436cb1399baeebdb401744cf8d6c53cea366004bdc5b978a4c8" gracePeriod=15 Jul 13 15:00:02.029931 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.029909 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c77f6d798-vk8dx" Jul 13 15:00:02.034685 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.034645 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f783bee-3b51-4f26-a438-2481add86752-trusted-ca-bundle\") pod \"4f783bee-3b51-4f26-a438-2481add86752\" (UID: \"4f783bee-3b51-4f26-a438-2481add86752\") " Jul 13 15:00:02.034685 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.034678 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f783bee-3b51-4f26-a438-2481add86752-console-oauth-config\") pod \"4f783bee-3b51-4f26-a438-2481add86752\" (UID: \"4f783bee-3b51-4f26-a438-2481add86752\") " Jul 13 15:00:02.034809 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.034712 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnp2p\" (UniqueName: \"kubernetes.io/projected/4f783bee-3b51-4f26-a438-2481add86752-kube-api-access-bnp2p\") pod \"4f783bee-3b51-4f26-a438-2481add86752\" (UID: \"4f783bee-3b51-4f26-a438-2481add86752\") " Jul 13 15:00:02.034809 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.034773 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f783bee-3b51-4f26-a438-2481add86752-service-ca\") pod \"4f783bee-3b51-4f26-a438-2481add86752\" (UID: \"4f783bee-3b51-4f26-a438-2481add86752\") " Jul 13 15:00:02.034886 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.034842 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f783bee-3b51-4f26-a438-2481add86752-console-serving-cert\") pod \"4f783bee-3b51-4f26-a438-2481add86752\" (UID: \"4f783bee-3b51-4f26-a438-2481add86752\") " Jul 13 15:00:02.034886 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.034871 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f783bee-3b51-4f26-a438-2481add86752-oauth-serving-cert\") pod \"4f783bee-3b51-4f26-a438-2481add86752\" (UID: \"4f783bee-3b51-4f26-a438-2481add86752\") " Jul 13 15:00:02.034990 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.034923 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f783bee-3b51-4f26-a438-2481add86752-console-config\") pod \"4f783bee-3b51-4f26-a438-2481add86752\" (UID: \"4f783bee-3b51-4f26-a438-2481add86752\") " Jul 13 15:00:02.035062 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.035032 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f783bee-3b51-4f26-a438-2481add86752-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4f783bee-3b51-4f26-a438-2481add86752" (UID: "4f783bee-3b51-4f26-a438-2481add86752"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 15:00:02.035225 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.035205 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f783bee-3b51-4f26-a438-2481add86752-trusted-ca-bundle\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:00:02.035304 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.035204 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f783bee-3b51-4f26-a438-2481add86752-service-ca" (OuterVolumeSpecName: "service-ca") pod "4f783bee-3b51-4f26-a438-2481add86752" (UID: "4f783bee-3b51-4f26-a438-2481add86752"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 15:00:02.035363 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.035267 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f783bee-3b51-4f26-a438-2481add86752-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4f783bee-3b51-4f26-a438-2481add86752" (UID: "4f783bee-3b51-4f26-a438-2481add86752"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 15:00:02.035425 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.035384 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f783bee-3b51-4f26-a438-2481add86752-console-config" (OuterVolumeSpecName: "console-config") pod "4f783bee-3b51-4f26-a438-2481add86752" (UID: "4f783bee-3b51-4f26-a438-2481add86752"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 15:00:02.036772 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.036748 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f783bee-3b51-4f26-a438-2481add86752-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4f783bee-3b51-4f26-a438-2481add86752" (UID: "4f783bee-3b51-4f26-a438-2481add86752"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 15:00:02.036992 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.036968 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f783bee-3b51-4f26-a438-2481add86752-kube-api-access-bnp2p" (OuterVolumeSpecName: "kube-api-access-bnp2p") pod "4f783bee-3b51-4f26-a438-2481add86752" (UID: "4f783bee-3b51-4f26-a438-2481add86752"). InnerVolumeSpecName "kube-api-access-bnp2p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 15:00:02.037046 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.037027 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f783bee-3b51-4f26-a438-2481add86752-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4f783bee-3b51-4f26-a438-2481add86752" (UID: "4f783bee-3b51-4f26-a438-2481add86752"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 15:00:02.136477 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.136452 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f783bee-3b51-4f26-a438-2481add86752-oauth-serving-cert\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:00:02.136477 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.136474 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f783bee-3b51-4f26-a438-2481add86752-console-config\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:00:02.136625 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.136484 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f783bee-3b51-4f26-a438-2481add86752-console-oauth-config\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:00:02.136625 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.136494 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnp2p\" (UniqueName: \"kubernetes.io/projected/4f783bee-3b51-4f26-a438-2481add86752-kube-api-access-bnp2p\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:00:02.136625 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.136502 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f783bee-3b51-4f26-a438-2481add86752-service-ca\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:00:02.136625 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.136510 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f783bee-3b51-4f26-a438-2481add86752-console-serving-cert\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:00:02.237382 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.237357 2577 generic.go:356] "Generic (PLEG): container finished" podID="4f783bee-3b51-4f26-a438-2481add86752" containerID="935f6b3e0f29d436cb1399baeebdb401744cf8d6c53cea366004bdc5b978a4c8" exitCode=0 Jul 13 15:00:02.237489 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.237402 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c77f6d798-vk8dx" Jul 13 15:00:02.237489 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.237410 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c77f6d798-vk8dx" event={"ID":"4f783bee-3b51-4f26-a438-2481add86752","Type":"ContainerDied","Data":"935f6b3e0f29d436cb1399baeebdb401744cf8d6c53cea366004bdc5b978a4c8"} Jul 13 15:00:02.237489 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.237447 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c77f6d798-vk8dx" event={"ID":"4f783bee-3b51-4f26-a438-2481add86752","Type":"ContainerDied","Data":"5673a0128c2084838c08a78acb78275a4a137b1ea7f53bea601c0a2b4213ef47"} Jul 13 15:00:02.237489 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.237467 2577 scope.go:117] "RemoveContainer" containerID="935f6b3e0f29d436cb1399baeebdb401744cf8d6c53cea366004bdc5b978a4c8" Jul 13 15:00:02.246462 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.246446 2577 scope.go:117] "RemoveContainer" containerID="935f6b3e0f29d436cb1399baeebdb401744cf8d6c53cea366004bdc5b978a4c8" Jul 13 15:00:02.246719 ip-10-0-134-237 kubenswrapper[2577]: E0713 15:00:02.246695 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"935f6b3e0f29d436cb1399baeebdb401744cf8d6c53cea366004bdc5b978a4c8\": container with ID starting with 935f6b3e0f29d436cb1399baeebdb401744cf8d6c53cea366004bdc5b978a4c8 not found: ID does not exist" containerID="935f6b3e0f29d436cb1399baeebdb401744cf8d6c53cea366004bdc5b978a4c8" Jul 13 15:00:02.246836 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.246724 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"935f6b3e0f29d436cb1399baeebdb401744cf8d6c53cea366004bdc5b978a4c8"} err="failed to get container status \"935f6b3e0f29d436cb1399baeebdb401744cf8d6c53cea366004bdc5b978a4c8\": rpc error: code = NotFound desc = could not find container \"935f6b3e0f29d436cb1399baeebdb401744cf8d6c53cea366004bdc5b978a4c8\": container with ID starting with 935f6b3e0f29d436cb1399baeebdb401744cf8d6c53cea366004bdc5b978a4c8 not found: ID does not exist" Jul 13 15:00:02.259523 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.259498 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c77f6d798-vk8dx"] Jul 13 15:00:02.264650 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:02.264631 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c77f6d798-vk8dx"] Jul 13 15:00:03.345387 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:03.345354 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f783bee-3b51-4f26-a438-2481add86752" path="/var/lib/kubelet/pods/4f783bee-3b51-4f26-a438-2481add86752/volumes" Jul 13 15:00:50.548263 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548230 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548496 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3c73acb-0441-4ecc-9395-025f4dfc2c9a" containerName="util" Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548506 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3c73acb-0441-4ecc-9395-025f4dfc2c9a" containerName="util" Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548519 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7670c86e-475b-4a57-a382-4a25a9467fc0" containerName="util" Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548524 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7670c86e-475b-4a57-a382-4a25a9467fc0" containerName="util" Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548533 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7670c86e-475b-4a57-a382-4a25a9467fc0" containerName="extract" Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548538 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7670c86e-475b-4a57-a382-4a25a9467fc0" containerName="extract" Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548546 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f790422-5e97-4ad3-93b9-facea9f10f74" containerName="util" Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548551 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f790422-5e97-4ad3-93b9-facea9f10f74" containerName="util" Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548557 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3c73acb-0441-4ecc-9395-025f4dfc2c9a" containerName="pull" Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548563 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3c73acb-0441-4ecc-9395-025f4dfc2c9a" containerName="pull" Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548570 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f783bee-3b51-4f26-a438-2481add86752" containerName="console" Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548577 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f783bee-3b51-4f26-a438-2481add86752" containerName="console" Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548584 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be4308da-c131-41d2-a355-e2bd2ee87645" containerName="util" Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548589 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="be4308da-c131-41d2-a355-e2bd2ee87645" containerName="util" Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548596 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3c73acb-0441-4ecc-9395-025f4dfc2c9a" containerName="extract" Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548601 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3c73acb-0441-4ecc-9395-025f4dfc2c9a" containerName="extract" Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548606 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be4308da-c131-41d2-a355-e2bd2ee87645" containerName="pull" Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548610 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="be4308da-c131-41d2-a355-e2bd2ee87645" containerName="pull" Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548621 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f790422-5e97-4ad3-93b9-facea9f10f74" containerName="pull" Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548625 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f790422-5e97-4ad3-93b9-facea9f10f74" containerName="pull" Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548632 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f790422-5e97-4ad3-93b9-facea9f10f74" containerName="extract" Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548638 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f790422-5e97-4ad3-93b9-facea9f10f74" containerName="extract" Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548643 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be4308da-c131-41d2-a355-e2bd2ee87645" containerName="extract" Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548648 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="be4308da-c131-41d2-a355-e2bd2ee87645" containerName="extract" Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548652 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7670c86e-475b-4a57-a382-4a25a9467fc0" containerName="pull" Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548657 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7670c86e-475b-4a57-a382-4a25a9467fc0" containerName="pull" Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548703 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f790422-5e97-4ad3-93b9-facea9f10f74" containerName="extract" Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548711 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7670c86e-475b-4a57-a382-4a25a9467fc0" containerName="extract" Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548717 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="be4308da-c131-41d2-a355-e2bd2ee87645" containerName="extract" Jul 13 15:00:50.548711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548724 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3c73acb-0441-4ecc-9395-025f4dfc2c9a" containerName="extract" Jul 13 15:00:50.549585 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.548731 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f783bee-3b51-4f26-a438-2481add86752" containerName="console" Jul 13 15:00:50.550828 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.550812 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-4kmfc" Jul 13 15:00:50.556095 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.556073 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 13 15:00:50.556363 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.556348 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ndlxh\"" Jul 13 15:00:50.557399 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.557380 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 13 15:00:50.562025 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.562009 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 13 15:00:50.573962 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.573935 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:00:50.645496 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.645467 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:00:50.681748 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.681717 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6039f024-dbf0-4059-a45d-5a46553a142b-config-file\") pod \"limitador-limitador-54d6d988d5-4kmfc\" (UID: \"6039f024-dbf0-4059-a45d-5a46553a142b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4kmfc" Jul 13 15:00:50.681844 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.681812 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt8sp\" (UniqueName: \"kubernetes.io/projected/6039f024-dbf0-4059-a45d-5a46553a142b-kube-api-access-gt8sp\") pod \"limitador-limitador-54d6d988d5-4kmfc\" (UID: \"6039f024-dbf0-4059-a45d-5a46553a142b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4kmfc" Jul 13 15:00:50.782873 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.782850 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt8sp\" (UniqueName: \"kubernetes.io/projected/6039f024-dbf0-4059-a45d-5a46553a142b-kube-api-access-gt8sp\") pod \"limitador-limitador-54d6d988d5-4kmfc\" (UID: \"6039f024-dbf0-4059-a45d-5a46553a142b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4kmfc" Jul 13 15:00:50.782972 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.782890 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6039f024-dbf0-4059-a45d-5a46553a142b-config-file\") pod \"limitador-limitador-54d6d988d5-4kmfc\" (UID: \"6039f024-dbf0-4059-a45d-5a46553a142b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4kmfc" Jul 13 15:00:50.783405 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.783388 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6039f024-dbf0-4059-a45d-5a46553a142b-config-file\") pod \"limitador-limitador-54d6d988d5-4kmfc\" (UID: \"6039f024-dbf0-4059-a45d-5a46553a142b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4kmfc" Jul 13 15:00:50.791243 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.791223 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt8sp\" (UniqueName: \"kubernetes.io/projected/6039f024-dbf0-4059-a45d-5a46553a142b-kube-api-access-gt8sp\") pod \"limitador-limitador-54d6d988d5-4kmfc\" (UID: \"6039f024-dbf0-4059-a45d-5a46553a142b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4kmfc" Jul 13 15:00:50.860667 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:50.860616 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-4kmfc" Jul 13 15:00:51.021347 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:51.021323 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:00:51.023409 ip-10-0-134-237 kubenswrapper[2577]: W0713 15:00:51.023381 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6039f024_dbf0_4059_a45d_5a46553a142b.slice/crio-77362f3542179d7eec92cd2d2f75b9a66fba4f4578409cb0ef40c986da36cb6f WatchSource:0}: Error finding container 77362f3542179d7eec92cd2d2f75b9a66fba4f4578409cb0ef40c986da36cb6f: Status 404 returned error can't find the container with id 77362f3542179d7eec92cd2d2f75b9a66fba4f4578409cb0ef40c986da36cb6f Jul 13 15:00:51.471691 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:51.471659 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-4kmfc" event={"ID":"6039f024-dbf0-4059-a45d-5a46553a142b","Type":"ContainerStarted","Data":"77362f3542179d7eec92cd2d2f75b9a66fba4f4578409cb0ef40c986da36cb6f"} Jul 13 15:00:55.492790 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:55.492753 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-4kmfc" event={"ID":"6039f024-dbf0-4059-a45d-5a46553a142b","Type":"ContainerStarted","Data":"7ee644c99ae6d2d20087de9462a38090f8685a26840647e103463c0f92a974b3"} Jul 13 15:00:55.493151 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:55.492834 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-4kmfc" Jul 13 15:00:55.512988 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:00:55.512943 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-4kmfc" podStartSLOduration=1.8434653829999998 podStartE2EDuration="5.512930321s" totalImagesPullingTime="3.669464938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:00:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:00:55.510625567 +0000 UTC m=+479.577198033" watchObservedRunningTime="2026-07-13 15:00:55.512930321 +0000 UTC m=+479.579502786" Jul 13 15:01:06.498031 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:01:06.497998 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-4kmfc" Jul 13 15:02:18.505653 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:02:18.505621 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:02:43.283220 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:02:43.283187 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:02:49.943412 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:02:49.943378 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:02:59.680761 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:02:59.680717 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:03:10.786409 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:10.786375 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:03:42.781741 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:42.781711 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l"] Jul 13 15:03:42.784842 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:42.784824 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l" Jul 13 15:03:42.788311 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:42.788270 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 13 15:03:42.788311 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:42.788274 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 13 15:03:42.788470 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:42.788352 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ttcck\"" Jul 13 15:03:42.788470 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:42.788357 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 13 15:03:42.796137 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:42.796118 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l"] Jul 13 15:03:42.863383 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:42.863354 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phmpr\" (UniqueName: \"kubernetes.io/projected/024b23fd-7e35-4bf2-8227-e5e7e7b307d1-kube-api-access-phmpr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n9x5l\" (UID: \"024b23fd-7e35-4bf2-8227-e5e7e7b307d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l" Jul 13 15:03:42.863514 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:42.863412 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/024b23fd-7e35-4bf2-8227-e5e7e7b307d1-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n9x5l\" (UID: \"024b23fd-7e35-4bf2-8227-e5e7e7b307d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l" Jul 13 15:03:42.863514 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:42.863451 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/024b23fd-7e35-4bf2-8227-e5e7e7b307d1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n9x5l\" (UID: \"024b23fd-7e35-4bf2-8227-e5e7e7b307d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l" Jul 13 15:03:42.863514 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:42.863474 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/024b23fd-7e35-4bf2-8227-e5e7e7b307d1-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n9x5l\" (UID: \"024b23fd-7e35-4bf2-8227-e5e7e7b307d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l" Jul 13 15:03:42.863514 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:42.863491 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/024b23fd-7e35-4bf2-8227-e5e7e7b307d1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n9x5l\" (UID: \"024b23fd-7e35-4bf2-8227-e5e7e7b307d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l" Jul 13 15:03:42.863646 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:42.863559 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/024b23fd-7e35-4bf2-8227-e5e7e7b307d1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n9x5l\" (UID: \"024b23fd-7e35-4bf2-8227-e5e7e7b307d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l" Jul 13 15:03:42.964530 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:42.964505 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/024b23fd-7e35-4bf2-8227-e5e7e7b307d1-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n9x5l\" (UID: \"024b23fd-7e35-4bf2-8227-e5e7e7b307d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l" Jul 13 15:03:42.964642 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:42.964539 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/024b23fd-7e35-4bf2-8227-e5e7e7b307d1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n9x5l\" (UID: \"024b23fd-7e35-4bf2-8227-e5e7e7b307d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l" Jul 13 15:03:42.964642 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:42.964561 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/024b23fd-7e35-4bf2-8227-e5e7e7b307d1-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n9x5l\" (UID: \"024b23fd-7e35-4bf2-8227-e5e7e7b307d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l" Jul 13 15:03:42.964642 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:42.964579 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/024b23fd-7e35-4bf2-8227-e5e7e7b307d1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n9x5l\" (UID: \"024b23fd-7e35-4bf2-8227-e5e7e7b307d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l" Jul 13 15:03:42.964642 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:42.964619 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/024b23fd-7e35-4bf2-8227-e5e7e7b307d1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n9x5l\" (UID: \"024b23fd-7e35-4bf2-8227-e5e7e7b307d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l" Jul 13 15:03:42.964875 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:42.964647 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phmpr\" (UniqueName: \"kubernetes.io/projected/024b23fd-7e35-4bf2-8227-e5e7e7b307d1-kube-api-access-phmpr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n9x5l\" (UID: \"024b23fd-7e35-4bf2-8227-e5e7e7b307d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l" Jul 13 15:03:42.965022 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:42.964965 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/024b23fd-7e35-4bf2-8227-e5e7e7b307d1-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n9x5l\" (UID: \"024b23fd-7e35-4bf2-8227-e5e7e7b307d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l" Jul 13 15:03:42.965124 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:42.965033 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/024b23fd-7e35-4bf2-8227-e5e7e7b307d1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n9x5l\" (UID: \"024b23fd-7e35-4bf2-8227-e5e7e7b307d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l" Jul 13 15:03:42.965124 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:42.965071 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/024b23fd-7e35-4bf2-8227-e5e7e7b307d1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n9x5l\" (UID: \"024b23fd-7e35-4bf2-8227-e5e7e7b307d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l" Jul 13 15:03:42.966865 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:42.966838 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/024b23fd-7e35-4bf2-8227-e5e7e7b307d1-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n9x5l\" (UID: \"024b23fd-7e35-4bf2-8227-e5e7e7b307d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l" Jul 13 15:03:42.967089 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:42.967072 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/024b23fd-7e35-4bf2-8227-e5e7e7b307d1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n9x5l\" (UID: \"024b23fd-7e35-4bf2-8227-e5e7e7b307d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l" Jul 13 15:03:42.972843 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:42.972823 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phmpr\" (UniqueName: \"kubernetes.io/projected/024b23fd-7e35-4bf2-8227-e5e7e7b307d1-kube-api-access-phmpr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n9x5l\" (UID: \"024b23fd-7e35-4bf2-8227-e5e7e7b307d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l" Jul 13 15:03:43.095584 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:43.095531 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l" Jul 13 15:03:43.223722 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:43.223694 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l"] Jul 13 15:03:43.225257 ip-10-0-134-237 kubenswrapper[2577]: W0713 15:03:43.225229 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod024b23fd_7e35_4bf2_8227_e5e7e7b307d1.slice/crio-9b5de7d0d988fb78a4fe947e1055d9d4522ad661e0e01c269ad8611cdb26b4f5 WatchSource:0}: Error finding container 9b5de7d0d988fb78a4fe947e1055d9d4522ad661e0e01c269ad8611cdb26b4f5: Status 404 returned error can't find the container with id 9b5de7d0d988fb78a4fe947e1055d9d4522ad661e0e01c269ad8611cdb26b4f5 Jul 13 15:03:43.226723 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:43.226702 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 15:03:43.267898 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:43.267874 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l" event={"ID":"024b23fd-7e35-4bf2-8227-e5e7e7b307d1","Type":"ContainerStarted","Data":"9b5de7d0d988fb78a4fe947e1055d9d4522ad661e0e01c269ad8611cdb26b4f5"} Jul 13 15:03:44.877486 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:44.877452 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:03:45.279104 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:45.279072 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l" event={"ID":"024b23fd-7e35-4bf2-8227-e5e7e7b307d1","Type":"ContainerStarted","Data":"885a9c9b5feb6c969069458deb0df1e341c7359ca8210c8798acdb9cb2cf985f"} Jul 13 15:03:45.299919 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:45.299870 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l" podStartSLOduration=2.217377942 podStartE2EDuration="3.299854017s" totalImagesPullingTime="1.082476075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:03:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:03:45.298600923 +0000 UTC m=+649.365173388" watchObservedRunningTime="2026-07-13 15:03:45.299854017 +0000 UTC m=+649.366426482" Jul 13 15:03:53.095974 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:53.095939 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l" Jul 13 15:03:53.096378 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:53.096011 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l" Jul 13 15:03:53.108352 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:53.108325 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l" Jul 13 15:03:53.335750 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:03:53.335720 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n9x5l" Jul 13 15:04:10.178684 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:10.178653 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss"] Jul 13 15:04:10.181854 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:10.181834 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss" Jul 13 15:04:10.184181 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:10.184161 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 13 15:04:10.192218 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:10.192200 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss"] Jul 13 15:04:10.277566 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:10.277541 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/162e68da-d153-4e7b-8eb9-42ece15f4a07-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss\" (UID: \"162e68da-d153-4e7b-8eb9-42ece15f4a07\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss" Jul 13 15:04:10.277709 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:10.277610 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrc44\" (UniqueName: \"kubernetes.io/projected/162e68da-d153-4e7b-8eb9-42ece15f4a07-kube-api-access-lrc44\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss\" (UID: \"162e68da-d153-4e7b-8eb9-42ece15f4a07\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss" Jul 13 15:04:10.277709 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:10.277632 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/162e68da-d153-4e7b-8eb9-42ece15f4a07-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss\" (UID: \"162e68da-d153-4e7b-8eb9-42ece15f4a07\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss" Jul 13 15:04:10.277709 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:10.277668 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/162e68da-d153-4e7b-8eb9-42ece15f4a07-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss\" (UID: \"162e68da-d153-4e7b-8eb9-42ece15f4a07\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss" Jul 13 15:04:10.277837 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:10.277720 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/162e68da-d153-4e7b-8eb9-42ece15f4a07-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss\" (UID: \"162e68da-d153-4e7b-8eb9-42ece15f4a07\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss" Jul 13 15:04:10.277837 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:10.277767 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/162e68da-d153-4e7b-8eb9-42ece15f4a07-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss\" (UID: \"162e68da-d153-4e7b-8eb9-42ece15f4a07\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss" Jul 13 15:04:10.379149 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:10.379113 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/162e68da-d153-4e7b-8eb9-42ece15f4a07-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss\" (UID: \"162e68da-d153-4e7b-8eb9-42ece15f4a07\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss" Jul 13 15:04:10.379149 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:10.379148 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/162e68da-d153-4e7b-8eb9-42ece15f4a07-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss\" (UID: \"162e68da-d153-4e7b-8eb9-42ece15f4a07\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss" Jul 13 15:04:10.379373 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:10.379170 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/162e68da-d153-4e7b-8eb9-42ece15f4a07-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss\" (UID: \"162e68da-d153-4e7b-8eb9-42ece15f4a07\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss" Jul 13 15:04:10.379373 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:10.379227 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrc44\" (UniqueName: \"kubernetes.io/projected/162e68da-d153-4e7b-8eb9-42ece15f4a07-kube-api-access-lrc44\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss\" (UID: \"162e68da-d153-4e7b-8eb9-42ece15f4a07\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss" Jul 13 15:04:10.379373 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:10.379245 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/162e68da-d153-4e7b-8eb9-42ece15f4a07-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss\" (UID: \"162e68da-d153-4e7b-8eb9-42ece15f4a07\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss" Jul 13 15:04:10.379373 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:10.379289 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/162e68da-d153-4e7b-8eb9-42ece15f4a07-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss\" (UID: \"162e68da-d153-4e7b-8eb9-42ece15f4a07\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss" Jul 13 15:04:10.379592 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:10.379571 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/162e68da-d153-4e7b-8eb9-42ece15f4a07-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss\" (UID: \"162e68da-d153-4e7b-8eb9-42ece15f4a07\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss" Jul 13 15:04:10.379662 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:10.379642 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/162e68da-d153-4e7b-8eb9-42ece15f4a07-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss\" (UID: \"162e68da-d153-4e7b-8eb9-42ece15f4a07\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss" Jul 13 15:04:10.379699 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:10.379676 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/162e68da-d153-4e7b-8eb9-42ece15f4a07-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss\" (UID: \"162e68da-d153-4e7b-8eb9-42ece15f4a07\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss" Jul 13 15:04:10.381421 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:10.381394 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/162e68da-d153-4e7b-8eb9-42ece15f4a07-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss\" (UID: \"162e68da-d153-4e7b-8eb9-42ece15f4a07\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss" Jul 13 15:04:10.381582 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:10.381563 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/162e68da-d153-4e7b-8eb9-42ece15f4a07-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss\" (UID: \"162e68da-d153-4e7b-8eb9-42ece15f4a07\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss" Jul 13 15:04:10.387547 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:10.387526 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrc44\" (UniqueName: \"kubernetes.io/projected/162e68da-d153-4e7b-8eb9-42ece15f4a07-kube-api-access-lrc44\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss\" (UID: \"162e68da-d153-4e7b-8eb9-42ece15f4a07\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss" Jul 13 15:04:10.490602 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:10.490536 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss" Jul 13 15:04:10.620246 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:10.620114 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss"] Jul 13 15:04:10.623041 ip-10-0-134-237 kubenswrapper[2577]: W0713 15:04:10.623011 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod162e68da_d153_4e7b_8eb9_42ece15f4a07.slice/crio-e3e54a09f6de29b022b134766a017b6de5a3417c890c7c8a7a3dd21c4b0faed2 WatchSource:0}: Error finding container e3e54a09f6de29b022b134766a017b6de5a3417c890c7c8a7a3dd21c4b0faed2: Status 404 returned error can't find the container with id e3e54a09f6de29b022b134766a017b6de5a3417c890c7c8a7a3dd21c4b0faed2 Jul 13 15:04:11.407860 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:11.407823 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss" event={"ID":"162e68da-d153-4e7b-8eb9-42ece15f4a07","Type":"ContainerStarted","Data":"4bd6b642eda0cab3ffbeeb81d835dced488826bdda906766177de8b383c7cf3f"} Jul 13 15:04:11.407860 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:11.407864 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss" event={"ID":"162e68da-d153-4e7b-8eb9-42ece15f4a07","Type":"ContainerStarted","Data":"e3e54a09f6de29b022b134766a017b6de5a3417c890c7c8a7a3dd21c4b0faed2"} Jul 13 15:04:11.427570 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:11.427527 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss" podStartSLOduration=1.171806287 podStartE2EDuration="1.427512901s" totalImagesPullingTime="255.706614ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:04:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:04:11.426291189 +0000 UTC m=+675.492863654" watchObservedRunningTime="2026-07-13 15:04:11.427512901 +0000 UTC m=+675.494085364" Jul 13 15:04:12.983662 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:12.983627 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:04:20.491456 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:20.491420 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss" Jul 13 15:04:20.491940 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:20.491604 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss" Jul 13 15:04:20.503880 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:20.503859 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss" Jul 13 15:04:21.466881 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:04:21.466856 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss" Jul 13 15:05:56.386413 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:05:56.386374 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:06:05.872458 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:06:05.872420 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:06:18.297520 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:06:18.297431 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:06:26.188958 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:06:26.188922 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:06:37.680230 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:06:37.680193 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:07:05.896729 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:07:05.896691 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:07:17.514514 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:07:17.514483 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:07:54.036859 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:07:54.036766 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:08:03.334051 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:08:03.334016 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:08:14.107883 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:08:14.107850 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:08:21.511466 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:08:21.511428 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:08:33.416791 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:08:33.416739 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:08:44.685137 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:08:44.685106 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:08:55.689458 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:08:55.689419 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:09:05.690621 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:09:05.690581 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:09:28.187197 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:09:28.187116 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:09:39.779474 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:09:39.779436 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:10:04.688676 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:10:04.688637 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:10:16.391301 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:10:16.391266 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:10:31.395819 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:10:31.395768 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:10:43.512139 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:10:43.512103 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:10:52.902526 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:10:52.902477 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:11:02.502434 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:11:02.502396 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:11:11.792984 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:11:11.792945 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:12:59.889618 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:12:59.889573 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:13:08.981040 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:13:08.980992 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:13:21.884846 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:13:21.884807 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:13:33.789329 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:13:33.789286 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:13:45.385761 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:13:45.385719 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:13:55.990554 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:13:55.990464 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:14:04.085089 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:14:04.085052 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:14:14.903699 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:14:14.903658 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:14:27.389272 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:14:27.389223 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:14:36.183161 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:14:36.183122 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:14:46.880240 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:14:46.880201 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:15:11.685604 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:15:11.685567 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:15:19.392257 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:15:19.392170 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:15:29.485219 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:15:29.485180 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:15:39.999521 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:15:39.999485 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:15:50.086888 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:15:50.086850 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:16:02.299743 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:16:02.299708 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:16:16.598770 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:16:16.598727 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:16:25.988241 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:16:25.988208 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:16:40.183916 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:16:40.183878 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:16:49.390110 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:16:49.390032 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:17:02.893886 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:17:02.893849 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:17:12.400985 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:17:12.400948 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:17:22.197845 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:17:22.197803 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:17:34.786276 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:17:34.786242 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:17:47.286124 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:17:47.286085 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:17:55.791138 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:17:55.791097 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:18:07.590880 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:07.590845 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:18:19.595478 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:19.595394 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:18:28.985714 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:28.985676 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:18:41.128139 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.128107 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn"] Jul 13 15:18:41.131350 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.131333 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:41.134347 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.134323 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d0b8e9a7-openshift-default-dockercfg-xkskw\"" Jul 13 15:18:41.158191 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.158159 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn"] Jul 13 15:18:41.252381 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.252342 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de79ae46-e85e-4a56-aa03-7458c79bf55a-istio-podinfo\") pod \"e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:41.252565 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.252404 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-credential-socket\") pod \"e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:41.252565 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.252469 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-istio-envoy\") pod \"e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:41.252565 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.252517 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de79ae46-e85e-4a56-aa03-7458c79bf55a-istio-token\") pod \"e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:41.252565 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.252536 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de79ae46-e85e-4a56-aa03-7458c79bf55a-istiod-ca-cert\") pod \"e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:41.252565 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.252558 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-workload-socket\") pod \"e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:41.252731 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.252584 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw5qq\" (UniqueName: \"kubernetes.io/projected/de79ae46-e85e-4a56-aa03-7458c79bf55a-kube-api-access-mw5qq\") pod \"e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:41.252731 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.252626 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-istio-data\") pod \"e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:41.252731 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.252676 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-workload-certs\") pod \"e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:41.353770 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.353732 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-credential-socket\") pod \"e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:41.353770 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.353794 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-istio-envoy\") pod \"e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:41.354006 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.353812 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de79ae46-e85e-4a56-aa03-7458c79bf55a-istio-token\") pod \"e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:41.354006 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.353929 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de79ae46-e85e-4a56-aa03-7458c79bf55a-istiod-ca-cert\") pod \"e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:41.354006 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.353969 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-workload-socket\") pod \"e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:41.354006 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.353996 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw5qq\" (UniqueName: \"kubernetes.io/projected/de79ae46-e85e-4a56-aa03-7458c79bf55a-kube-api-access-mw5qq\") pod \"e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:41.354242 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.354027 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-istio-data\") pod \"e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:41.354242 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.354109 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-workload-certs\") pod \"e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:41.354242 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.354128 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-credential-socket\") pod \"e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:41.354242 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.354197 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de79ae46-e85e-4a56-aa03-7458c79bf55a-istio-podinfo\") pod \"e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:41.354472 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.354371 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-workload-socket\") pod \"e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:41.354651 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.354631 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-workload-certs\") pod \"e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:41.354723 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.354652 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-istio-data\") pod \"e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:41.354723 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.354671 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de79ae46-e85e-4a56-aa03-7458c79bf55a-istiod-ca-cert\") pod \"e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:41.356175 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.356158 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-istio-envoy\") pod \"e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:41.356475 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.356457 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de79ae46-e85e-4a56-aa03-7458c79bf55a-istio-podinfo\") pod \"e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:41.364860 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.364832 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de79ae46-e85e-4a56-aa03-7458c79bf55a-istio-token\") pod \"e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:41.365088 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.365070 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw5qq\" (UniqueName: \"kubernetes.io/projected/de79ae46-e85e-4a56-aa03-7458c79bf55a-kube-api-access-mw5qq\") pod \"e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:41.442236 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.442198 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:41.585847 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.585823 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn"] Jul 13 15:18:41.587387 ip-10-0-134-237 kubenswrapper[2577]: W0713 15:18:41.587365 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde79ae46_e85e_4a56_aa03_7458c79bf55a.slice/crio-c8a10912dd390ff376a6b3a3d7d92c77fdf2ca3ceec5ce9cdf0492d49b28f770 WatchSource:0}: Error finding container c8a10912dd390ff376a6b3a3d7d92c77fdf2ca3ceec5ce9cdf0492d49b28f770: Status 404 returned error can't find the container with id c8a10912dd390ff376a6b3a3d7d92c77fdf2ca3ceec5ce9cdf0492d49b28f770 Jul 13 15:18:41.589500 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.589461 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:18:41.589576 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.589533 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:18:41.589576 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.589561 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:18:41.619288 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:41.619256 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" event={"ID":"de79ae46-e85e-4a56-aa03-7458c79bf55a","Type":"ContainerStarted","Data":"c8a10912dd390ff376a6b3a3d7d92c77fdf2ca3ceec5ce9cdf0492d49b28f770"} Jul 13 15:18:42.626014 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:42.625972 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" event={"ID":"de79ae46-e85e-4a56-aa03-7458c79bf55a","Type":"ContainerStarted","Data":"bce96d658f3a4bbfa10ed5a0815e15d9e6e66eaa9336b5e4b6334c242c7721f0"} Jul 13 15:18:43.443396 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:43.443352 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:43.448661 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:43.448634 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:43.482259 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:43.482203 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" podStartSLOduration=2.482184127 podStartE2EDuration="2.482184127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:18:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:18:42.670995445 +0000 UTC m=+1546.737567911" watchObservedRunningTime="2026-07-13 15:18:43.482184127 +0000 UTC m=+1547.548756593" Jul 13 15:18:43.630460 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:43.630417 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:43.631335 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:43.631315 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:45.487440 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:45.487399 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:18:53.689510 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:53.689475 2577 generic.go:356] "Generic (PLEG): container finished" podID="de79ae46-e85e-4a56-aa03-7458c79bf55a" containerID="bce96d658f3a4bbfa10ed5a0815e15d9e6e66eaa9336b5e4b6334c242c7721f0" exitCode=0 Jul 13 15:18:53.689957 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:53.689517 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" event={"ID":"de79ae46-e85e-4a56-aa03-7458c79bf55a","Type":"ContainerDied","Data":"bce96d658f3a4bbfa10ed5a0815e15d9e6e66eaa9336b5e4b6334c242c7721f0"} Jul 13 15:18:53.689957 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:53.689867 2577 scope.go:117] "RemoveContainer" containerID="bce96d658f3a4bbfa10ed5a0815e15d9e6e66eaa9336b5e4b6334c242c7721f0" Jul 13 15:18:53.690891 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:53.690860 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:18:53.690949 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:53.690931 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:18:53.690992 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:53.690961 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:18:54.697698 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:54.697662 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" event={"ID":"de79ae46-e85e-4a56-aa03-7458c79bf55a","Type":"ContainerStarted","Data":"a3f1c7a046d2cd9718607be900722608fae38960aceba6bb80862301bba4c3ff"} Jul 13 15:18:55.442606 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:55.442559 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:55.444019 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:55.443983 2577 patch_prober.go:28] interesting pod/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 13 15:18:55.444165 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:55.444061 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" podUID="de79ae46-e85e-4a56-aa03-7458c79bf55a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 13 15:18:56.443316 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:56.443277 2577 patch_prober.go:28] interesting pod/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 13 15:18:56.443928 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:56.443894 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" podUID="de79ae46-e85e-4a56-aa03-7458c79bf55a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 13 15:18:57.443365 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:57.443318 2577 patch_prober.go:28] interesting pod/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 13 15:18:57.443884 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:57.443397 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" podUID="de79ae46-e85e-4a56-aa03-7458c79bf55a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 13 15:18:58.443313 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:58.443270 2577 patch_prober.go:28] interesting pod/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 13 15:18:58.443624 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:58.443592 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" podUID="de79ae46-e85e-4a56-aa03-7458c79bf55a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 13 15:18:58.631055 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:58.631012 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:59.446387 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:59.446357 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:18:59.447389 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:18:59.447371 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:19:00.887026 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:00.886988 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:19:12.672483 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:12.672443 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn"] Jul 13 15:19:12.673015 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:12.672735 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" podUID="de79ae46-e85e-4a56-aa03-7458c79bf55a" containerName="istio-proxy" containerID="cri-o://a3f1c7a046d2cd9718607be900722608fae38960aceba6bb80862301bba4c3ff" gracePeriod=30 Jul 13 15:19:14.448860 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:14.448819 2577 patch_prober.go:28] interesting pod/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 13 15:19:14.449248 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:14.448895 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" podUID="de79ae46-e85e-4a56-aa03-7458c79bf55a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 15:19:17.817999 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:17.817959 2577 generic.go:356] "Generic (PLEG): container finished" podID="de79ae46-e85e-4a56-aa03-7458c79bf55a" containerID="a3f1c7a046d2cd9718607be900722608fae38960aceba6bb80862301bba4c3ff" exitCode=0 Jul 13 15:19:17.818418 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:17.818030 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" event={"ID":"de79ae46-e85e-4a56-aa03-7458c79bf55a","Type":"ContainerDied","Data":"a3f1c7a046d2cd9718607be900722608fae38960aceba6bb80862301bba4c3ff"} Jul 13 15:19:17.818418 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:17.818099 2577 scope.go:117] "RemoveContainer" containerID="bce96d658f3a4bbfa10ed5a0815e15d9e6e66eaa9336b5e4b6334c242c7721f0" Jul 13 15:19:17.919129 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:17.919104 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:19:18.094085 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.094048 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mw5qq\" (UniqueName: \"kubernetes.io/projected/de79ae46-e85e-4a56-aa03-7458c79bf55a-kube-api-access-mw5qq\") pod \"de79ae46-e85e-4a56-aa03-7458c79bf55a\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " Jul 13 15:19:18.094297 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.094106 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-istio-envoy\") pod \"de79ae46-e85e-4a56-aa03-7458c79bf55a\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " Jul 13 15:19:18.094297 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.094129 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de79ae46-e85e-4a56-aa03-7458c79bf55a-istio-token\") pod \"de79ae46-e85e-4a56-aa03-7458c79bf55a\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " Jul 13 15:19:18.094297 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.094173 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-workload-certs\") pod \"de79ae46-e85e-4a56-aa03-7458c79bf55a\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " Jul 13 15:19:18.094297 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.094199 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-istio-data\") pod \"de79ae46-e85e-4a56-aa03-7458c79bf55a\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " Jul 13 15:19:18.094297 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.094238 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de79ae46-e85e-4a56-aa03-7458c79bf55a-istio-podinfo\") pod \"de79ae46-e85e-4a56-aa03-7458c79bf55a\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " Jul 13 15:19:18.094297 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.094262 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-credential-socket\") pod \"de79ae46-e85e-4a56-aa03-7458c79bf55a\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " Jul 13 15:19:18.094584 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.094299 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-workload-socket\") pod \"de79ae46-e85e-4a56-aa03-7458c79bf55a\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " Jul 13 15:19:18.094584 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.094338 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de79ae46-e85e-4a56-aa03-7458c79bf55a-istiod-ca-cert\") pod \"de79ae46-e85e-4a56-aa03-7458c79bf55a\" (UID: \"de79ae46-e85e-4a56-aa03-7458c79bf55a\") " Jul 13 15:19:18.094584 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.094513 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "de79ae46-e85e-4a56-aa03-7458c79bf55a" (UID: "de79ae46-e85e-4a56-aa03-7458c79bf55a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:19:18.094744 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.094724 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-workload-certs\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:19:18.094838 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.094700 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "de79ae46-e85e-4a56-aa03-7458c79bf55a" (UID: "de79ae46-e85e-4a56-aa03-7458c79bf55a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:19:18.094970 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.094926 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "de79ae46-e85e-4a56-aa03-7458c79bf55a" (UID: "de79ae46-e85e-4a56-aa03-7458c79bf55a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:19:18.094970 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.094949 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de79ae46-e85e-4a56-aa03-7458c79bf55a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "de79ae46-e85e-4a56-aa03-7458c79bf55a" (UID: "de79ae46-e85e-4a56-aa03-7458c79bf55a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 15:19:18.095176 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.095151 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-istio-data" (OuterVolumeSpecName: "istio-data") pod "de79ae46-e85e-4a56-aa03-7458c79bf55a" (UID: "de79ae46-e85e-4a56-aa03-7458c79bf55a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:19:18.096589 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.096565 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "de79ae46-e85e-4a56-aa03-7458c79bf55a" (UID: "de79ae46-e85e-4a56-aa03-7458c79bf55a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:19:18.096589 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.096578 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de79ae46-e85e-4a56-aa03-7458c79bf55a-kube-api-access-mw5qq" (OuterVolumeSpecName: "kube-api-access-mw5qq") pod "de79ae46-e85e-4a56-aa03-7458c79bf55a" (UID: "de79ae46-e85e-4a56-aa03-7458c79bf55a"). InnerVolumeSpecName "kube-api-access-mw5qq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 15:19:18.096871 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.096838 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de79ae46-e85e-4a56-aa03-7458c79bf55a-istio-token" (OuterVolumeSpecName: "istio-token") pod "de79ae46-e85e-4a56-aa03-7458c79bf55a" (UID: "de79ae46-e85e-4a56-aa03-7458c79bf55a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 15:19:18.096962 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.096888 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/de79ae46-e85e-4a56-aa03-7458c79bf55a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "de79ae46-e85e-4a56-aa03-7458c79bf55a" (UID: "de79ae46-e85e-4a56-aa03-7458c79bf55a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 15:19:18.196197 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.196157 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mw5qq\" (UniqueName: \"kubernetes.io/projected/de79ae46-e85e-4a56-aa03-7458c79bf55a-kube-api-access-mw5qq\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:19:18.196197 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.196191 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-istio-envoy\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:19:18.196197 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.196202 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de79ae46-e85e-4a56-aa03-7458c79bf55a-istio-token\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:19:18.196431 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.196210 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-istio-data\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:19:18.196431 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.196218 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de79ae46-e85e-4a56-aa03-7458c79bf55a-istio-podinfo\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:19:18.196431 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.196225 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-credential-socket\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:19:18.196431 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.196235 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de79ae46-e85e-4a56-aa03-7458c79bf55a-workload-socket\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:19:18.196431 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.196244 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de79ae46-e85e-4a56-aa03-7458c79bf55a-istiod-ca-cert\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:19:18.824692 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.824656 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" event={"ID":"de79ae46-e85e-4a56-aa03-7458c79bf55a","Type":"ContainerDied","Data":"c8a10912dd390ff376a6b3a3d7d92c77fdf2ca3ceec5ce9cdf0492d49b28f770"} Jul 13 15:19:18.824692 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.824690 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn" Jul 13 15:19:18.825202 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.824739 2577 scope.go:117] "RemoveContainer" containerID="a3f1c7a046d2cd9718607be900722608fae38960aceba6bb80862301bba4c3ff" Jul 13 15:19:18.848904 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.848874 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn"] Jul 13 15:19:18.853293 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:18.853265 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d0b8e9a7-openshift-default-54b67d9879-wpqzn"] Jul 13 15:19:19.345372 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:19.345330 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de79ae46-e85e-4a56-aa03-7458c79bf55a" path="/var/lib/kubelet/pods/de79ae46-e85e-4a56-aa03-7458c79bf55a/volumes" Jul 13 15:19:21.690219 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:19:21.690183 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:20:21.091719 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:21.091683 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:20:31.876714 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:31.876683 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56"] Jul 13 15:20:31.877272 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:31.877251 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de79ae46-e85e-4a56-aa03-7458c79bf55a" containerName="istio-proxy" Jul 13 15:20:31.877352 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:31.877274 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="de79ae46-e85e-4a56-aa03-7458c79bf55a" containerName="istio-proxy" Jul 13 15:20:31.877408 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:31.877383 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="de79ae46-e85e-4a56-aa03-7458c79bf55a" containerName="istio-proxy" Jul 13 15:20:31.880359 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:31.880339 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:31.884725 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:31.884704 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-76c770f3-openshift-default-dockercfg-mr654\"" Jul 13 15:20:31.896541 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:31.896514 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56"] Jul 13 15:20:31.960673 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:31.960640 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istio-podinfo\") pod \"e2e-ait-76c770f3-openshift-default-57c8746969-b5z56\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:31.960673 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:31.960677 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-workload-certs\") pod \"e2e-ait-76c770f3-openshift-default-57c8746969-b5z56\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:31.960968 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:31.960715 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-workload-socket\") pod \"e2e-ait-76c770f3-openshift-default-57c8746969-b5z56\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:31.960968 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:31.960771 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istio-token\") pod \"e2e-ait-76c770f3-openshift-default-57c8746969-b5z56\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:31.960968 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:31.960837 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-credential-socket\") pod \"e2e-ait-76c770f3-openshift-default-57c8746969-b5z56\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:31.960968 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:31.960866 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r22wz\" (UniqueName: \"kubernetes.io/projected/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-kube-api-access-r22wz\") pod \"e2e-ait-76c770f3-openshift-default-57c8746969-b5z56\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:31.960968 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:31.960898 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istio-envoy\") pod \"e2e-ait-76c770f3-openshift-default-57c8746969-b5z56\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:31.960968 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:31.960937 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istiod-ca-cert\") pod \"e2e-ait-76c770f3-openshift-default-57c8746969-b5z56\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:31.961248 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:31.960995 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istio-data\") pod \"e2e-ait-76c770f3-openshift-default-57c8746969-b5z56\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:32.062210 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:32.062166 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-workload-socket\") pod \"e2e-ait-76c770f3-openshift-default-57c8746969-b5z56\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:32.062210 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:32.062213 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istio-token\") pod \"e2e-ait-76c770f3-openshift-default-57c8746969-b5z56\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:32.062471 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:32.062239 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-credential-socket\") pod \"e2e-ait-76c770f3-openshift-default-57c8746969-b5z56\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:32.062471 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:32.062275 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r22wz\" (UniqueName: \"kubernetes.io/projected/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-kube-api-access-r22wz\") pod \"e2e-ait-76c770f3-openshift-default-57c8746969-b5z56\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:32.062471 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:32.062308 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istio-envoy\") pod \"e2e-ait-76c770f3-openshift-default-57c8746969-b5z56\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:32.062624 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:32.062465 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istiod-ca-cert\") pod \"e2e-ait-76c770f3-openshift-default-57c8746969-b5z56\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:32.062624 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:32.062572 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istio-data\") pod \"e2e-ait-76c770f3-openshift-default-57c8746969-b5z56\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:32.062723 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:32.062630 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istio-podinfo\") pod \"e2e-ait-76c770f3-openshift-default-57c8746969-b5z56\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:32.062723 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:32.062664 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-workload-certs\") pod \"e2e-ait-76c770f3-openshift-default-57c8746969-b5z56\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:32.062723 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:32.062686 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-workload-socket\") pod \"e2e-ait-76c770f3-openshift-default-57c8746969-b5z56\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:32.062723 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:32.062631 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-credential-socket\") pod \"e2e-ait-76c770f3-openshift-default-57c8746969-b5z56\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:32.062969 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:32.062901 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istio-data\") pod \"e2e-ait-76c770f3-openshift-default-57c8746969-b5z56\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:32.063092 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:32.063069 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-workload-certs\") pod \"e2e-ait-76c770f3-openshift-default-57c8746969-b5z56\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:32.063146 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:32.063120 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istiod-ca-cert\") pod \"e2e-ait-76c770f3-openshift-default-57c8746969-b5z56\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:32.064683 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:32.064660 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istio-envoy\") pod \"e2e-ait-76c770f3-openshift-default-57c8746969-b5z56\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:32.064913 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:32.064896 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istio-podinfo\") pod \"e2e-ait-76c770f3-openshift-default-57c8746969-b5z56\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:32.081578 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:32.081548 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r22wz\" (UniqueName: \"kubernetes.io/projected/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-kube-api-access-r22wz\") pod \"e2e-ait-76c770f3-openshift-default-57c8746969-b5z56\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:32.082073 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:32.082055 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istio-token\") pod \"e2e-ait-76c770f3-openshift-default-57c8746969-b5z56\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:32.191477 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:32.191452 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:32.332875 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:32.332847 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56"] Jul 13 15:20:32.334852 ip-10-0-134-237 kubenswrapper[2577]: W0713 15:20:32.334821 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ce66d93_277c_4c8c_b7c5_a4d0cdc852ac.slice/crio-5c013ff11c9060859224b4d08a38b3feabd9bb89e46044134631ea79690b76e9 WatchSource:0}: Error finding container 5c013ff11c9060859224b4d08a38b3feabd9bb89e46044134631ea79690b76e9: Status 404 returned error can't find the container with id 5c013ff11c9060859224b4d08a38b3feabd9bb89e46044134631ea79690b76e9 Jul 13 15:20:32.336945 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:32.336910 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:20:32.337033 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:32.336981 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:20:32.337033 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:32.337012 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:20:33.192416 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:33.192377 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" event={"ID":"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac","Type":"ContainerStarted","Data":"00725aabd9f5eb3cf36946e9a762d6af912be1c7211900102addfdd787aa8bdf"} Jul 13 15:20:33.192841 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:33.192435 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" event={"ID":"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac","Type":"ContainerStarted","Data":"5c013ff11c9060859224b4d08a38b3feabd9bb89e46044134631ea79690b76e9"} Jul 13 15:20:33.222838 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:33.222765 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" podStartSLOduration=2.222745696 podStartE2EDuration="2.222745696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:20:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:20:33.221846336 +0000 UTC m=+1657.288418803" watchObservedRunningTime="2026-07-13 15:20:33.222745696 +0000 UTC m=+1657.289318161" Jul 13 15:20:34.192080 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:34.192045 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:34.197426 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:34.197395 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:34.199062 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:34.199033 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:34.199787 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:34.199756 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:36.088589 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:36.088550 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:20:44.254467 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:44.254433 2577 generic.go:356] "Generic (PLEG): container finished" podID="6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac" containerID="00725aabd9f5eb3cf36946e9a762d6af912be1c7211900102addfdd787aa8bdf" exitCode=0 Jul 13 15:20:44.255072 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:44.254507 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" event={"ID":"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac","Type":"ContainerDied","Data":"00725aabd9f5eb3cf36946e9a762d6af912be1c7211900102addfdd787aa8bdf"} Jul 13 15:20:44.255072 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:44.254943 2577 scope.go:117] "RemoveContainer" containerID="00725aabd9f5eb3cf36946e9a762d6af912be1c7211900102addfdd787aa8bdf" Jul 13 15:20:44.255949 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:44.255919 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:20:44.256003 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:44.255985 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:20:44.256037 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:44.256015 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:20:45.261286 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:45.261253 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" event={"ID":"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac","Type":"ContainerStarted","Data":"aa1ff399dd332ad61296f765a51a0b46a8480a9fb0b0fa8f9632b228925665cc"} Jul 13 15:20:46.192172 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:46.192129 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:46.193298 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:46.193270 2577 patch_prober.go:28] interesting pod/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 13 15:20:46.193442 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:46.193335 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" podUID="6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 13 15:20:47.192278 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:47.192239 2577 patch_prober.go:28] interesting pod/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 13 15:20:47.192669 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:47.192310 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" podUID="6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 13 15:20:48.192530 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:48.192492 2577 patch_prober.go:28] interesting pod/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 13 15:20:48.193011 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:48.192552 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" podUID="6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 13 15:20:49.191826 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:49.191772 2577 patch_prober.go:28] interesting pod/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 13 15:20:49.192006 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:49.191866 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" podUID="6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 13 15:20:49.198884 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:49.198856 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:50.192302 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:50.192259 2577 patch_prober.go:28] interesting pod/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 13 15:20:50.192495 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:50.192335 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" podUID="6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 13 15:20:51.196566 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:51.196533 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:20:51.197396 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:20:51.197380 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:21:41.816353 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:21:41.816305 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:21:54.656438 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:21:54.656399 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56"] Jul 13 15:21:54.656927 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:21:54.656642 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" podUID="6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac" containerName="istio-proxy" containerID="cri-o://aa1ff399dd332ad61296f765a51a0b46a8480a9fb0b0fa8f9632b228925665cc" gracePeriod=30 Jul 13 15:21:59.199441 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:21:59.199404 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:21:59.911471 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:21:59.911425 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:21:59.966642 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:21:59.966612 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-credential-socket\") pod \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " Jul 13 15:21:59.966818 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:21:59.966664 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istio-envoy\") pod \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " Jul 13 15:21:59.966818 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:21:59.966698 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-workload-socket\") pod \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " Jul 13 15:21:59.966818 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:21:59.966740 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istiod-ca-cert\") pod \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " Jul 13 15:21:59.966818 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:21:59.966810 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r22wz\" (UniqueName: \"kubernetes.io/projected/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-kube-api-access-r22wz\") pod \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " Jul 13 15:21:59.967044 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:21:59.966845 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istio-data\") pod \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " Jul 13 15:21:59.967044 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:21:59.966927 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-workload-certs\") pod \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " Jul 13 15:21:59.967044 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:21:59.966936 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac" (UID: "6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:21:59.967044 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:21:59.966975 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istio-podinfo\") pod \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " Jul 13 15:21:59.967044 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:21:59.967001 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istio-token\") pod \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\" (UID: \"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac\") " Jul 13 15:21:59.967279 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:21:59.967029 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac" (UID: "6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:21:59.967279 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:21:59.967235 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac" (UID: "6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:21:59.967378 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:21:59.967282 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-credential-socket\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:21:59.967378 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:21:59.967300 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-workload-socket\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:21:59.967378 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:21:59.967275 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac" (UID: "6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 15:21:59.967758 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:21:59.967718 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istio-data" (OuterVolumeSpecName: "istio-data") pod "6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac" (UID: "6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:21:59.969169 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:21:59.969141 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac" (UID: "6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 15:21:59.969328 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:21:59.969307 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-kube-api-access-r22wz" (OuterVolumeSpecName: "kube-api-access-r22wz") pod "6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac" (UID: "6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac"). InnerVolumeSpecName "kube-api-access-r22wz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 15:21:59.969391 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:21:59.969369 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istio-token" (OuterVolumeSpecName: "istio-token") pod "6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac" (UID: "6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 15:21:59.969536 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:21:59.969519 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac" (UID: "6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:22:00.068355 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:22:00.068315 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istio-podinfo\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:22:00.068355 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:22:00.068347 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istio-token\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:22:00.068355 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:22:00.068360 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istio-envoy\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:22:00.068604 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:22:00.068371 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istiod-ca-cert\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:22:00.068604 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:22:00.068382 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r22wz\" (UniqueName: \"kubernetes.io/projected/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-kube-api-access-r22wz\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:22:00.068604 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:22:00.068395 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-istio-data\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:22:00.068604 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:22:00.068406 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac-workload-certs\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:22:00.634897 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:22:00.634857 2577 generic.go:356] "Generic (PLEG): container finished" podID="6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac" containerID="aa1ff399dd332ad61296f765a51a0b46a8480a9fb0b0fa8f9632b228925665cc" exitCode=0 Jul 13 15:22:00.635412 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:22:00.634915 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" Jul 13 15:22:00.635412 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:22:00.634938 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" event={"ID":"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac","Type":"ContainerDied","Data":"aa1ff399dd332ad61296f765a51a0b46a8480a9fb0b0fa8f9632b228925665cc"} Jul 13 15:22:00.635412 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:22:00.634992 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56" event={"ID":"6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac","Type":"ContainerDied","Data":"5c013ff11c9060859224b4d08a38b3feabd9bb89e46044134631ea79690b76e9"} Jul 13 15:22:00.635412 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:22:00.635015 2577 scope.go:117] "RemoveContainer" containerID="aa1ff399dd332ad61296f765a51a0b46a8480a9fb0b0fa8f9632b228925665cc" Jul 13 15:22:00.645116 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:22:00.645099 2577 scope.go:117] "RemoveContainer" containerID="00725aabd9f5eb3cf36946e9a762d6af912be1c7211900102addfdd787aa8bdf" Jul 13 15:22:00.653101 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:22:00.653080 2577 scope.go:117] "RemoveContainer" containerID="aa1ff399dd332ad61296f765a51a0b46a8480a9fb0b0fa8f9632b228925665cc" Jul 13 15:22:00.653356 ip-10-0-134-237 kubenswrapper[2577]: E0713 15:22:00.653338 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa1ff399dd332ad61296f765a51a0b46a8480a9fb0b0fa8f9632b228925665cc\": container with ID starting with aa1ff399dd332ad61296f765a51a0b46a8480a9fb0b0fa8f9632b228925665cc not found: ID does not exist" containerID="aa1ff399dd332ad61296f765a51a0b46a8480a9fb0b0fa8f9632b228925665cc" Jul 13 15:22:00.653395 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:22:00.653367 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa1ff399dd332ad61296f765a51a0b46a8480a9fb0b0fa8f9632b228925665cc"} err="failed to get container status \"aa1ff399dd332ad61296f765a51a0b46a8480a9fb0b0fa8f9632b228925665cc\": rpc error: code = NotFound desc = could not find container \"aa1ff399dd332ad61296f765a51a0b46a8480a9fb0b0fa8f9632b228925665cc\": container with ID starting with aa1ff399dd332ad61296f765a51a0b46a8480a9fb0b0fa8f9632b228925665cc not found: ID does not exist" Jul 13 15:22:00.653395 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:22:00.653386 2577 scope.go:117] "RemoveContainer" containerID="00725aabd9f5eb3cf36946e9a762d6af912be1c7211900102addfdd787aa8bdf" Jul 13 15:22:00.653609 ip-10-0-134-237 kubenswrapper[2577]: E0713 15:22:00.653591 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00725aabd9f5eb3cf36946e9a762d6af912be1c7211900102addfdd787aa8bdf\": container with ID starting with 00725aabd9f5eb3cf36946e9a762d6af912be1c7211900102addfdd787aa8bdf not found: ID does not exist" containerID="00725aabd9f5eb3cf36946e9a762d6af912be1c7211900102addfdd787aa8bdf" Jul 13 15:22:00.653642 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:22:00.653617 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00725aabd9f5eb3cf36946e9a762d6af912be1c7211900102addfdd787aa8bdf"} err="failed to get container status \"00725aabd9f5eb3cf36946e9a762d6af912be1c7211900102addfdd787aa8bdf\": rpc error: code = NotFound desc = could not find container \"00725aabd9f5eb3cf36946e9a762d6af912be1c7211900102addfdd787aa8bdf\": container with ID starting with 00725aabd9f5eb3cf36946e9a762d6af912be1c7211900102addfdd787aa8bdf not found: ID does not exist" Jul 13 15:22:00.659328 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:22:00.659300 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56"] Jul 13 15:22:00.666615 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:22:00.666589 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-76c770f3-openshift-default-57c8746969-b5z56"] Jul 13 15:22:01.344753 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:22:01.344720 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac" path="/var/lib/kubelet/pods/6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac/volumes" Jul 13 15:23:04.089966 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:23:04.089923 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:24:42.390788 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:42.390737 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:24:51.397935 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:51.397896 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:24:53.959063 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:53.959025 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2"] Jul 13 15:24:53.959438 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:53.959335 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac" containerName="istio-proxy" Jul 13 15:24:53.959438 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:53.959345 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac" containerName="istio-proxy" Jul 13 15:24:53.959438 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:53.959369 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de79ae46-e85e-4a56-aa03-7458c79bf55a" containerName="istio-proxy" Jul 13 15:24:53.959438 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:53.959374 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="de79ae46-e85e-4a56-aa03-7458c79bf55a" containerName="istio-proxy" Jul 13 15:24:53.959438 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:53.959381 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac" containerName="istio-proxy" Jul 13 15:24:53.959438 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:53.959386 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac" containerName="istio-proxy" Jul 13 15:24:53.959438 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:53.959439 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac" containerName="istio-proxy" Jul 13 15:24:53.959654 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:53.959447 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ce66d93-277c-4c8c-b7c5-a4d0cdc852ac" containerName="istio-proxy" Jul 13 15:24:53.959654 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:53.959454 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="de79ae46-e85e-4a56-aa03-7458c79bf55a" containerName="istio-proxy" Jul 13 15:24:53.963378 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:53.963361 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:53.966821 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:53.966794 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f969cfbe-openshift-default-dockercfg-5v8s9\"" Jul 13 15:24:53.989387 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:53.989351 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2"] Jul 13 15:24:54.013414 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.013377 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istio-data\") pod \"e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:54.013596 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.013418 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istiod-ca-cert\") pod \"e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:54.013596 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.013471 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-credential-socket\") pod \"e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:54.013596 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.013495 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-workload-certs\") pod \"e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:54.013596 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.013571 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-workload-socket\") pod \"e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:54.013740 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.013625 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istio-token\") pod \"e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:54.013740 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.013677 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istio-podinfo\") pod \"e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:54.013740 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.013692 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d6gs\" (UniqueName: \"kubernetes.io/projected/d4b30038-42fc-4c75-9b64-b8c3da1b676e-kube-api-access-6d6gs\") pod \"e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:54.013740 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.013717 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istio-envoy\") pod \"e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:54.114843 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.114804 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istio-envoy\") pod \"e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:54.115060 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.114859 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istio-data\") pod \"e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:54.115060 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.114882 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istiod-ca-cert\") pod \"e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:54.115060 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.114912 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-credential-socket\") pod \"e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:54.115060 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.114933 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-workload-certs\") pod \"e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:54.115060 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.114963 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-workload-socket\") pod \"e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:54.115060 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.115014 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istio-token\") pod \"e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:54.115392 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.115063 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istio-podinfo\") pod \"e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:54.115392 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.115085 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d6gs\" (UniqueName: \"kubernetes.io/projected/d4b30038-42fc-4c75-9b64-b8c3da1b676e-kube-api-access-6d6gs\") pod \"e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:54.115392 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.115341 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-credential-socket\") pod \"e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:54.115565 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.115440 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-workload-certs\") pod \"e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:54.115565 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.115477 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-workload-socket\") pod \"e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:54.115679 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.115645 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istio-data\") pod \"e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:54.115679 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.115659 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istiod-ca-cert\") pod \"e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:54.117160 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.117143 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istio-envoy\") pod \"e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:54.117515 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.117498 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istio-podinfo\") pod \"e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:54.124146 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.124101 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d6gs\" (UniqueName: \"kubernetes.io/projected/d4b30038-42fc-4c75-9b64-b8c3da1b676e-kube-api-access-6d6gs\") pod \"e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:54.124287 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.124268 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istio-token\") pod \"e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:54.273900 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.273806 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:54.414791 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.414752 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2"] Jul 13 15:24:54.416678 ip-10-0-134-237 kubenswrapper[2577]: W0713 15:24:54.416648 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4b30038_42fc_4c75_9b64_b8c3da1b676e.slice/crio-483a0dac9ba7ffa9f2db30c067d29a5aaf6f0c036125cb7f2f5c6b19b8e9e343 WatchSource:0}: Error finding container 483a0dac9ba7ffa9f2db30c067d29a5aaf6f0c036125cb7f2f5c6b19b8e9e343: Status 404 returned error can't find the container with id 483a0dac9ba7ffa9f2db30c067d29a5aaf6f0c036125cb7f2f5c6b19b8e9e343 Jul 13 15:24:54.418920 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.418884 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:24:54.419034 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.418990 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:24:54.419093 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.419057 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:24:54.490039 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:54.490010 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" event={"ID":"d4b30038-42fc-4c75-9b64-b8c3da1b676e","Type":"ContainerStarted","Data":"483a0dac9ba7ffa9f2db30c067d29a5aaf6f0c036125cb7f2f5c6b19b8e9e343"} Jul 13 15:24:55.496537 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:55.496503 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" event={"ID":"d4b30038-42fc-4c75-9b64-b8c3da1b676e","Type":"ContainerStarted","Data":"65c07220a6136d3144318fe2f3230701ff7b394907a333a99f1ac967ec6086d8"} Jul 13 15:24:55.521705 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:55.521643 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" podStartSLOduration=2.521624296 podStartE2EDuration="2.521624296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:24:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:55.520532283 +0000 UTC m=+1919.587104750" watchObservedRunningTime="2026-07-13 15:24:55.521624296 +0000 UTC m=+1919.588196763" Jul 13 15:24:56.274115 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:56.274081 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:56.279021 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:56.278996 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:56.501284 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:56.501254 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:24:56.502268 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:24:56.502245 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:25:02.790745 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:02.790707 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:25:11.502990 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:11.502952 2577 patch_prober.go:28] interesting pod/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 13 15:25:11.503420 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:11.503021 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" podUID="d4b30038-42fc-4c75-9b64-b8c3da1b676e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 13 15:25:11.583945 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:11.583916 2577 generic.go:356] "Generic (PLEG): container finished" podID="d4b30038-42fc-4c75-9b64-b8c3da1b676e" containerID="65c07220a6136d3144318fe2f3230701ff7b394907a333a99f1ac967ec6086d8" exitCode=0 Jul 13 15:25:11.584103 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:11.583979 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" event={"ID":"d4b30038-42fc-4c75-9b64-b8c3da1b676e","Type":"ContainerDied","Data":"65c07220a6136d3144318fe2f3230701ff7b394907a333a99f1ac967ec6086d8"} Jul 13 15:25:11.584419 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:11.584402 2577 scope.go:117] "RemoveContainer" containerID="65c07220a6136d3144318fe2f3230701ff7b394907a333a99f1ac967ec6086d8" Jul 13 15:25:11.585406 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:11.585364 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:25:11.585522 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:11.585437 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:25:11.585522 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:11.585469 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:25:12.590189 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:12.590152 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" event={"ID":"d4b30038-42fc-4c75-9b64-b8c3da1b676e","Type":"ContainerStarted","Data":"df32d7d1c60f35ca69569130b2ff9abbb974677fdea61170591035399345278f"} Jul 13 15:25:13.275042 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:13.275005 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:25:13.275267 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:13.275241 2577 patch_prober.go:28] interesting pod/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 13 15:25:13.275353 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:13.275303 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" podUID="d4b30038-42fc-4c75-9b64-b8c3da1b676e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 13 15:25:14.274999 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:14.274963 2577 patch_prober.go:28] interesting pod/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 13 15:25:14.275388 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:14.275021 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" podUID="d4b30038-42fc-4c75-9b64-b8c3da1b676e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 13 15:25:15.275241 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:15.275203 2577 patch_prober.go:28] interesting pod/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 13 15:25:15.275669 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:15.275260 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" podUID="d4b30038-42fc-4c75-9b64-b8c3da1b676e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 13 15:25:16.274824 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:16.274763 2577 patch_prober.go:28] interesting pod/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 13 15:25:16.274999 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:16.274845 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" podUID="d4b30038-42fc-4c75-9b64-b8c3da1b676e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 13 15:25:17.279103 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:17.279074 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:25:17.279475 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:17.279337 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:25:17.280128 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:17.280109 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:25:23.288377 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:23.288339 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:25:35.582303 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:35.582264 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2"] Jul 13 15:25:35.582926 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:35.582472 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" podUID="d4b30038-42fc-4c75-9b64-b8c3da1b676e" containerName="istio-proxy" containerID="cri-o://df32d7d1c60f35ca69569130b2ff9abbb974677fdea61170591035399345278f" gracePeriod=30 Jul 13 15:25:40.732742 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:40.732708 2577 generic.go:356] "Generic (PLEG): container finished" podID="d4b30038-42fc-4c75-9b64-b8c3da1b676e" containerID="df32d7d1c60f35ca69569130b2ff9abbb974677fdea61170591035399345278f" exitCode=0 Jul 13 15:25:40.733175 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:40.732790 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" event={"ID":"d4b30038-42fc-4c75-9b64-b8c3da1b676e","Type":"ContainerDied","Data":"df32d7d1c60f35ca69569130b2ff9abbb974677fdea61170591035399345278f"} Jul 13 15:25:40.733175 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:40.732857 2577 scope.go:117] "RemoveContainer" containerID="65c07220a6136d3144318fe2f3230701ff7b394907a333a99f1ac967ec6086d8" Jul 13 15:25:40.835588 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:40.835559 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:25:40.957474 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:40.957442 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6d6gs\" (UniqueName: \"kubernetes.io/projected/d4b30038-42fc-4c75-9b64-b8c3da1b676e-kube-api-access-6d6gs\") pod \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " Jul 13 15:25:40.957751 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:40.957490 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istio-token\") pod \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " Jul 13 15:25:40.957751 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:40.957520 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istio-data\") pod \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " Jul 13 15:25:40.957751 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:40.957538 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istiod-ca-cert\") pod \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " Jul 13 15:25:40.957751 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:40.957581 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-credential-socket\") pod \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " Jul 13 15:25:40.957751 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:40.957597 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istio-envoy\") pod \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " Jul 13 15:25:40.957751 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:40.957705 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-workload-certs\") pod \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " Jul 13 15:25:40.957751 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:40.957753 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istio-podinfo\") pod \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " Jul 13 15:25:40.958231 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:40.957806 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-workload-socket\") pod \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\" (UID: \"d4b30038-42fc-4c75-9b64-b8c3da1b676e\") " Jul 13 15:25:40.958231 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:40.957926 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d4b30038-42fc-4c75-9b64-b8c3da1b676e" (UID: "d4b30038-42fc-4c75-9b64-b8c3da1b676e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:25:40.958231 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:40.958025 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d4b30038-42fc-4c75-9b64-b8c3da1b676e" (UID: "d4b30038-42fc-4c75-9b64-b8c3da1b676e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 15:25:40.958231 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:40.958141 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d4b30038-42fc-4c75-9b64-b8c3da1b676e" (UID: "d4b30038-42fc-4c75-9b64-b8c3da1b676e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:25:40.958231 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:40.958214 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istiod-ca-cert\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:25:40.958467 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:40.958235 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-credential-socket\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:25:40.958467 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:40.958284 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d4b30038-42fc-4c75-9b64-b8c3da1b676e" (UID: "d4b30038-42fc-4c75-9b64-b8c3da1b676e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:25:40.958694 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:40.958669 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istio-data" (OuterVolumeSpecName: "istio-data") pod "d4b30038-42fc-4c75-9b64-b8c3da1b676e" (UID: "d4b30038-42fc-4c75-9b64-b8c3da1b676e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:25:40.959881 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:40.959856 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istio-token" (OuterVolumeSpecName: "istio-token") pod "d4b30038-42fc-4c75-9b64-b8c3da1b676e" (UID: "d4b30038-42fc-4c75-9b64-b8c3da1b676e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 15:25:40.959996 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:40.959885 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d4b30038-42fc-4c75-9b64-b8c3da1b676e" (UID: "d4b30038-42fc-4c75-9b64-b8c3da1b676e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:25:40.960135 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:40.960120 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4b30038-42fc-4c75-9b64-b8c3da1b676e-kube-api-access-6d6gs" (OuterVolumeSpecName: "kube-api-access-6d6gs") pod "d4b30038-42fc-4c75-9b64-b8c3da1b676e" (UID: "d4b30038-42fc-4c75-9b64-b8c3da1b676e"). InnerVolumeSpecName "kube-api-access-6d6gs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 15:25:40.960229 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:40.960210 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d4b30038-42fc-4c75-9b64-b8c3da1b676e" (UID: "d4b30038-42fc-4c75-9b64-b8c3da1b676e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 15:25:41.059579 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:41.059544 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6d6gs\" (UniqueName: \"kubernetes.io/projected/d4b30038-42fc-4c75-9b64-b8c3da1b676e-kube-api-access-6d6gs\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:25:41.059579 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:41.059573 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istio-token\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:25:41.059579 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:41.059583 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istio-data\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:25:41.059579 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:41.059591 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istio-envoy\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:25:41.059866 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:41.059599 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-workload-certs\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:25:41.059866 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:41.059607 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4b30038-42fc-4c75-9b64-b8c3da1b676e-istio-podinfo\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:25:41.059866 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:41.059616 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4b30038-42fc-4c75-9b64-b8c3da1b676e-workload-socket\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:25:41.738940 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:41.738907 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" event={"ID":"d4b30038-42fc-4c75-9b64-b8c3da1b676e","Type":"ContainerDied","Data":"483a0dac9ba7ffa9f2db30c067d29a5aaf6f0c036125cb7f2f5c6b19b8e9e343"} Jul 13 15:25:41.738940 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:41.738939 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2" Jul 13 15:25:41.739470 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:41.738964 2577 scope.go:117] "RemoveContainer" containerID="df32d7d1c60f35ca69569130b2ff9abbb974677fdea61170591035399345278f" Jul 13 15:25:41.759476 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:41.759450 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2"] Jul 13 15:25:41.765598 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:41.765573 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f969cfbe-openshift-default-75cbd4f899-pl9t2"] Jul 13 15:25:43.345881 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:43.345848 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4b30038-42fc-4c75-9b64-b8c3da1b676e" path="/var/lib/kubelet/pods/d4b30038-42fc-4c75-9b64-b8c3da1b676e/volumes" Jul 13 15:25:55.923282 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:55.923203 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn"] Jul 13 15:25:55.923629 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:55.923520 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4b30038-42fc-4c75-9b64-b8c3da1b676e" containerName="istio-proxy" Jul 13 15:25:55.923629 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:55.923532 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4b30038-42fc-4c75-9b64-b8c3da1b676e" containerName="istio-proxy" Jul 13 15:25:55.923629 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:55.923546 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4b30038-42fc-4c75-9b64-b8c3da1b676e" containerName="istio-proxy" Jul 13 15:25:55.923629 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:55.923551 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4b30038-42fc-4c75-9b64-b8c3da1b676e" containerName="istio-proxy" Jul 13 15:25:55.923629 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:55.923604 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4b30038-42fc-4c75-9b64-b8c3da1b676e" containerName="istio-proxy" Jul 13 15:25:55.923629 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:55.923612 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4b30038-42fc-4c75-9b64-b8c3da1b676e" containerName="istio-proxy" Jul 13 15:25:55.927995 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:55.927977 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:55.930828 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:55.930802 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-fb1236df-openshift-default-dockercfg-jpxcn\"" Jul 13 15:25:55.939495 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:55.939475 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn"] Jul 13 15:25:56.096505 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.096461 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/978c27d1-e946-4a56-9701-71b018c6c3f1-istio-token\") pod \"e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:56.096505 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.096505 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/978c27d1-e946-4a56-9701-71b018c6c3f1-istio-podinfo\") pod \"e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:56.096746 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.096536 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-credential-socket\") pod \"e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:56.096746 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.096558 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-istio-data\") pod \"e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:56.096746 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.096631 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/978c27d1-e946-4a56-9701-71b018c6c3f1-istiod-ca-cert\") pod \"e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:56.096746 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.096674 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-workload-socket\") pod \"e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:56.096746 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.096694 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjb67\" (UniqueName: \"kubernetes.io/projected/978c27d1-e946-4a56-9701-71b018c6c3f1-kube-api-access-gjb67\") pod \"e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:56.096746 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.096729 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-workload-certs\") pod \"e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:56.097004 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.096824 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-istio-envoy\") pod \"e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:56.197661 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.197561 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/978c27d1-e946-4a56-9701-71b018c6c3f1-istio-podinfo\") pod \"e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:56.197661 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.197611 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-credential-socket\") pod \"e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:56.197913 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.197727 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-istio-data\") pod \"e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:56.197913 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.197817 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/978c27d1-e946-4a56-9701-71b018c6c3f1-istiod-ca-cert\") pod \"e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:56.197913 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.197844 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-workload-socket\") pod \"e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:56.197913 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.197865 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjb67\" (UniqueName: \"kubernetes.io/projected/978c27d1-e946-4a56-9701-71b018c6c3f1-kube-api-access-gjb67\") pod \"e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:56.197913 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.197902 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-workload-certs\") pod \"e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:56.198209 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.197938 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-istio-envoy\") pod \"e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:56.198209 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.197974 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/978c27d1-e946-4a56-9701-71b018c6c3f1-istio-token\") pod \"e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:56.198209 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.198028 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-credential-socket\") pod \"e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:56.198209 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.198051 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-istio-data\") pod \"e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:56.198406 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.198298 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-workload-socket\") pod \"e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:56.198406 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.198328 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-workload-certs\") pod \"e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:56.198885 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.198861 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/978c27d1-e946-4a56-9701-71b018c6c3f1-istiod-ca-cert\") pod \"e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:56.200157 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.200136 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-istio-envoy\") pod \"e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:56.200352 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.200337 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/978c27d1-e946-4a56-9701-71b018c6c3f1-istio-podinfo\") pod \"e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:56.205858 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.205834 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjb67\" (UniqueName: \"kubernetes.io/projected/978c27d1-e946-4a56-9701-71b018c6c3f1-kube-api-access-gjb67\") pod \"e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:56.206511 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.206488 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/978c27d1-e946-4a56-9701-71b018c6c3f1-istio-token\") pod \"e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:56.238698 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.238658 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:56.374734 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.374702 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn"] Jul 13 15:25:56.376564 ip-10-0-134-237 kubenswrapper[2577]: W0713 15:25:56.376532 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod978c27d1_e946_4a56_9701_71b018c6c3f1.slice/crio-78ca41300b50f1095a7b1752ac947199051f0337b9a175885b789ca5697dc569 WatchSource:0}: Error finding container 78ca41300b50f1095a7b1752ac947199051f0337b9a175885b789ca5697dc569: Status 404 returned error can't find the container with id 78ca41300b50f1095a7b1752ac947199051f0337b9a175885b789ca5697dc569 Jul 13 15:25:56.378764 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.378730 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:25:56.378884 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.378824 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:25:56.378884 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.378872 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:25:56.813961 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.813926 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" event={"ID":"978c27d1-e946-4a56-9701-71b018c6c3f1","Type":"ContainerStarted","Data":"b2fd9ae0aa2a5620dae3de4f52a767f46d38b9639154b57d4f5a3ae5c32266e5"} Jul 13 15:25:56.814173 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.814014 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" event={"ID":"978c27d1-e946-4a56-9701-71b018c6c3f1","Type":"ContainerStarted","Data":"78ca41300b50f1095a7b1752ac947199051f0337b9a175885b789ca5697dc569"} Jul 13 15:25:56.837055 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:56.836988 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" podStartSLOduration=1.83696978 podStartE2EDuration="1.83696978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:25:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:25:56.834756671 +0000 UTC m=+1980.901329161" watchObservedRunningTime="2026-07-13 15:25:56.83696978 +0000 UTC m=+1980.903542246" Jul 13 15:25:57.239141 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:57.239107 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:57.244137 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:57.244107 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:57.819585 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:57.819548 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:25:57.820474 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:25:57.820453 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:26:04.784158 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:26:04.784121 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:26:12.821650 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:26:12.821622 2577 patch_prober.go:28] interesting pod/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 13 15:26:12.822027 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:26:12.821676 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" podUID="978c27d1-e946-4a56-9701-71b018c6c3f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 13 15:26:12.898341 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:26:12.898308 2577 generic.go:356] "Generic (PLEG): container finished" podID="978c27d1-e946-4a56-9701-71b018c6c3f1" containerID="b2fd9ae0aa2a5620dae3de4f52a767f46d38b9639154b57d4f5a3ae5c32266e5" exitCode=0 Jul 13 15:26:12.898521 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:26:12.898377 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" event={"ID":"978c27d1-e946-4a56-9701-71b018c6c3f1","Type":"ContainerDied","Data":"b2fd9ae0aa2a5620dae3de4f52a767f46d38b9639154b57d4f5a3ae5c32266e5"} Jul 13 15:26:12.898807 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:26:12.898772 2577 scope.go:117] "RemoveContainer" containerID="b2fd9ae0aa2a5620dae3de4f52a767f46d38b9639154b57d4f5a3ae5c32266e5" Jul 13 15:26:12.899836 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:26:12.899803 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:26:12.899961 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:26:12.899894 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:26:12.899961 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:26:12.899946 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:26:13.906217 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:26:13.906180 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" event={"ID":"978c27d1-e946-4a56-9701-71b018c6c3f1","Type":"ContainerStarted","Data":"262331d432471da6dbf34ff95dc9f5d2b6128add411053bc26d57577c7d8f6a2"} Jul 13 15:26:14.239227 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:26:14.239129 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:26:14.239591 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:26:14.239494 2577 patch_prober.go:28] interesting pod/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 13 15:26:14.239744 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:26:14.239722 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" podUID="978c27d1-e946-4a56-9701-71b018c6c3f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 13 15:26:15.239246 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:26:15.239199 2577 patch_prober.go:28] interesting pod/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 13 15:26:15.239769 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:26:15.239288 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" podUID="978c27d1-e946-4a56-9701-71b018c6c3f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 13 15:26:16.239495 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:26:16.239456 2577 patch_prober.go:28] interesting pod/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 13 15:26:16.240116 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:26:16.240083 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" podUID="978c27d1-e946-4a56-9701-71b018c6c3f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 13 15:26:17.239384 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:26:17.239333 2577 patch_prober.go:28] interesting pod/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 13 15:26:17.239600 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:26:17.239425 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" podUID="978c27d1-e946-4a56-9701-71b018c6c3f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 13 15:26:18.242925 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:26:18.242894 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:26:18.243405 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:26:18.243278 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:26:18.244055 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:26:18.244033 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:26:28.189437 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:26:28.189399 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:26:45.778484 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:26:45.778447 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:27:06.785433 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:27:06.785395 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:27:59.472792 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:27:59.472740 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn"] Jul 13 15:27:59.473333 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:27:59.472971 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" podUID="978c27d1-e946-4a56-9701-71b018c6c3f1" containerName="istio-proxy" containerID="cri-o://262331d432471da6dbf34ff95dc9f5d2b6128add411053bc26d57577c7d8f6a2" gracePeriod=30 Jul 13 15:28:03.245799 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:03.245744 2577 patch_prober.go:28] interesting pod/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 13 15:28:03.246202 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:03.245829 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" podUID="978c27d1-e946-4a56-9701-71b018c6c3f1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 15:28:04.714961 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:04.714935 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:28:04.849177 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:04.849042 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-credential-socket\") pod \"978c27d1-e946-4a56-9701-71b018c6c3f1\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " Jul 13 15:28:04.849177 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:04.849132 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-workload-certs\") pod \"978c27d1-e946-4a56-9701-71b018c6c3f1\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " Jul 13 15:28:04.849177 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:04.849173 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-istio-data\") pod \"978c27d1-e946-4a56-9701-71b018c6c3f1\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " Jul 13 15:28:04.849458 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:04.849217 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/978c27d1-e946-4a56-9701-71b018c6c3f1-istio-token\") pod \"978c27d1-e946-4a56-9701-71b018c6c3f1\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " Jul 13 15:28:04.849458 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:04.849237 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/978c27d1-e946-4a56-9701-71b018c6c3f1-istiod-ca-cert\") pod \"978c27d1-e946-4a56-9701-71b018c6c3f1\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " Jul 13 15:28:04.849458 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:04.849296 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-workload-socket\") pod \"978c27d1-e946-4a56-9701-71b018c6c3f1\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " Jul 13 15:28:04.849458 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:04.849329 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "978c27d1-e946-4a56-9701-71b018c6c3f1" (UID: "978c27d1-e946-4a56-9701-71b018c6c3f1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:28:04.849458 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:04.849343 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/978c27d1-e946-4a56-9701-71b018c6c3f1-istio-podinfo\") pod \"978c27d1-e946-4a56-9701-71b018c6c3f1\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " Jul 13 15:28:04.849458 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:04.849401 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjb67\" (UniqueName: \"kubernetes.io/projected/978c27d1-e946-4a56-9701-71b018c6c3f1-kube-api-access-gjb67\") pod \"978c27d1-e946-4a56-9701-71b018c6c3f1\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " Jul 13 15:28:04.849458 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:04.849457 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-istio-envoy\") pod \"978c27d1-e946-4a56-9701-71b018c6c3f1\" (UID: \"978c27d1-e946-4a56-9701-71b018c6c3f1\") " Jul 13 15:28:04.849879 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:04.849478 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "978c27d1-e946-4a56-9701-71b018c6c3f1" (UID: "978c27d1-e946-4a56-9701-71b018c6c3f1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:28:04.849879 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:04.849741 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "978c27d1-e946-4a56-9701-71b018c6c3f1" (UID: "978c27d1-e946-4a56-9701-71b018c6c3f1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:28:04.849879 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:04.849761 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-credential-socket\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:28:04.849879 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:04.849839 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-workload-certs\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:28:04.850107 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:04.850006 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/978c27d1-e946-4a56-9701-71b018c6c3f1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "978c27d1-e946-4a56-9701-71b018c6c3f1" (UID: "978c27d1-e946-4a56-9701-71b018c6c3f1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 15:28:04.850240 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:04.850208 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-istio-data" (OuterVolumeSpecName: "istio-data") pod "978c27d1-e946-4a56-9701-71b018c6c3f1" (UID: "978c27d1-e946-4a56-9701-71b018c6c3f1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:28:04.851666 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:04.851634 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/978c27d1-e946-4a56-9701-71b018c6c3f1-kube-api-access-gjb67" (OuterVolumeSpecName: "kube-api-access-gjb67") pod "978c27d1-e946-4a56-9701-71b018c6c3f1" (UID: "978c27d1-e946-4a56-9701-71b018c6c3f1"). InnerVolumeSpecName "kube-api-access-gjb67". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 15:28:04.851761 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:04.851658 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/978c27d1-e946-4a56-9701-71b018c6c3f1-istio-token" (OuterVolumeSpecName: "istio-token") pod "978c27d1-e946-4a56-9701-71b018c6c3f1" (UID: "978c27d1-e946-4a56-9701-71b018c6c3f1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 15:28:04.851761 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:04.851678 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/978c27d1-e946-4a56-9701-71b018c6c3f1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "978c27d1-e946-4a56-9701-71b018c6c3f1" (UID: "978c27d1-e946-4a56-9701-71b018c6c3f1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 15:28:04.851761 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:04.851714 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "978c27d1-e946-4a56-9701-71b018c6c3f1" (UID: "978c27d1-e946-4a56-9701-71b018c6c3f1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:28:04.950683 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:04.950640 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-istio-envoy\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:28:04.950683 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:04.950673 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-istio-data\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:28:04.950683 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:04.950682 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/978c27d1-e946-4a56-9701-71b018c6c3f1-istio-token\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:28:04.950683 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:04.950690 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/978c27d1-e946-4a56-9701-71b018c6c3f1-istiod-ca-cert\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:28:04.950992 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:04.950698 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/978c27d1-e946-4a56-9701-71b018c6c3f1-workload-socket\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:28:04.950992 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:04.950706 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/978c27d1-e946-4a56-9701-71b018c6c3f1-istio-podinfo\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:28:04.950992 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:04.950714 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjb67\" (UniqueName: \"kubernetes.io/projected/978c27d1-e946-4a56-9701-71b018c6c3f1-kube-api-access-gjb67\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:28:05.196615 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:05.196579 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:28:05.462494 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:05.462393 2577 generic.go:356] "Generic (PLEG): container finished" podID="978c27d1-e946-4a56-9701-71b018c6c3f1" containerID="262331d432471da6dbf34ff95dc9f5d2b6128add411053bc26d57577c7d8f6a2" exitCode=0 Jul 13 15:28:05.462494 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:05.462438 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" Jul 13 15:28:05.462494 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:05.462458 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" event={"ID":"978c27d1-e946-4a56-9701-71b018c6c3f1","Type":"ContainerDied","Data":"262331d432471da6dbf34ff95dc9f5d2b6128add411053bc26d57577c7d8f6a2"} Jul 13 15:28:05.462739 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:05.462508 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn" event={"ID":"978c27d1-e946-4a56-9701-71b018c6c3f1","Type":"ContainerDied","Data":"78ca41300b50f1095a7b1752ac947199051f0337b9a175885b789ca5697dc569"} Jul 13 15:28:05.462739 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:05.462530 2577 scope.go:117] "RemoveContainer" containerID="262331d432471da6dbf34ff95dc9f5d2b6128add411053bc26d57577c7d8f6a2" Jul 13 15:28:05.473262 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:05.473242 2577 scope.go:117] "RemoveContainer" containerID="b2fd9ae0aa2a5620dae3de4f52a767f46d38b9639154b57d4f5a3ae5c32266e5" Jul 13 15:28:05.480959 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:05.480941 2577 scope.go:117] "RemoveContainer" containerID="262331d432471da6dbf34ff95dc9f5d2b6128add411053bc26d57577c7d8f6a2" Jul 13 15:28:05.481237 ip-10-0-134-237 kubenswrapper[2577]: E0713 15:28:05.481218 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"262331d432471da6dbf34ff95dc9f5d2b6128add411053bc26d57577c7d8f6a2\": container with ID starting with 262331d432471da6dbf34ff95dc9f5d2b6128add411053bc26d57577c7d8f6a2 not found: ID does not exist" containerID="262331d432471da6dbf34ff95dc9f5d2b6128add411053bc26d57577c7d8f6a2" Jul 13 15:28:05.481278 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:05.481246 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"262331d432471da6dbf34ff95dc9f5d2b6128add411053bc26d57577c7d8f6a2"} err="failed to get container status \"262331d432471da6dbf34ff95dc9f5d2b6128add411053bc26d57577c7d8f6a2\": rpc error: code = NotFound desc = could not find container \"262331d432471da6dbf34ff95dc9f5d2b6128add411053bc26d57577c7d8f6a2\": container with ID starting with 262331d432471da6dbf34ff95dc9f5d2b6128add411053bc26d57577c7d8f6a2 not found: ID does not exist" Jul 13 15:28:05.481278 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:05.481263 2577 scope.go:117] "RemoveContainer" containerID="b2fd9ae0aa2a5620dae3de4f52a767f46d38b9639154b57d4f5a3ae5c32266e5" Jul 13 15:28:05.481478 ip-10-0-134-237 kubenswrapper[2577]: E0713 15:28:05.481453 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2fd9ae0aa2a5620dae3de4f52a767f46d38b9639154b57d4f5a3ae5c32266e5\": container with ID starting with b2fd9ae0aa2a5620dae3de4f52a767f46d38b9639154b57d4f5a3ae5c32266e5 not found: ID does not exist" containerID="b2fd9ae0aa2a5620dae3de4f52a767f46d38b9639154b57d4f5a3ae5c32266e5" Jul 13 15:28:05.481522 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:05.481477 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2fd9ae0aa2a5620dae3de4f52a767f46d38b9639154b57d4f5a3ae5c32266e5"} err="failed to get container status \"b2fd9ae0aa2a5620dae3de4f52a767f46d38b9639154b57d4f5a3ae5c32266e5\": rpc error: code = NotFound desc = could not find container \"b2fd9ae0aa2a5620dae3de4f52a767f46d38b9639154b57d4f5a3ae5c32266e5\": container with ID starting with b2fd9ae0aa2a5620dae3de4f52a767f46d38b9639154b57d4f5a3ae5c32266e5 not found: ID does not exist" Jul 13 15:28:05.488660 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:05.488615 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn"] Jul 13 15:28:05.491383 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:05.491358 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-fb1236df-openshift-default-59c45f67bc-2hvwn"] Jul 13 15:28:07.345385 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:07.345351 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="978c27d1-e946-4a56-9701-71b018c6c3f1" path="/var/lib/kubelet/pods/978c27d1-e946-4a56-9701-71b018c6c3f1/volumes" Jul 13 15:28:18.403591 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:18.403549 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:28:55.005177 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.005098 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5"] Jul 13 15:28:55.005622 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.005467 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="978c27d1-e946-4a56-9701-71b018c6c3f1" containerName="istio-proxy" Jul 13 15:28:55.005622 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.005480 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="978c27d1-e946-4a56-9701-71b018c6c3f1" containerName="istio-proxy" Jul 13 15:28:55.005622 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.005490 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="978c27d1-e946-4a56-9701-71b018c6c3f1" containerName="istio-proxy" Jul 13 15:28:55.005622 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.005495 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="978c27d1-e946-4a56-9701-71b018c6c3f1" containerName="istio-proxy" Jul 13 15:28:55.005622 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.005549 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="978c27d1-e946-4a56-9701-71b018c6c3f1" containerName="istio-proxy" Jul 13 15:28:55.008514 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.008497 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:55.011167 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.011143 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-15d63b-openshift-default-dockercfg-8rgfg\"" Jul 13 15:28:55.022900 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.022869 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5"] Jul 13 15:28:55.106151 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.106103 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istio-podinfo\") pod \"e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:55.106392 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.106161 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istio-token\") pod \"e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:55.106392 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.106210 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7ncs\" (UniqueName: \"kubernetes.io/projected/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-kube-api-access-d7ncs\") pod \"e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:55.106392 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.106284 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-workload-socket\") pod \"e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:55.106392 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.106360 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-credential-socket\") pod \"e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:55.106392 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.106386 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istiod-ca-cert\") pod \"e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:55.106635 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.106452 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istio-envoy\") pod \"e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:55.106635 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.106484 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istio-data\") pod \"e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:55.106635 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.106582 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-workload-certs\") pod \"e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:55.207421 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.207382 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-workload-socket\") pod \"e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:55.207604 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.207438 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-credential-socket\") pod \"e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:55.207604 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.207459 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istiod-ca-cert\") pod \"e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:55.207604 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.207488 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istio-envoy\") pod \"e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:55.207604 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.207509 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istio-data\") pod \"e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:55.207604 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.207562 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-workload-certs\") pod \"e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:55.207604 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.207591 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istio-podinfo\") pod \"e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:55.207918 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.207617 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istio-token\") pod \"e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:55.207918 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.207655 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7ncs\" (UniqueName: \"kubernetes.io/projected/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-kube-api-access-d7ncs\") pod \"e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:55.207918 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.207868 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-workload-socket\") pod \"e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:55.207918 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.207907 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-credential-socket\") pod \"e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:55.208185 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.208165 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istio-data\") pod \"e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:55.208253 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.208215 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-workload-certs\") pod \"e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:55.208289 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.208272 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istiod-ca-cert\") pod \"e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:55.210080 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.210050 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istio-envoy\") pod \"e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:55.210286 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.210255 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istio-podinfo\") pod \"e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:55.217502 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.217482 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istio-token\") pod \"e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:55.217873 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.217853 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7ncs\" (UniqueName: \"kubernetes.io/projected/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-kube-api-access-d7ncs\") pod \"e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:55.319227 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.319144 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:55.456608 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.456579 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5"] Jul 13 15:28:55.458822 ip-10-0-134-237 kubenswrapper[2577]: W0713 15:28:55.458797 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8648477a_ca9f_4889_bf57_8a2eb92ab9f6.slice/crio-fc456365a056e5c4d268bd20ccd5ef86261ff18f4eeeb843c1ed57e9e4cdc9cd WatchSource:0}: Error finding container fc456365a056e5c4d268bd20ccd5ef86261ff18f4eeeb843c1ed57e9e4cdc9cd: Status 404 returned error can't find the container with id fc456365a056e5c4d268bd20ccd5ef86261ff18f4eeeb843c1ed57e9e4cdc9cd Jul 13 15:28:55.460863 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.460830 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:28:55.460931 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.460896 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:28:55.460931 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.460923 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:28:55.710079 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.710038 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" event={"ID":"8648477a-ca9f-4889-bf57-8a2eb92ab9f6","Type":"ContainerStarted","Data":"f9d718eed2452edfc02166f21399c4b74d3b8113d03f46ea9b0556bebca62404"} Jul 13 15:28:55.710245 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.710101 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" event={"ID":"8648477a-ca9f-4889-bf57-8a2eb92ab9f6","Type":"ContainerStarted","Data":"fc456365a056e5c4d268bd20ccd5ef86261ff18f4eeeb843c1ed57e9e4cdc9cd"} Jul 13 15:28:55.732730 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:55.732664 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" podStartSLOduration=1.732649131 podStartE2EDuration="1.732649131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:28:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:28:55.731205474 +0000 UTC m=+2159.797778137" watchObservedRunningTime="2026-07-13 15:28:55.732649131 +0000 UTC m=+2159.799221595" Jul 13 15:28:56.319454 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:56.319418 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:56.324614 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:56.324583 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:56.715236 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:56.715207 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:28:56.716125 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:28:56.716104 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:29:05.183675 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:29:05.183643 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:29:12.757009 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:29:12.756962 2577 patch_prober.go:28] interesting pod/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 13 15:29:12.757454 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:29:12.757054 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" podUID="8648477a-ca9f-4889-bf57-8a2eb92ab9f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 13 15:29:14.807125 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:29:14.807090 2577 generic.go:356] "Generic (PLEG): container finished" podID="8648477a-ca9f-4889-bf57-8a2eb92ab9f6" containerID="f9d718eed2452edfc02166f21399c4b74d3b8113d03f46ea9b0556bebca62404" exitCode=0 Jul 13 15:29:14.807663 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:29:14.807167 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" event={"ID":"8648477a-ca9f-4889-bf57-8a2eb92ab9f6","Type":"ContainerDied","Data":"f9d718eed2452edfc02166f21399c4b74d3b8113d03f46ea9b0556bebca62404"} Jul 13 15:29:14.807739 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:29:14.807666 2577 scope.go:117] "RemoveContainer" containerID="f9d718eed2452edfc02166f21399c4b74d3b8113d03f46ea9b0556bebca62404" Jul 13 15:29:14.808696 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:29:14.808668 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:29:14.808821 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:29:14.808734 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:29:14.808821 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:29:14.808800 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:29:15.814227 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:29:15.814194 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" event={"ID":"8648477a-ca9f-4889-bf57-8a2eb92ab9f6","Type":"ContainerStarted","Data":"41d640cb8eced9edd99d31fe9faa69ce9c6768effa7635d7ee38770d02afb87f"} Jul 13 15:29:16.320007 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:29:16.319976 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:29:16.320212 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:29:16.320191 2577 patch_prober.go:28] interesting pod/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 13 15:29:16.320264 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:29:16.320243 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" podUID="8648477a-ca9f-4889-bf57-8a2eb92ab9f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 13 15:29:17.320118 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:29:17.320082 2577 patch_prober.go:28] interesting pod/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 13 15:29:17.320533 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:29:17.320136 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" podUID="8648477a-ca9f-4889-bf57-8a2eb92ab9f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 13 15:29:18.288099 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:29:18.288061 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:29:18.320017 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:29:18.319979 2577 patch_prober.go:28] interesting pod/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 13 15:29:18.320173 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:29:18.320041 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" podUID="8648477a-ca9f-4889-bf57-8a2eb92ab9f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 13 15:29:19.319790 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:29:19.319737 2577 patch_prober.go:28] interesting pod/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 13 15:29:19.319978 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:29:19.319827 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" podUID="8648477a-ca9f-4889-bf57-8a2eb92ab9f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 13 15:29:20.320193 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:29:20.320156 2577 patch_prober.go:28] interesting pod/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 13 15:29:20.320582 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:29:20.320233 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" podUID="8648477a-ca9f-4889-bf57-8a2eb92ab9f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 13 15:29:21.323075 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:29:21.323047 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:29:21.323440 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:29:21.323320 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:29:21.323931 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:29:21.323913 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:29:35.378561 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:29:35.378525 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:29:46.185813 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:29:46.185763 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:30:06.276210 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:06.276180 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:30:23.785127 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:23.785013 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:30:27.882168 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:27.882134 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5"] Jul 13 15:30:27.882590 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:27.882358 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" podUID="8648477a-ca9f-4889-bf57-8a2eb92ab9f6" containerName="istio-proxy" containerID="cri-o://41d640cb8eced9edd99d31fe9faa69ce9c6768effa7635d7ee38770d02afb87f" gracePeriod=30 Jul 13 15:30:33.125146 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.125123 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:30:33.196794 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.196755 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7ncs\" (UniqueName: \"kubernetes.io/projected/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-kube-api-access-d7ncs\") pod \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " Jul 13 15:30:33.196971 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.196821 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-credential-socket\") pod \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " Jul 13 15:30:33.196971 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.196864 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istio-envoy\") pod \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " Jul 13 15:30:33.196971 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.196909 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istio-data\") pod \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " Jul 13 15:30:33.196971 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.196952 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-workload-certs\") pod \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " Jul 13 15:30:33.197204 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.196984 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-workload-socket\") pod \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " Jul 13 15:30:33.197204 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.197038 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istio-podinfo\") pod \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " Jul 13 15:30:33.197204 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.197075 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istiod-ca-cert\") pod \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " Jul 13 15:30:33.197204 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.197112 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istio-token\") pod \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\" (UID: \"8648477a-ca9f-4889-bf57-8a2eb92ab9f6\") " Jul 13 15:30:33.198022 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.197734 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8648477a-ca9f-4889-bf57-8a2eb92ab9f6" (UID: "8648477a-ca9f-4889-bf57-8a2eb92ab9f6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:30:33.198022 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.197991 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istio-data" (OuterVolumeSpecName: "istio-data") pod "8648477a-ca9f-4889-bf57-8a2eb92ab9f6" (UID: "8648477a-ca9f-4889-bf57-8a2eb92ab9f6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:30:33.198316 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.198265 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8648477a-ca9f-4889-bf57-8a2eb92ab9f6" (UID: "8648477a-ca9f-4889-bf57-8a2eb92ab9f6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:30:33.198980 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.198640 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8648477a-ca9f-4889-bf57-8a2eb92ab9f6" (UID: "8648477a-ca9f-4889-bf57-8a2eb92ab9f6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 15:30:33.198980 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.198808 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8648477a-ca9f-4889-bf57-8a2eb92ab9f6" (UID: "8648477a-ca9f-4889-bf57-8a2eb92ab9f6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:30:33.205427 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.205379 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-kube-api-access-d7ncs" (OuterVolumeSpecName: "kube-api-access-d7ncs") pod "8648477a-ca9f-4889-bf57-8a2eb92ab9f6" (UID: "8648477a-ca9f-4889-bf57-8a2eb92ab9f6"). InnerVolumeSpecName "kube-api-access-d7ncs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 15:30:33.205427 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.205383 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8648477a-ca9f-4889-bf57-8a2eb92ab9f6" (UID: "8648477a-ca9f-4889-bf57-8a2eb92ab9f6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 15:30:33.205427 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.205389 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istio-token" (OuterVolumeSpecName: "istio-token") pod "8648477a-ca9f-4889-bf57-8a2eb92ab9f6" (UID: "8648477a-ca9f-4889-bf57-8a2eb92ab9f6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 15:30:33.205635 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.205434 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8648477a-ca9f-4889-bf57-8a2eb92ab9f6" (UID: "8648477a-ca9f-4889-bf57-8a2eb92ab9f6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:30:33.209358 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.209327 2577 generic.go:356] "Generic (PLEG): container finished" podID="8648477a-ca9f-4889-bf57-8a2eb92ab9f6" containerID="41d640cb8eced9edd99d31fe9faa69ce9c6768effa7635d7ee38770d02afb87f" exitCode=0 Jul 13 15:30:33.209459 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.209385 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" Jul 13 15:30:33.209459 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.209417 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" event={"ID":"8648477a-ca9f-4889-bf57-8a2eb92ab9f6","Type":"ContainerDied","Data":"41d640cb8eced9edd99d31fe9faa69ce9c6768effa7635d7ee38770d02afb87f"} Jul 13 15:30:33.209587 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.209493 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5" event={"ID":"8648477a-ca9f-4889-bf57-8a2eb92ab9f6","Type":"ContainerDied","Data":"fc456365a056e5c4d268bd20ccd5ef86261ff18f4eeeb843c1ed57e9e4cdc9cd"} Jul 13 15:30:33.209587 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.209517 2577 scope.go:117] "RemoveContainer" containerID="41d640cb8eced9edd99d31fe9faa69ce9c6768effa7635d7ee38770d02afb87f" Jul 13 15:30:33.219887 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.219870 2577 scope.go:117] "RemoveContainer" containerID="f9d718eed2452edfc02166f21399c4b74d3b8113d03f46ea9b0556bebca62404" Jul 13 15:30:33.227630 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.227606 2577 scope.go:117] "RemoveContainer" containerID="41d640cb8eced9edd99d31fe9faa69ce9c6768effa7635d7ee38770d02afb87f" Jul 13 15:30:33.227932 ip-10-0-134-237 kubenswrapper[2577]: E0713 15:30:33.227915 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41d640cb8eced9edd99d31fe9faa69ce9c6768effa7635d7ee38770d02afb87f\": container with ID starting with 41d640cb8eced9edd99d31fe9faa69ce9c6768effa7635d7ee38770d02afb87f not found: ID does not exist" containerID="41d640cb8eced9edd99d31fe9faa69ce9c6768effa7635d7ee38770d02afb87f" Jul 13 15:30:33.228016 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.227943 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41d640cb8eced9edd99d31fe9faa69ce9c6768effa7635d7ee38770d02afb87f"} err="failed to get container status \"41d640cb8eced9edd99d31fe9faa69ce9c6768effa7635d7ee38770d02afb87f\": rpc error: code = NotFound desc = could not find container \"41d640cb8eced9edd99d31fe9faa69ce9c6768effa7635d7ee38770d02afb87f\": container with ID starting with 41d640cb8eced9edd99d31fe9faa69ce9c6768effa7635d7ee38770d02afb87f not found: ID does not exist" Jul 13 15:30:33.228016 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.227967 2577 scope.go:117] "RemoveContainer" containerID="f9d718eed2452edfc02166f21399c4b74d3b8113d03f46ea9b0556bebca62404" Jul 13 15:30:33.228227 ip-10-0-134-237 kubenswrapper[2577]: E0713 15:30:33.228208 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9d718eed2452edfc02166f21399c4b74d3b8113d03f46ea9b0556bebca62404\": container with ID starting with f9d718eed2452edfc02166f21399c4b74d3b8113d03f46ea9b0556bebca62404 not found: ID does not exist" containerID="f9d718eed2452edfc02166f21399c4b74d3b8113d03f46ea9b0556bebca62404" Jul 13 15:30:33.228269 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.228233 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9d718eed2452edfc02166f21399c4b74d3b8113d03f46ea9b0556bebca62404"} err="failed to get container status \"f9d718eed2452edfc02166f21399c4b74d3b8113d03f46ea9b0556bebca62404\": rpc error: code = NotFound desc = could not find container \"f9d718eed2452edfc02166f21399c4b74d3b8113d03f46ea9b0556bebca62404\": container with ID starting with f9d718eed2452edfc02166f21399c4b74d3b8113d03f46ea9b0556bebca62404 not found: ID does not exist" Jul 13 15:30:33.231139 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.231107 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5"] Jul 13 15:30:33.235119 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.235099 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-15d63b-openshift-default-87bbfcc47-4hng5"] Jul 13 15:30:33.299903 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.299869 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istio-token\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:30:33.299903 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.299896 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7ncs\" (UniqueName: \"kubernetes.io/projected/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-kube-api-access-d7ncs\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:30:33.299903 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.299906 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-credential-socket\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:30:33.300113 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.299916 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istio-envoy\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:30:33.300113 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.299924 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istio-data\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:30:33.300113 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.299932 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-workload-certs\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:30:33.300113 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.299939 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-workload-socket\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:30:33.300113 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.299946 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istio-podinfo\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:30:33.300113 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.299954 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8648477a-ca9f-4889-bf57-8a2eb92ab9f6-istiod-ca-cert\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:30:33.346003 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:33.345973 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8648477a-ca9f-4889-bf57-8a2eb92ab9f6" path="/var/lib/kubelet/pods/8648477a-ca9f-4889-bf57-8a2eb92ab9f6/volumes" Jul 13 15:30:41.874613 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:41.874576 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:30:54.951968 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:54.951929 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp"] Jul 13 15:30:54.952553 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:54.952425 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8648477a-ca9f-4889-bf57-8a2eb92ab9f6" containerName="istio-proxy" Jul 13 15:30:54.952553 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:54.952446 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8648477a-ca9f-4889-bf57-8a2eb92ab9f6" containerName="istio-proxy" Jul 13 15:30:54.952553 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:54.952489 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8648477a-ca9f-4889-bf57-8a2eb92ab9f6" containerName="istio-proxy" Jul 13 15:30:54.952553 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:54.952499 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8648477a-ca9f-4889-bf57-8a2eb92ab9f6" containerName="istio-proxy" Jul 13 15:30:54.952793 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:54.952585 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8648477a-ca9f-4889-bf57-8a2eb92ab9f6" containerName="istio-proxy" Jul 13 15:30:54.952793 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:54.952601 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8648477a-ca9f-4889-bf57-8a2eb92ab9f6" containerName="istio-proxy" Jul 13 15:30:54.952793 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:54.952612 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="978c27d1-e946-4a56-9701-71b018c6c3f1" containerName="istio-proxy" Jul 13 15:30:54.957130 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:54.957105 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:54.959638 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:54.959616 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-4b866e-openshift-default-dockercfg-kmbbf\"" Jul 13 15:30:54.967893 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:54.967862 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp"] Jul 13 15:30:55.095864 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.095823 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/117e2975-0720-47a4-b8f0-5150f6f5baa0-istio-podinfo\") pod \"e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:55.095864 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.095870 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-workload-socket\") pod \"e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:55.096091 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.095893 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-credential-socket\") pod \"e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:55.096091 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.095914 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-istio-envoy\") pod \"e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:55.096091 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.095945 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-istio-data\") pod \"e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:55.096091 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.095974 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-workload-certs\") pod \"e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:55.096091 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.095995 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/117e2975-0720-47a4-b8f0-5150f6f5baa0-istio-token\") pod \"e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:55.096091 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.096029 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpnld\" (UniqueName: \"kubernetes.io/projected/117e2975-0720-47a4-b8f0-5150f6f5baa0-kube-api-access-mpnld\") pod \"e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:55.096091 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.096053 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/117e2975-0720-47a4-b8f0-5150f6f5baa0-istiod-ca-cert\") pod \"e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:55.196682 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.196634 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpnld\" (UniqueName: \"kubernetes.io/projected/117e2975-0720-47a4-b8f0-5150f6f5baa0-kube-api-access-mpnld\") pod \"e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:55.196910 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.196692 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/117e2975-0720-47a4-b8f0-5150f6f5baa0-istiod-ca-cert\") pod \"e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:55.196910 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.196741 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/117e2975-0720-47a4-b8f0-5150f6f5baa0-istio-podinfo\") pod \"e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:55.196910 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.196770 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-workload-socket\") pod \"e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:55.196910 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.196831 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-credential-socket\") pod \"e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:55.196910 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.196852 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-istio-envoy\") pod \"e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:55.196910 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.196885 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-istio-data\") pod \"e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:55.197243 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.196935 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-workload-certs\") pod \"e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:55.197243 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.196966 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/117e2975-0720-47a4-b8f0-5150f6f5baa0-istio-token\") pod \"e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:55.197354 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.197287 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-credential-socket\") pod \"e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:55.197421 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.197384 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-workload-socket\") pod \"e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:55.197485 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.197462 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-workload-certs\") pod \"e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:55.197537 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.197517 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-istio-data\") pod \"e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:55.197607 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.197590 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/117e2975-0720-47a4-b8f0-5150f6f5baa0-istiod-ca-cert\") pod \"e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:55.199287 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.199258 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-istio-envoy\") pod \"e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:55.199417 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.199396 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/117e2975-0720-47a4-b8f0-5150f6f5baa0-istio-podinfo\") pod \"e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:55.205015 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.204959 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/117e2975-0720-47a4-b8f0-5150f6f5baa0-istio-token\") pod \"e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:55.205312 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.205291 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpnld\" (UniqueName: \"kubernetes.io/projected/117e2975-0720-47a4-b8f0-5150f6f5baa0-kube-api-access-mpnld\") pod \"e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:55.268895 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.268852 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:55.415750 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.415712 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp"] Jul 13 15:30:55.416876 ip-10-0-134-237 kubenswrapper[2577]: W0713 15:30:55.416833 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod117e2975_0720_47a4_b8f0_5150f6f5baa0.slice/crio-8d5538e30adbf209b0a7dffdb4d4cbdbd6588eef4f91c24a3f6562d34af4661f WatchSource:0}: Error finding container 8d5538e30adbf209b0a7dffdb4d4cbdbd6588eef4f91c24a3f6562d34af4661f: Status 404 returned error can't find the container with id 8d5538e30adbf209b0a7dffdb4d4cbdbd6588eef4f91c24a3f6562d34af4661f Jul 13 15:30:55.419116 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.419075 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:30:55.419218 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.419160 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:30:55.419218 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:55.419202 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:30:56.326077 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:56.326032 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" event={"ID":"117e2975-0720-47a4-b8f0-5150f6f5baa0","Type":"ContainerStarted","Data":"f9732b274180dcbacbcc9a0d637091d4cb124c7f322fe9cb8a6493f33af0d6eb"} Jul 13 15:30:56.326584 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:56.326095 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" event={"ID":"117e2975-0720-47a4-b8f0-5150f6f5baa0","Type":"ContainerStarted","Data":"8d5538e30adbf209b0a7dffdb4d4cbdbd6588eef4f91c24a3f6562d34af4661f"} Jul 13 15:30:56.348538 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:56.348485 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" podStartSLOduration=2.348469356 podStartE2EDuration="2.348469356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:30:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:30:56.345748122 +0000 UTC m=+2280.412320589" watchObservedRunningTime="2026-07-13 15:30:56.348469356 +0000 UTC m=+2280.415041821" Jul 13 15:30:57.269758 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:57.269715 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:57.274514 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:57.274488 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:57.331166 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:57.331134 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:30:57.332069 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:30:57.332046 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:31:02.984220 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:02.984186 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:31:11.405515 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:11.405479 2577 generic.go:356] "Generic (PLEG): container finished" podID="117e2975-0720-47a4-b8f0-5150f6f5baa0" containerID="f9732b274180dcbacbcc9a0d637091d4cb124c7f322fe9cb8a6493f33af0d6eb" exitCode=0 Jul 13 15:31:11.406056 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:11.405514 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" event={"ID":"117e2975-0720-47a4-b8f0-5150f6f5baa0","Type":"ContainerDied","Data":"f9732b274180dcbacbcc9a0d637091d4cb124c7f322fe9cb8a6493f33af0d6eb"} Jul 13 15:31:11.406056 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:11.406031 2577 scope.go:117] "RemoveContainer" containerID="f9732b274180dcbacbcc9a0d637091d4cb124c7f322fe9cb8a6493f33af0d6eb" Jul 13 15:31:11.407077 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:11.407048 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:31:11.407191 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:11.407115 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:31:11.407191 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:11.407147 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:31:12.332120 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:12.332082 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:31:12.413030 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:12.412985 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" event={"ID":"117e2975-0720-47a4-b8f0-5150f6f5baa0","Type":"ContainerStarted","Data":"8c9f109bbe4f53405010d9eed3574ed459dc18e6b165413052ae5cac9b619b7d"} Jul 13 15:31:13.269558 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:13.269514 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:31:13.270727 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:13.270706 2577 patch_prober.go:28] interesting pod/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 13 15:31:13.270810 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:13.270756 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" podUID="117e2975-0720-47a4-b8f0-5150f6f5baa0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 13 15:31:14.269359 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:14.269322 2577 patch_prober.go:28] interesting pod/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 13 15:31:14.269801 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:14.269390 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" podUID="117e2975-0720-47a4-b8f0-5150f6f5baa0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 13 15:31:15.269981 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:15.269944 2577 patch_prober.go:28] interesting pod/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 13 15:31:15.270405 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:15.270001 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" podUID="117e2975-0720-47a4-b8f0-5150f6f5baa0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 13 15:31:15.681711 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:15.681676 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:31:16.269408 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:16.269366 2577 patch_prober.go:28] interesting pod/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 13 15:31:16.269622 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:16.269426 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" podUID="117e2975-0720-47a4-b8f0-5150f6f5baa0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 13 15:31:17.274029 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:17.273991 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:31:17.274511 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:17.274371 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:31:17.275116 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:17.275096 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:31:34.479876 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:34.479838 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:31:45.235580 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:45.235529 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp"] Jul 13 15:31:45.236113 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:45.235794 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" podUID="117e2975-0720-47a4-b8f0-5150f6f5baa0" containerName="istio-proxy" containerID="cri-o://8c9f109bbe4f53405010d9eed3574ed459dc18e6b165413052ae5cac9b619b7d" gracePeriod=30 Jul 13 15:31:47.276616 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:47.276579 2577 patch_prober.go:28] interesting pod/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 13 15:31:47.277043 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:47.276636 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" podUID="117e2975-0720-47a4-b8f0-5150f6f5baa0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 15:31:50.482516 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.482489 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:31:50.528936 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.528850 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-workload-socket\") pod \"117e2975-0720-47a4-b8f0-5150f6f5baa0\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " Jul 13 15:31:50.528936 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.528919 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-credential-socket\") pod \"117e2975-0720-47a4-b8f0-5150f6f5baa0\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " Jul 13 15:31:50.529176 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.528942 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/117e2975-0720-47a4-b8f0-5150f6f5baa0-istiod-ca-cert\") pod \"117e2975-0720-47a4-b8f0-5150f6f5baa0\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " Jul 13 15:31:50.529176 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.528960 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/117e2975-0720-47a4-b8f0-5150f6f5baa0-istio-token\") pod \"117e2975-0720-47a4-b8f0-5150f6f5baa0\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " Jul 13 15:31:50.529176 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.528986 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/117e2975-0720-47a4-b8f0-5150f6f5baa0-istio-podinfo\") pod \"117e2975-0720-47a4-b8f0-5150f6f5baa0\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " Jul 13 15:31:50.529176 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.529032 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-workload-certs\") pod \"117e2975-0720-47a4-b8f0-5150f6f5baa0\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " Jul 13 15:31:50.529176 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.529066 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-istio-data\") pod \"117e2975-0720-47a4-b8f0-5150f6f5baa0\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " Jul 13 15:31:50.529176 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.529101 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpnld\" (UniqueName: \"kubernetes.io/projected/117e2975-0720-47a4-b8f0-5150f6f5baa0-kube-api-access-mpnld\") pod \"117e2975-0720-47a4-b8f0-5150f6f5baa0\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " Jul 13 15:31:50.529176 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.529107 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "117e2975-0720-47a4-b8f0-5150f6f5baa0" (UID: "117e2975-0720-47a4-b8f0-5150f6f5baa0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:31:50.529176 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.529126 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-istio-envoy\") pod \"117e2975-0720-47a4-b8f0-5150f6f5baa0\" (UID: \"117e2975-0720-47a4-b8f0-5150f6f5baa0\") " Jul 13 15:31:50.529590 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.529268 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "117e2975-0720-47a4-b8f0-5150f6f5baa0" (UID: "117e2975-0720-47a4-b8f0-5150f6f5baa0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:31:50.529590 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.529448 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/117e2975-0720-47a4-b8f0-5150f6f5baa0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "117e2975-0720-47a4-b8f0-5150f6f5baa0" (UID: "117e2975-0720-47a4-b8f0-5150f6f5baa0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 15:31:50.529590 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.529477 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-workload-socket\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:31:50.529590 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.529497 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-credential-socket\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:31:50.529904 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.529735 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "117e2975-0720-47a4-b8f0-5150f6f5baa0" (UID: "117e2975-0720-47a4-b8f0-5150f6f5baa0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:31:50.530003 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.529983 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-istio-data" (OuterVolumeSpecName: "istio-data") pod "117e2975-0720-47a4-b8f0-5150f6f5baa0" (UID: "117e2975-0720-47a4-b8f0-5150f6f5baa0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:31:50.531718 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.531686 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/117e2975-0720-47a4-b8f0-5150f6f5baa0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "117e2975-0720-47a4-b8f0-5150f6f5baa0" (UID: "117e2975-0720-47a4-b8f0-5150f6f5baa0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 15:31:50.531718 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.531708 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/117e2975-0720-47a4-b8f0-5150f6f5baa0-istio-token" (OuterVolumeSpecName: "istio-token") pod "117e2975-0720-47a4-b8f0-5150f6f5baa0" (UID: "117e2975-0720-47a4-b8f0-5150f6f5baa0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 15:31:50.531887 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.531746 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "117e2975-0720-47a4-b8f0-5150f6f5baa0" (UID: "117e2975-0720-47a4-b8f0-5150f6f5baa0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:31:50.531887 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.531753 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/117e2975-0720-47a4-b8f0-5150f6f5baa0-kube-api-access-mpnld" (OuterVolumeSpecName: "kube-api-access-mpnld") pod "117e2975-0720-47a4-b8f0-5150f6f5baa0" (UID: "117e2975-0720-47a4-b8f0-5150f6f5baa0"). InnerVolumeSpecName "kube-api-access-mpnld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 15:31:50.610018 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.609980 2577 generic.go:356] "Generic (PLEG): container finished" podID="117e2975-0720-47a4-b8f0-5150f6f5baa0" containerID="8c9f109bbe4f53405010d9eed3574ed459dc18e6b165413052ae5cac9b619b7d" exitCode=0 Jul 13 15:31:50.610194 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.610028 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" Jul 13 15:31:50.610194 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.610061 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" event={"ID":"117e2975-0720-47a4-b8f0-5150f6f5baa0","Type":"ContainerDied","Data":"8c9f109bbe4f53405010d9eed3574ed459dc18e6b165413052ae5cac9b619b7d"} Jul 13 15:31:50.610194 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.610115 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp" event={"ID":"117e2975-0720-47a4-b8f0-5150f6f5baa0","Type":"ContainerDied","Data":"8d5538e30adbf209b0a7dffdb4d4cbdbd6588eef4f91c24a3f6562d34af4661f"} Jul 13 15:31:50.610194 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.610137 2577 scope.go:117] "RemoveContainer" containerID="8c9f109bbe4f53405010d9eed3574ed459dc18e6b165413052ae5cac9b619b7d" Jul 13 15:31:50.619420 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.619405 2577 scope.go:117] "RemoveContainer" containerID="f9732b274180dcbacbcc9a0d637091d4cb124c7f322fe9cb8a6493f33af0d6eb" Jul 13 15:31:50.627858 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.627836 2577 scope.go:117] "RemoveContainer" containerID="8c9f109bbe4f53405010d9eed3574ed459dc18e6b165413052ae5cac9b619b7d" Jul 13 15:31:50.628123 ip-10-0-134-237 kubenswrapper[2577]: E0713 15:31:50.628103 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c9f109bbe4f53405010d9eed3574ed459dc18e6b165413052ae5cac9b619b7d\": container with ID starting with 8c9f109bbe4f53405010d9eed3574ed459dc18e6b165413052ae5cac9b619b7d not found: ID does not exist" containerID="8c9f109bbe4f53405010d9eed3574ed459dc18e6b165413052ae5cac9b619b7d" Jul 13 15:31:50.628203 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.628137 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c9f109bbe4f53405010d9eed3574ed459dc18e6b165413052ae5cac9b619b7d"} err="failed to get container status \"8c9f109bbe4f53405010d9eed3574ed459dc18e6b165413052ae5cac9b619b7d\": rpc error: code = NotFound desc = could not find container \"8c9f109bbe4f53405010d9eed3574ed459dc18e6b165413052ae5cac9b619b7d\": container with ID starting with 8c9f109bbe4f53405010d9eed3574ed459dc18e6b165413052ae5cac9b619b7d not found: ID does not exist" Jul 13 15:31:50.628203 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.628163 2577 scope.go:117] "RemoveContainer" containerID="f9732b274180dcbacbcc9a0d637091d4cb124c7f322fe9cb8a6493f33af0d6eb" Jul 13 15:31:50.628418 ip-10-0-134-237 kubenswrapper[2577]: E0713 15:31:50.628401 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9732b274180dcbacbcc9a0d637091d4cb124c7f322fe9cb8a6493f33af0d6eb\": container with ID starting with f9732b274180dcbacbcc9a0d637091d4cb124c7f322fe9cb8a6493f33af0d6eb not found: ID does not exist" containerID="f9732b274180dcbacbcc9a0d637091d4cb124c7f322fe9cb8a6493f33af0d6eb" Jul 13 15:31:50.628456 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.628425 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9732b274180dcbacbcc9a0d637091d4cb124c7f322fe9cb8a6493f33af0d6eb"} err="failed to get container status \"f9732b274180dcbacbcc9a0d637091d4cb124c7f322fe9cb8a6493f33af0d6eb\": rpc error: code = NotFound desc = could not find container \"f9732b274180dcbacbcc9a0d637091d4cb124c7f322fe9cb8a6493f33af0d6eb\": container with ID starting with f9732b274180dcbacbcc9a0d637091d4cb124c7f322fe9cb8a6493f33af0d6eb not found: ID does not exist" Jul 13 15:31:50.630270 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.630251 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-workload-certs\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:31:50.630371 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.630274 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-istio-data\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:31:50.630371 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.630287 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpnld\" (UniqueName: \"kubernetes.io/projected/117e2975-0720-47a4-b8f0-5150f6f5baa0-kube-api-access-mpnld\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:31:50.630371 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.630299 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/117e2975-0720-47a4-b8f0-5150f6f5baa0-istio-envoy\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:31:50.630371 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.630313 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/117e2975-0720-47a4-b8f0-5150f6f5baa0-istiod-ca-cert\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:31:50.630371 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.630325 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/117e2975-0720-47a4-b8f0-5150f6f5baa0-istio-token\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:31:50.630371 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.630335 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/117e2975-0720-47a4-b8f0-5150f6f5baa0-istio-podinfo\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:31:50.632274 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.632255 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp"] Jul 13 15:31:50.636037 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:50.636017 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-4b866e-openshift-default-5947d7f69-z56cp"] Jul 13 15:31:51.345519 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:51.345488 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="117e2975-0720-47a4-b8f0-5150f6f5baa0" path="/var/lib/kubelet/pods/117e2975-0720-47a4-b8f0-5150f6f5baa0/volumes" Jul 13 15:31:58.793238 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:31:58.793195 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:32:12.298364 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.298335 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs"] Jul 13 15:32:12.298871 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.298667 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="117e2975-0720-47a4-b8f0-5150f6f5baa0" containerName="istio-proxy" Jul 13 15:32:12.298871 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.298680 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="117e2975-0720-47a4-b8f0-5150f6f5baa0" containerName="istio-proxy" Jul 13 15:32:12.298871 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.298695 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="117e2975-0720-47a4-b8f0-5150f6f5baa0" containerName="istio-proxy" Jul 13 15:32:12.298871 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.298701 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="117e2975-0720-47a4-b8f0-5150f6f5baa0" containerName="istio-proxy" Jul 13 15:32:12.298871 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.298751 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="117e2975-0720-47a4-b8f0-5150f6f5baa0" containerName="istio-proxy" Jul 13 15:32:12.298871 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.298759 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="117e2975-0720-47a4-b8f0-5150f6f5baa0" containerName="istio-proxy" Jul 13 15:32:12.300815 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.300765 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:12.303726 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.303704 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-88b181-openshift-default-dockercfg-6jz2c\"" Jul 13 15:32:12.312681 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.312660 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs"] Jul 13 15:32:12.430887 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.430850 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-istio-data\") pod \"e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:12.431100 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.430909 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-istio-envoy\") pod \"e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:12.431100 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.430949 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-credential-socket\") pod \"e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:12.431100 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.431040 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d31aa8af-5673-4d82-b27b-c7671e78a437-istio-token\") pod \"e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:12.431100 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.431078 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-workload-certs\") pod \"e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:12.431290 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.431120 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-workload-socket\") pod \"e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:12.431290 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.431138 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d31aa8af-5673-4d82-b27b-c7671e78a437-istio-podinfo\") pod \"e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:12.431290 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.431158 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d31aa8af-5673-4d82-b27b-c7671e78a437-istiod-ca-cert\") pod \"e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:12.431290 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.431188 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm52p\" (UniqueName: \"kubernetes.io/projected/d31aa8af-5673-4d82-b27b-c7671e78a437-kube-api-access-vm52p\") pod \"e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:12.531915 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.531873 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-istio-data\") pod \"e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:12.532086 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.531944 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-istio-envoy\") pod \"e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:12.532086 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.531988 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-credential-socket\") pod \"e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:12.532160 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.532133 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d31aa8af-5673-4d82-b27b-c7671e78a437-istio-token\") pod \"e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:12.532195 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.532175 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-workload-certs\") pod \"e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:12.532235 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.532207 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-workload-socket\") pod \"e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:12.532292 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.532231 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d31aa8af-5673-4d82-b27b-c7671e78a437-istio-podinfo\") pod \"e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:12.532292 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.532258 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d31aa8af-5673-4d82-b27b-c7671e78a437-istiod-ca-cert\") pod \"e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:12.532292 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.532282 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm52p\" (UniqueName: \"kubernetes.io/projected/d31aa8af-5673-4d82-b27b-c7671e78a437-kube-api-access-vm52p\") pod \"e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:12.532436 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.532340 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-istio-data\") pod \"e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:12.532562 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.532537 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-workload-socket\") pod \"e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:12.532630 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.532577 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-workload-certs\") pod \"e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:12.532673 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.532643 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-credential-socket\") pod \"e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:12.532945 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.532927 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d31aa8af-5673-4d82-b27b-c7671e78a437-istiod-ca-cert\") pod \"e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:12.534276 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.534261 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-istio-envoy\") pod \"e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:12.534728 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.534708 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d31aa8af-5673-4d82-b27b-c7671e78a437-istio-podinfo\") pod \"e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:12.541476 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.541452 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d31aa8af-5673-4d82-b27b-c7671e78a437-istio-token\") pod \"e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:12.541600 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.541587 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm52p\" (UniqueName: \"kubernetes.io/projected/d31aa8af-5673-4d82-b27b-c7671e78a437-kube-api-access-vm52p\") pod \"e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:12.610608 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.610511 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:12.746062 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.746036 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs"] Jul 13 15:32:12.748039 ip-10-0-134-237 kubenswrapper[2577]: W0713 15:32:12.748000 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd31aa8af_5673_4d82_b27b_c7671e78a437.slice/crio-a727b878155641c0ec90301af130e67f3655d4763c6f6bbab6821fc9edd1710d WatchSource:0}: Error finding container a727b878155641c0ec90301af130e67f3655d4763c6f6bbab6821fc9edd1710d: Status 404 returned error can't find the container with id a727b878155641c0ec90301af130e67f3655d4763c6f6bbab6821fc9edd1710d Jul 13 15:32:12.750212 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.750172 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:32:12.750307 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.750256 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:32:12.750307 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:12.750297 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:32:13.729952 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:13.729917 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" event={"ID":"d31aa8af-5673-4d82-b27b-c7671e78a437","Type":"ContainerStarted","Data":"dad22e46bcd97a9cd7585d95e5b0676f3184518e4a9a8d3af661f47cb9d811a6"} Jul 13 15:32:13.730427 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:13.729978 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" event={"ID":"d31aa8af-5673-4d82-b27b-c7671e78a437","Type":"ContainerStarted","Data":"a727b878155641c0ec90301af130e67f3655d4763c6f6bbab6821fc9edd1710d"} Jul 13 15:32:13.754554 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:13.754486 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" podStartSLOduration=1.754467355 podStartE2EDuration="1.754467355s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:32:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:32:13.753292172 +0000 UTC m=+2357.819864651" watchObservedRunningTime="2026-07-13 15:32:13.754467355 +0000 UTC m=+2357.821039822" Jul 13 15:32:14.611569 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:14.611527 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:14.616895 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:14.616865 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:14.735504 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:14.735472 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:14.736354 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:14.736338 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:20.385510 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:20.385468 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:32:28.807353 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:28.807314 2577 generic.go:356] "Generic (PLEG): container finished" podID="d31aa8af-5673-4d82-b27b-c7671e78a437" containerID="dad22e46bcd97a9cd7585d95e5b0676f3184518e4a9a8d3af661f47cb9d811a6" exitCode=0 Jul 13 15:32:28.807821 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:28.807384 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" event={"ID":"d31aa8af-5673-4d82-b27b-c7671e78a437","Type":"ContainerDied","Data":"dad22e46bcd97a9cd7585d95e5b0676f3184518e4a9a8d3af661f47cb9d811a6"} Jul 13 15:32:28.807821 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:28.807796 2577 scope.go:117] "RemoveContainer" containerID="dad22e46bcd97a9cd7585d95e5b0676f3184518e4a9a8d3af661f47cb9d811a6" Jul 13 15:32:28.808837 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:28.808807 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:32:28.808910 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:28.808892 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:32:28.808962 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:28.808948 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 13 15:32:29.736197 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:29.736161 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:29.814044 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:29.814007 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" event={"ID":"d31aa8af-5673-4d82-b27b-c7671e78a437","Type":"ContainerStarted","Data":"c41b9cf1708856b5e56c901c23f1f6c3f86c426c900b434aabc15bfeb2c2b727"} Jul 13 15:32:30.611180 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:30.611142 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:30.612347 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:30.612320 2577 patch_prober.go:28] interesting pod/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 13 15:32:30.612491 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:30.612374 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" podUID="d31aa8af-5673-4d82-b27b-c7671e78a437" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 13 15:32:31.611085 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:31.611054 2577 patch_prober.go:28] interesting pod/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 13 15:32:31.611466 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:31.611112 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" podUID="d31aa8af-5673-4d82-b27b-c7671e78a437" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 13 15:32:31.890858 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:31.890741 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:32:32.611864 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:32.611832 2577 patch_prober.go:28] interesting pod/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 13 15:32:32.612253 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:32.611898 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" podUID="d31aa8af-5673-4d82-b27b-c7671e78a437" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 13 15:32:33.611727 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:33.611692 2577 patch_prober.go:28] interesting pod/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 13 15:32:33.611924 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:33.611755 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" podUID="d31aa8af-5673-4d82-b27b-c7671e78a437" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 13 15:32:34.614808 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:34.614768 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:34.615225 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:34.615051 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:34.615731 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:34.615713 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:32:44.193101 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:32:44.193039 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:33:12.508020 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:33:12.507984 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:33:35.885309 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:33:35.885271 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:33:53.782010 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:33:53.781974 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:34:09.397726 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:34:09.397689 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:34:27.189943 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:34:27.189905 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:34:46.797385 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:34:46.797346 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:35:03.998145 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:35:03.998066 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:35:22.493073 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:35:22.493034 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:35:45.999839 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:35:45.999804 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:36:12.817319 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:36:12.817288 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:36:37.703177 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:36:37.703144 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:36:54.893373 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:36:54.893337 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:37:13.911359 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:37:13.911322 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:37:28.591132 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:37:28.591101 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:37:51.088539 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:37:51.088458 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:38:05.790832 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:38:05.790789 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:38:21.696119 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:38:21.696087 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:38:36.483392 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:38:36.483346 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:39:04.682157 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:04.682120 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:39:16.342292 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:16.342257 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs"] Jul 13 15:39:16.342811 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:16.342516 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" podUID="d31aa8af-5673-4d82-b27b-c7671e78a437" containerName="istio-proxy" containerID="cri-o://c41b9cf1708856b5e56c901c23f1f6c3f86c426c900b434aabc15bfeb2c2b727" gracePeriod=30 Jul 13 15:39:19.617936 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:19.617840 2577 patch_prober.go:28] interesting pod/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 13 15:39:19.617936 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:19.617919 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" podUID="d31aa8af-5673-4d82-b27b-c7671e78a437" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 15:39:21.594808 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.594769 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:39:21.716577 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.716551 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-istio-envoy\") pod \"d31aa8af-5673-4d82-b27b-c7671e78a437\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " Jul 13 15:39:21.716577 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.716578 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-credential-socket\") pod \"d31aa8af-5673-4d82-b27b-c7671e78a437\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " Jul 13 15:39:21.716832 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.716606 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d31aa8af-5673-4d82-b27b-c7671e78a437-istio-podinfo\") pod \"d31aa8af-5673-4d82-b27b-c7671e78a437\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " Jul 13 15:39:21.716832 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.716632 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-workload-certs\") pod \"d31aa8af-5673-4d82-b27b-c7671e78a437\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " Jul 13 15:39:21.716832 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.716650 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vm52p\" (UniqueName: \"kubernetes.io/projected/d31aa8af-5673-4d82-b27b-c7671e78a437-kube-api-access-vm52p\") pod \"d31aa8af-5673-4d82-b27b-c7671e78a437\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " Jul 13 15:39:21.716832 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.716702 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-istio-data\") pod \"d31aa8af-5673-4d82-b27b-c7671e78a437\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " Jul 13 15:39:21.716832 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.716732 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d31aa8af-5673-4d82-b27b-c7671e78a437-istio-token\") pod \"d31aa8af-5673-4d82-b27b-c7671e78a437\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " Jul 13 15:39:21.716832 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.716761 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d31aa8af-5673-4d82-b27b-c7671e78a437-istiod-ca-cert\") pod \"d31aa8af-5673-4d82-b27b-c7671e78a437\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " Jul 13 15:39:21.716832 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.716813 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-workload-socket\") pod \"d31aa8af-5673-4d82-b27b-c7671e78a437\" (UID: \"d31aa8af-5673-4d82-b27b-c7671e78a437\") " Jul 13 15:39:21.717223 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.716874 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d31aa8af-5673-4d82-b27b-c7671e78a437" (UID: "d31aa8af-5673-4d82-b27b-c7671e78a437"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:39:21.717223 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.716931 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d31aa8af-5673-4d82-b27b-c7671e78a437" (UID: "d31aa8af-5673-4d82-b27b-c7671e78a437"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:39:21.717223 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.717090 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d31aa8af-5673-4d82-b27b-c7671e78a437" (UID: "d31aa8af-5673-4d82-b27b-c7671e78a437"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:39:21.717223 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.717109 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-credential-socket\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:39:21.717223 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.717127 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-workload-certs\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:39:21.717223 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.717199 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d31aa8af-5673-4d82-b27b-c7671e78a437-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d31aa8af-5673-4d82-b27b-c7671e78a437" (UID: "d31aa8af-5673-4d82-b27b-c7671e78a437"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 15:39:21.718052 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.718024 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-istio-data" (OuterVolumeSpecName: "istio-data") pod "d31aa8af-5673-4d82-b27b-c7671e78a437" (UID: "d31aa8af-5673-4d82-b27b-c7671e78a437"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:39:21.718682 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.718661 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d31aa8af-5673-4d82-b27b-c7671e78a437" (UID: "d31aa8af-5673-4d82-b27b-c7671e78a437"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:39:21.718922 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.718902 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d31aa8af-5673-4d82-b27b-c7671e78a437-istio-token" (OuterVolumeSpecName: "istio-token") pod "d31aa8af-5673-4d82-b27b-c7671e78a437" (UID: "d31aa8af-5673-4d82-b27b-c7671e78a437"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 15:39:21.719122 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.719105 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d31aa8af-5673-4d82-b27b-c7671e78a437-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d31aa8af-5673-4d82-b27b-c7671e78a437" (UID: "d31aa8af-5673-4d82-b27b-c7671e78a437"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 15:39:21.719224 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.719204 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d31aa8af-5673-4d82-b27b-c7671e78a437-kube-api-access-vm52p" (OuterVolumeSpecName: "kube-api-access-vm52p") pod "d31aa8af-5673-4d82-b27b-c7671e78a437" (UID: "d31aa8af-5673-4d82-b27b-c7671e78a437"). InnerVolumeSpecName "kube-api-access-vm52p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 15:39:21.817920 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.817901 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-istio-envoy\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:39:21.818018 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.817923 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d31aa8af-5673-4d82-b27b-c7671e78a437-istio-podinfo\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:39:21.818018 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.817936 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vm52p\" (UniqueName: \"kubernetes.io/projected/d31aa8af-5673-4d82-b27b-c7671e78a437-kube-api-access-vm52p\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:39:21.818018 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.817948 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-istio-data\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:39:21.818018 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.817959 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d31aa8af-5673-4d82-b27b-c7671e78a437-istio-token\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:39:21.818018 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.817969 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d31aa8af-5673-4d82-b27b-c7671e78a437-istiod-ca-cert\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:39:21.818018 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.817981 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d31aa8af-5673-4d82-b27b-c7671e78a437-workload-socket\") on node \"ip-10-0-134-237.ec2.internal\" DevicePath \"\"" Jul 13 15:39:21.828150 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.828127 2577 generic.go:356] "Generic (PLEG): container finished" podID="d31aa8af-5673-4d82-b27b-c7671e78a437" containerID="c41b9cf1708856b5e56c901c23f1f6c3f86c426c900b434aabc15bfeb2c2b727" exitCode=0 Jul 13 15:39:21.828251 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.828174 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" event={"ID":"d31aa8af-5673-4d82-b27b-c7671e78a437","Type":"ContainerDied","Data":"c41b9cf1708856b5e56c901c23f1f6c3f86c426c900b434aabc15bfeb2c2b727"} Jul 13 15:39:21.828251 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.828180 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" Jul 13 15:39:21.828251 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.828216 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs" event={"ID":"d31aa8af-5673-4d82-b27b-c7671e78a437","Type":"ContainerDied","Data":"a727b878155641c0ec90301af130e67f3655d4763c6f6bbab6821fc9edd1710d"} Jul 13 15:39:21.828251 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.828236 2577 scope.go:117] "RemoveContainer" containerID="c41b9cf1708856b5e56c901c23f1f6c3f86c426c900b434aabc15bfeb2c2b727" Jul 13 15:39:21.836933 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.836912 2577 scope.go:117] "RemoveContainer" containerID="dad22e46bcd97a9cd7585d95e5b0676f3184518e4a9a8d3af661f47cb9d811a6" Jul 13 15:39:21.844400 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.844385 2577 scope.go:117] "RemoveContainer" containerID="c41b9cf1708856b5e56c901c23f1f6c3f86c426c900b434aabc15bfeb2c2b727" Jul 13 15:39:21.844629 ip-10-0-134-237 kubenswrapper[2577]: E0713 15:39:21.844609 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c41b9cf1708856b5e56c901c23f1f6c3f86c426c900b434aabc15bfeb2c2b727\": container with ID starting with c41b9cf1708856b5e56c901c23f1f6c3f86c426c900b434aabc15bfeb2c2b727 not found: ID does not exist" containerID="c41b9cf1708856b5e56c901c23f1f6c3f86c426c900b434aabc15bfeb2c2b727" Jul 13 15:39:21.844693 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.844635 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c41b9cf1708856b5e56c901c23f1f6c3f86c426c900b434aabc15bfeb2c2b727"} err="failed to get container status \"c41b9cf1708856b5e56c901c23f1f6c3f86c426c900b434aabc15bfeb2c2b727\": rpc error: code = NotFound desc = could not find container \"c41b9cf1708856b5e56c901c23f1f6c3f86c426c900b434aabc15bfeb2c2b727\": container with ID starting with c41b9cf1708856b5e56c901c23f1f6c3f86c426c900b434aabc15bfeb2c2b727 not found: ID does not exist" Jul 13 15:39:21.844693 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.844653 2577 scope.go:117] "RemoveContainer" containerID="dad22e46bcd97a9cd7585d95e5b0676f3184518e4a9a8d3af661f47cb9d811a6" Jul 13 15:39:21.844902 ip-10-0-134-237 kubenswrapper[2577]: E0713 15:39:21.844888 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dad22e46bcd97a9cd7585d95e5b0676f3184518e4a9a8d3af661f47cb9d811a6\": container with ID starting with dad22e46bcd97a9cd7585d95e5b0676f3184518e4a9a8d3af661f47cb9d811a6 not found: ID does not exist" containerID="dad22e46bcd97a9cd7585d95e5b0676f3184518e4a9a8d3af661f47cb9d811a6" Jul 13 15:39:21.844964 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.844907 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dad22e46bcd97a9cd7585d95e5b0676f3184518e4a9a8d3af661f47cb9d811a6"} err="failed to get container status \"dad22e46bcd97a9cd7585d95e5b0676f3184518e4a9a8d3af661f47cb9d811a6\": rpc error: code = NotFound desc = could not find container \"dad22e46bcd97a9cd7585d95e5b0676f3184518e4a9a8d3af661f47cb9d811a6\": container with ID starting with dad22e46bcd97a9cd7585d95e5b0676f3184518e4a9a8d3af661f47cb9d811a6 not found: ID does not exist" Jul 13 15:39:21.851798 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.851763 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs"] Jul 13 15:39:21.859565 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:21.859546 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-88b181-openshift-default-5b9f47476c-qrqzs"] Jul 13 15:39:23.345823 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:23.345761 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d31aa8af-5673-4d82-b27b-c7671e78a437" path="/var/lib/kubelet/pods/d31aa8af-5673-4d82-b27b-c7671e78a437/volumes" Jul 13 15:39:30.484913 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:30.484881 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4kmfc"] Jul 13 15:39:49.506259 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:49.506229 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67985f7df8-lztzg_f74dfc69-9adf-4e16-87a2-70419fd392ec/copy-manifests/0.log" Jul 13 15:39:49.514581 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:49.514541 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67985f7df8-lztzg_f74dfc69-9adf-4e16-87a2-70419fd392ec/manager/0.log" Jul 13 15:39:52.721215 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:52.721171 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr_4f790422-5e97-4ad3-93b9-facea9f10f74/pull/0.log" Jul 13 15:39:52.727840 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:52.727797 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr_4f790422-5e97-4ad3-93b9-facea9f10f74/extract/0.log" Jul 13 15:39:52.734114 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:52.734087 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr_4f790422-5e97-4ad3-93b9-facea9f10f74/util/0.log" Jul 13 15:39:52.855556 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:52.855526 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz_be4308da-c131-41d2-a355-e2bd2ee87645/util/0.log" Jul 13 15:39:52.862748 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:52.862724 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz_be4308da-c131-41d2-a355-e2bd2ee87645/pull/0.log" Jul 13 15:39:52.869376 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:52.869354 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz_be4308da-c131-41d2-a355-e2bd2ee87645/extract/0.log" Jul 13 15:39:52.991556 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:52.991490 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf_7670c86e-475b-4a57-a382-4a25a9467fc0/util/0.log" Jul 13 15:39:52.998709 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:52.998688 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf_7670c86e-475b-4a57-a382-4a25a9467fc0/pull/0.log" Jul 13 15:39:53.005510 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:53.005491 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf_7670c86e-475b-4a57-a382-4a25a9467fc0/extract/0.log" Jul 13 15:39:53.125922 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:53.125896 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s_c3c73acb-0441-4ecc-9395-025f4dfc2c9a/extract/0.log" Jul 13 15:39:53.132501 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:53.132483 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s_c3c73acb-0441-4ecc-9395-025f4dfc2c9a/util/0.log" Jul 13 15:39:53.139159 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:53.139141 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s_c3c73acb-0441-4ecc-9395-025f4dfc2c9a/pull/0.log" Jul 13 15:39:54.093167 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:54.093141 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-4kmfc_6039f024-dbf0-4059-a45d-5a46553a142b/limitador/0.log" Jul 13 15:39:54.612027 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:54.611999 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4nhj27_657068e3-f65c-49dd-b86f-1ce127d85fd0/istio-proxy/0.log" Jul 13 15:39:54.733874 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:54.733843 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-65kfw_41529d43-505a-448f-acaa-a627230fb3d8/discovery/0.log" Jul 13 15:39:56.406040 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:56.406012 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-n9x5l_024b23fd-7e35-4bf2-8227-e5e7e7b307d1/main/0.log" Jul 13 15:39:56.530574 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:39:56.530540 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-wzkss_162e68da-d153-4e7b-8eb9-42ece15f4a07/main/0.log" Jul 13 15:40:03.405608 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:03.405578 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vrbdc_b4113ffd-a496-4d76-9f75-942100b26c23/global-pull-secret-syncer/0.log" Jul 13 15:40:03.499986 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:03.499963 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bnrgl_f105bdfa-cff6-4b9f-b5ac-7b386e2a9542/konnectivity-agent/0.log" Jul 13 15:40:03.588384 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:03.588360 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-237.ec2.internal_04d9ec37c251ad9524965495843a7e0c/haproxy/0.log" Jul 13 15:40:07.972181 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:07.972149 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr_4f790422-5e97-4ad3-93b9-facea9f10f74/extract/0.log" Jul 13 15:40:08.005663 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:08.005637 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr_4f790422-5e97-4ad3-93b9-facea9f10f74/util/0.log" Jul 13 15:40:08.033740 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:08.033719 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596pkcr_4f790422-5e97-4ad3-93b9-facea9f10f74/pull/0.log" Jul 13 15:40:08.068150 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:08.068110 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz_be4308da-c131-41d2-a355-e2bd2ee87645/extract/0.log" Jul 13 15:40:08.091976 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:08.091956 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz_be4308da-c131-41d2-a355-e2bd2ee87645/util/0.log" Jul 13 15:40:08.118008 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:08.117989 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cfmdz_be4308da-c131-41d2-a355-e2bd2ee87645/pull/0.log" Jul 13 15:40:08.147322 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:08.147295 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf_7670c86e-475b-4a57-a382-4a25a9467fc0/extract/0.log" Jul 13 15:40:08.175982 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:08.175964 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf_7670c86e-475b-4a57-a382-4a25a9467fc0/util/0.log" Jul 13 15:40:08.200751 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:08.200718 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732l2cf_7670c86e-475b-4a57-a382-4a25a9467fc0/pull/0.log" Jul 13 15:40:08.244246 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:08.244180 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s_c3c73acb-0441-4ecc-9395-025f4dfc2c9a/extract/0.log" Jul 13 15:40:08.271113 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:08.271089 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s_c3c73acb-0441-4ecc-9395-025f4dfc2c9a/util/0.log" Jul 13 15:40:08.297824 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:08.297804 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1swq7s_c3c73acb-0441-4ecc-9395-025f4dfc2c9a/pull/0.log" Jul 13 15:40:08.977597 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:08.977569 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-4kmfc_6039f024-dbf0-4059-a45d-5a46553a142b/limitador/0.log" Jul 13 15:40:10.589389 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:10.589365 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ec89a4f4-701c-4b8e-9ab4-113c6e8e0003/alertmanager/0.log" Jul 13 15:40:10.614830 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:10.614805 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ec89a4f4-701c-4b8e-9ab4-113c6e8e0003/config-reloader/0.log" Jul 13 15:40:10.638356 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:10.638332 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ec89a4f4-701c-4b8e-9ab4-113c6e8e0003/kube-rbac-proxy-web/0.log" Jul 13 15:40:10.664789 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:10.664750 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ec89a4f4-701c-4b8e-9ab4-113c6e8e0003/kube-rbac-proxy/0.log" Jul 13 15:40:10.697647 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:10.697621 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ec89a4f4-701c-4b8e-9ab4-113c6e8e0003/kube-rbac-proxy-metric/0.log" Jul 13 15:40:10.740435 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:10.740418 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ec89a4f4-701c-4b8e-9ab4-113c6e8e0003/prom-label-proxy/0.log" Jul 13 15:40:10.766653 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:10.766637 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ec89a4f4-701c-4b8e-9ab4-113c6e8e0003/init-config-reloader/0.log" Jul 13 15:40:10.939839 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:10.939819 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-78c6d67dcf-2pml8_e0df991d-b78f-4144-85c7-9f7f9a9edc55/metrics-server/0.log" Jul 13 15:40:11.171943 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:11.171919 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tqltd_d02cc62c-036b-4674-acc7-798bfe7d4127/node-exporter/0.log" Jul 13 15:40:11.199597 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:11.199537 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tqltd_d02cc62c-036b-4674-acc7-798bfe7d4127/kube-rbac-proxy/0.log" Jul 13 15:40:11.218905 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:11.218884 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tqltd_d02cc62c-036b-4674-acc7-798bfe7d4127/init-textfile/0.log" Jul 13 15:40:11.824055 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:11.823956 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f4bd6b4d-lncbr_9b6fe734-5aae-408a-a26e-2793e4a7763b/telemeter-client/0.log" Jul 13 15:40:11.875653 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:11.875632 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f4bd6b4d-lncbr_9b6fe734-5aae-408a-a26e-2793e4a7763b/reload/0.log" Jul 13 15:40:11.910629 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:11.910601 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f4bd6b4d-lncbr_9b6fe734-5aae-408a-a26e-2793e4a7763b/kube-rbac-proxy/0.log" Jul 13 15:40:14.023920 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:14.023887 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vdpg8/perf-node-gather-daemonset-rnvfh"] Jul 13 15:40:14.024285 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:14.024173 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d31aa8af-5673-4d82-b27b-c7671e78a437" containerName="istio-proxy" Jul 13 15:40:14.024285 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:14.024183 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d31aa8af-5673-4d82-b27b-c7671e78a437" containerName="istio-proxy" Jul 13 15:40:14.024285 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:14.024192 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d31aa8af-5673-4d82-b27b-c7671e78a437" containerName="istio-proxy" Jul 13 15:40:14.024285 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:14.024197 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d31aa8af-5673-4d82-b27b-c7671e78a437" containerName="istio-proxy" Jul 13 15:40:14.024285 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:14.024255 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d31aa8af-5673-4d82-b27b-c7671e78a437" containerName="istio-proxy" Jul 13 15:40:14.024285 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:14.024263 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d31aa8af-5673-4d82-b27b-c7671e78a437" containerName="istio-proxy" Jul 13 15:40:14.027421 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:14.027399 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vdpg8/perf-node-gather-daemonset-rnvfh" Jul 13 15:40:14.030262 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:14.030242 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vdpg8\"/\"openshift-service-ca.crt\"" Jul 13 15:40:14.030374 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:14.030243 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vdpg8\"/\"default-dockercfg-sdvkg\"" Jul 13 15:40:14.031123 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:14.031107 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vdpg8\"/\"kube-root-ca.crt\"" Jul 13 15:40:14.037462 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:14.037443 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vdpg8/perf-node-gather-daemonset-rnvfh"] Jul 13 15:40:14.105946 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:14.105924 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/616e6048-9543-4b68-a700-8dd7c74d6325-sys\") pod \"perf-node-gather-daemonset-rnvfh\" (UID: \"616e6048-9543-4b68-a700-8dd7c74d6325\") " pod="openshift-must-gather-vdpg8/perf-node-gather-daemonset-rnvfh" Jul 13 15:40:14.106044 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:14.105970 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/616e6048-9543-4b68-a700-8dd7c74d6325-podres\") pod \"perf-node-gather-daemonset-rnvfh\" (UID: \"616e6048-9543-4b68-a700-8dd7c74d6325\") " pod="openshift-must-gather-vdpg8/perf-node-gather-daemonset-rnvfh" Jul 13 15:40:14.106044 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:14.105992 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbg54\" (UniqueName: \"kubernetes.io/projected/616e6048-9543-4b68-a700-8dd7c74d6325-kube-api-access-gbg54\") pod \"perf-node-gather-daemonset-rnvfh\" (UID: \"616e6048-9543-4b68-a700-8dd7c74d6325\") " pod="openshift-must-gather-vdpg8/perf-node-gather-daemonset-rnvfh" Jul 13 15:40:14.106158 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:14.106039 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/616e6048-9543-4b68-a700-8dd7c74d6325-proc\") pod \"perf-node-gather-daemonset-rnvfh\" (UID: \"616e6048-9543-4b68-a700-8dd7c74d6325\") " pod="openshift-must-gather-vdpg8/perf-node-gather-daemonset-rnvfh" Jul 13 15:40:14.106158 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:14.106066 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/616e6048-9543-4b68-a700-8dd7c74d6325-lib-modules\") pod \"perf-node-gather-daemonset-rnvfh\" (UID: \"616e6048-9543-4b68-a700-8dd7c74d6325\") " pod="openshift-must-gather-vdpg8/perf-node-gather-daemonset-rnvfh" Jul 13 15:40:14.207018 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:14.206998 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/616e6048-9543-4b68-a700-8dd7c74d6325-podres\") pod \"perf-node-gather-daemonset-rnvfh\" (UID: \"616e6048-9543-4b68-a700-8dd7c74d6325\") " pod="openshift-must-gather-vdpg8/perf-node-gather-daemonset-rnvfh" Jul 13 15:40:14.207139 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:14.207031 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbg54\" (UniqueName: \"kubernetes.io/projected/616e6048-9543-4b68-a700-8dd7c74d6325-kube-api-access-gbg54\") pod \"perf-node-gather-daemonset-rnvfh\" (UID: \"616e6048-9543-4b68-a700-8dd7c74d6325\") " pod="openshift-must-gather-vdpg8/perf-node-gather-daemonset-rnvfh" Jul 13 15:40:14.207139 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:14.207050 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/616e6048-9543-4b68-a700-8dd7c74d6325-proc\") pod \"perf-node-gather-daemonset-rnvfh\" (UID: \"616e6048-9543-4b68-a700-8dd7c74d6325\") " pod="openshift-must-gather-vdpg8/perf-node-gather-daemonset-rnvfh" Jul 13 15:40:14.207139 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:14.207071 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/616e6048-9543-4b68-a700-8dd7c74d6325-lib-modules\") pod \"perf-node-gather-daemonset-rnvfh\" (UID: \"616e6048-9543-4b68-a700-8dd7c74d6325\") " pod="openshift-must-gather-vdpg8/perf-node-gather-daemonset-rnvfh" Jul 13 15:40:14.207285 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:14.207161 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/616e6048-9543-4b68-a700-8dd7c74d6325-proc\") pod \"perf-node-gather-daemonset-rnvfh\" (UID: \"616e6048-9543-4b68-a700-8dd7c74d6325\") " pod="openshift-must-gather-vdpg8/perf-node-gather-daemonset-rnvfh" Jul 13 15:40:14.207285 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:14.207174 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/616e6048-9543-4b68-a700-8dd7c74d6325-podres\") pod \"perf-node-gather-daemonset-rnvfh\" (UID: \"616e6048-9543-4b68-a700-8dd7c74d6325\") " pod="openshift-must-gather-vdpg8/perf-node-gather-daemonset-rnvfh" Jul 13 15:40:14.207285 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:14.207184 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/616e6048-9543-4b68-a700-8dd7c74d6325-lib-modules\") pod \"perf-node-gather-daemonset-rnvfh\" (UID: \"616e6048-9543-4b68-a700-8dd7c74d6325\") " pod="openshift-must-gather-vdpg8/perf-node-gather-daemonset-rnvfh" Jul 13 15:40:14.207285 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:14.207249 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/616e6048-9543-4b68-a700-8dd7c74d6325-sys\") pod \"perf-node-gather-daemonset-rnvfh\" (UID: \"616e6048-9543-4b68-a700-8dd7c74d6325\") " pod="openshift-must-gather-vdpg8/perf-node-gather-daemonset-rnvfh" Jul 13 15:40:14.207432 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:14.207300 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/616e6048-9543-4b68-a700-8dd7c74d6325-sys\") pod \"perf-node-gather-daemonset-rnvfh\" (UID: \"616e6048-9543-4b68-a700-8dd7c74d6325\") " pod="openshift-must-gather-vdpg8/perf-node-gather-daemonset-rnvfh" Jul 13 15:40:14.216496 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:14.216474 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbg54\" (UniqueName: \"kubernetes.io/projected/616e6048-9543-4b68-a700-8dd7c74d6325-kube-api-access-gbg54\") pod \"perf-node-gather-daemonset-rnvfh\" (UID: \"616e6048-9543-4b68-a700-8dd7c74d6325\") " pod="openshift-must-gather-vdpg8/perf-node-gather-daemonset-rnvfh" Jul 13 15:40:14.338282 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:14.338217 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vdpg8/perf-node-gather-daemonset-rnvfh" Jul 13 15:40:14.467184 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:14.467160 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vdpg8/perf-node-gather-daemonset-rnvfh"] Jul 13 15:40:14.468649 ip-10-0-134-237 kubenswrapper[2577]: W0713 15:40:14.468625 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod616e6048_9543_4b68_a700_8dd7c74d6325.slice/crio-b8dff3c0019f23566ec12e504cd2d37926c02eb2e55da9adfe6c890c68449a01 WatchSource:0}: Error finding container b8dff3c0019f23566ec12e504cd2d37926c02eb2e55da9adfe6c890c68449a01: Status 404 returned error can't find the container with id b8dff3c0019f23566ec12e504cd2d37926c02eb2e55da9adfe6c890c68449a01 Jul 13 15:40:15.094239 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:15.094206 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vdpg8/perf-node-gather-daemonset-rnvfh" event={"ID":"616e6048-9543-4b68-a700-8dd7c74d6325","Type":"ContainerStarted","Data":"418fa51fd926caee87cdecb5a6a574978b21288ba33a87e1f20574893b618c64"} Jul 13 15:40:15.094624 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:15.094262 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vdpg8/perf-node-gather-daemonset-rnvfh" event={"ID":"616e6048-9543-4b68-a700-8dd7c74d6325","Type":"ContainerStarted","Data":"b8dff3c0019f23566ec12e504cd2d37926c02eb2e55da9adfe6c890c68449a01"} Jul 13 15:40:15.094624 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:15.094288 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vdpg8/perf-node-gather-daemonset-rnvfh" Jul 13 15:40:15.113632 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:15.113582 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vdpg8/perf-node-gather-daemonset-rnvfh" podStartSLOduration=1.113566637 podStartE2EDuration="1.113566637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:40:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:40:15.11144565 +0000 UTC m=+2839.178018114" watchObservedRunningTime="2026-07-13 15:40:15.113566637 +0000 UTC m=+2839.180139112" Jul 13 15:40:16.264374 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:16.264347 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l9jkc_e6f7d3e1-80fb-4fb2-af95-146709ef0532/dns/0.log" Jul 13 15:40:16.287628 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:16.287606 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l9jkc_e6f7d3e1-80fb-4fb2-af95-146709ef0532/kube-rbac-proxy/0.log" Jul 13 15:40:16.312266 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:16.312245 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cw5zb_47635ebe-4411-4f30-bd50-d642f911219b/dns-node-resolver/0.log" Jul 13 15:40:16.912978 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:16.912953 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-74869c78fb-4snkc_e834a3dd-45d7-4375-bcb2-aec8703c05c2/registry/0.log" Jul 13 15:40:16.936845 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:16.936824 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6cfq7_127d8c73-93c5-4fd9-8ab5-9276bcee81be/node-ca/0.log" Jul 13 15:40:18.061006 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:18.060977 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4nhj27_657068e3-f65c-49dd-b86f-1ce127d85fd0/istio-proxy/0.log" Jul 13 15:40:18.184673 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:18.184645 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-65kfw_41529d43-505a-448f-acaa-a627230fb3d8/discovery/0.log" Jul 13 15:40:19.205137 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:19.205108 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gx4xs_c2127b3c-d4ef-48e7-887a-12892501daaf/serve-healthcheck-canary/0.log" Jul 13 15:40:19.907354 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:19.907322 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pxbb4_1e90d2eb-57e0-4e48-8167-aa16764b612a/kube-rbac-proxy/0.log" Jul 13 15:40:19.928795 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:19.928756 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pxbb4_1e90d2eb-57e0-4e48-8167-aa16764b612a/exporter/0.log" Jul 13 15:40:19.951089 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:19.951069 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pxbb4_1e90d2eb-57e0-4e48-8167-aa16764b612a/extractor/0.log" Jul 13 15:40:21.108353 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:21.108326 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vdpg8/perf-node-gather-daemonset-rnvfh" Jul 13 15:40:22.684657 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:22.684635 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67985f7df8-lztzg_f74dfc69-9adf-4e16-87a2-70419fd392ec/manager/0.log" Jul 13 15:40:22.706633 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:22.706611 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67985f7df8-lztzg_f74dfc69-9adf-4e16-87a2-70419fd392ec/copy-manifests/0.log" Jul 13 15:40:23.832547 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:23.832524 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4nhj27_657068e3-f65c-49dd-b86f-1ce127d85fd0/istio-proxy/0.log" Jul 13 15:40:23.939248 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:23.939182 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-65kfw_41529d43-505a-448f-acaa-a627230fb3d8/discovery/0.log" Jul 13 15:40:24.281025 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:24.280962 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-677c5d8dc-qmwgd_85835492-7bc1-46c5-bf21-e6af4ce80f85/manager/0.log" Jul 13 15:40:25.376526 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:25.376500 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4nhj27_657068e3-f65c-49dd-b86f-1ce127d85fd0/istio-proxy/0.log" Jul 13 15:40:25.478697 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:25.478621 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-65kfw_41529d43-505a-448f-acaa-a627230fb3d8/discovery/0.log" Jul 13 15:40:30.852258 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:30.852220 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4tv96_21e47eec-3d15-47fd-9cf8-dcaf27954260/kube-multus/0.log" Jul 13 15:40:30.884696 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:30.884670 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m6xbq_c96d9a00-a5ee-468a-ab1e-57fc28bda457/kube-multus-additional-cni-plugins/0.log" Jul 13 15:40:30.912688 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:30.912659 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m6xbq_c96d9a00-a5ee-468a-ab1e-57fc28bda457/egress-router-binary-copy/0.log" Jul 13 15:40:30.942473 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:30.942452 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m6xbq_c96d9a00-a5ee-468a-ab1e-57fc28bda457/cni-plugins/0.log" Jul 13 15:40:30.973675 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:30.973658 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m6xbq_c96d9a00-a5ee-468a-ab1e-57fc28bda457/bond-cni-plugin/0.log" Jul 13 15:40:30.996669 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:30.996655 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m6xbq_c96d9a00-a5ee-468a-ab1e-57fc28bda457/routeoverride-cni/0.log" Jul 13 15:40:31.020646 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:31.020630 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m6xbq_c96d9a00-a5ee-468a-ab1e-57fc28bda457/whereabouts-cni-bincopy/0.log" Jul 13 15:40:31.044706 ip-10-0-134-237 kubenswrapper[2577]: I0713 15:40:31.044687 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m6xbq_c96d9a00-a5ee-468a-ab1e-57fc28bda457/whereabouts-cni/0.log"