Jul 17 21:01:46.186462 ip-10-0-132-253 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 17 21:01:46.186652 ip-10-0-132-253 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 17 21:01:46.186747 ip-10-0-132-253 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 17 21:01:46.187436 ip-10-0-132-253 systemd[1]: Failed to start Kubernetes Kubelet. Jul 17 21:01:56.278885 ip-10-0-132-253 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 17 21:01:56.278904 ip-10-0-132-253 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 4461bdabe5ed4742ac85b52e6ce7570b -- Jul 17 21:03:47.300434 ip-10-0-132-253 systemd[1]: Starting Kubernetes Kubelet... Jul 17 21:03:47.730465 ip-10-0-132-253 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 21:03:47.730465 ip-10-0-132-253 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 17 21:03:47.730465 ip-10-0-132-253 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 21:03:47.730465 ip-10-0-132-253 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 17 21:03:47.730465 ip-10-0-132-253 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 21:03:47.730465 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.639211 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 17 21:03:47.730465 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644343 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 21:03:47.730465 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644353 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 21:03:47.730465 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644358 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 21:03:47.730465 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644361 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 21:03:47.730465 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644364 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 21:03:47.730465 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644366 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 21:03:47.730465 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644369 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 21:03:47.730465 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644372 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 21:03:47.706914 ip-10-0-132-253 systemd[1]: Started Kubernetes Kubelet. Jul 17 21:03:47.733025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644375 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 21:03:47.733025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644380 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 21:03:47.733025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644383 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 21:03:47.733025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644386 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 21:03:47.733025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644388 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 21:03:47.733025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644391 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 21:03:47.733025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644393 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 21:03:47.733025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644396 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 21:03:47.733025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644398 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 21:03:47.733025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644401 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 21:03:47.733025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644403 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 21:03:47.733025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644406 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 21:03:47.733025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644408 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 21:03:47.733025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644412 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 21:03:47.733025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644416 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 21:03:47.733025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644419 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 21:03:47.733025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644422 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 21:03:47.733025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644425 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 21:03:47.733025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644428 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 21:03:47.735601 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644431 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 21:03:47.735601 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644433 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 21:03:47.735601 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644436 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 21:03:47.735601 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644438 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 21:03:47.735601 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644441 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 21:03:47.735601 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644443 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 21:03:47.735601 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644446 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 21:03:47.735601 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644448 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 21:03:47.735601 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644450 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 21:03:47.735601 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644453 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 21:03:47.735601 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644455 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 21:03:47.735601 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644458 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 21:03:47.735601 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644461 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 21:03:47.735601 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644465 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 21:03:47.735601 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644468 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 21:03:47.735601 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644471 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 21:03:47.735601 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644473 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 21:03:47.735601 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644476 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 21:03:47.735601 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644478 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 21:03:47.750869 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644482 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 21:03:47.750869 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644484 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 21:03:47.750869 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644486 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 21:03:47.750869 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644489 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 21:03:47.750869 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644492 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 21:03:47.750869 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644494 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 21:03:47.750869 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644498 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 21:03:47.750869 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644500 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 21:03:47.750869 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644503 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 21:03:47.750869 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644506 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 21:03:47.750869 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644508 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 21:03:47.750869 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644511 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 21:03:47.750869 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644513 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 21:03:47.750869 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644516 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 21:03:47.750869 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644518 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 21:03:47.750869 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644520 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 21:03:47.750869 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644523 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 17 21:03:47.750869 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644525 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 21:03:47.750869 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644527 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 21:03:47.750869 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644530 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 21:03:47.766415 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644532 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 21:03:47.766415 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644535 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 21:03:47.766415 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644537 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 21:03:47.766415 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644540 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 21:03:47.766415 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644542 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 21:03:47.766415 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644545 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 21:03:47.766415 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644547 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 21:03:47.766415 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644550 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 21:03:47.766415 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644553 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 21:03:47.766415 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644556 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 21:03:47.766415 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644558 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 21:03:47.766415 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644561 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 21:03:47.766415 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644564 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 21:03:47.766415 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644567 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 21:03:47.766415 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644570 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 21:03:47.766415 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644572 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 21:03:47.766415 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644575 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 21:03:47.766415 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644577 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 21:03:47.766415 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644580 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 21:03:47.766415 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644583 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 21:03:47.782770 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644585 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 21:03:47.782770 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644587 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 21:03:47.782770 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644590 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 21:03:47.782770 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644592 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 21:03:47.782770 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644596 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 21:03:47.782770 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644599 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 21:03:47.782770 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644602 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 21:03:47.782770 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644604 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 21:03:47.782770 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644606 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 21:03:47.782770 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644609 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 21:03:47.782770 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644613 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 21:03:47.782770 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644615 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 21:03:47.782770 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.644618 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 21:03:47.782770 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645279 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 21:03:47.782770 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645285 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 21:03:47.782770 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645288 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 21:03:47.782770 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645291 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 21:03:47.782770 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645294 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 21:03:47.782770 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645296 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 21:03:47.782770 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645298 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 21:03:47.790983 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645302 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 21:03:47.790983 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645304 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 21:03:47.790983 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645307 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 21:03:47.790983 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645310 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 21:03:47.790983 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645313 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 21:03:47.790983 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645315 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 21:03:47.790983 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645318 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 21:03:47.790983 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645322 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 21:03:47.790983 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645325 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 21:03:47.790983 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645328 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 21:03:47.790983 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645331 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 21:03:47.790983 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645334 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 21:03:47.790983 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645336 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 21:03:47.790983 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645338 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 21:03:47.790983 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645341 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 21:03:47.790983 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645343 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 21:03:47.790983 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645346 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 21:03:47.790983 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645348 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 17 21:03:47.790983 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645352 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 21:03:47.937821 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645355 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 21:03:47.937821 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645358 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 21:03:47.937821 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645361 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 21:03:47.937821 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645364 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 21:03:47.937821 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645366 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 21:03:47.937821 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645369 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 21:03:47.937821 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645372 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 21:03:47.937821 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645374 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 21:03:47.937821 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645376 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 21:03:47.937821 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645379 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 21:03:47.937821 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645382 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 21:03:47.937821 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645385 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 21:03:47.937821 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645388 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 21:03:47.937821 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645391 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 21:03:47.937821 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645394 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 21:03:47.937821 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645396 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 21:03:47.937821 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645399 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 21:03:47.937821 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645401 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 21:03:47.937821 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645404 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 21:03:47.937821 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645406 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 21:03:47.959665 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645408 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 21:03:47.959665 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645411 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 21:03:47.959665 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645413 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 21:03:47.959665 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645416 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 21:03:47.959665 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645419 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 21:03:47.959665 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645421 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 21:03:47.959665 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645423 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 21:03:47.959665 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645426 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 21:03:47.959665 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645428 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 21:03:47.959665 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645431 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 21:03:47.959665 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645433 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 21:03:47.959665 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645435 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 21:03:47.959665 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645439 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 21:03:47.959665 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645442 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 21:03:47.959665 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645445 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 21:03:47.959665 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645447 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 21:03:47.959665 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645450 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 21:03:47.959665 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645452 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 21:03:47.959665 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645455 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 21:03:47.959665 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645457 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 21:03:47.960893 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645459 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 21:03:47.960893 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645462 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 21:03:47.960893 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645466 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 21:03:47.960893 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645469 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 21:03:47.960893 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645472 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 21:03:47.960893 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645475 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 21:03:47.960893 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645477 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 21:03:47.960893 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645480 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 21:03:47.960893 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645483 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 21:03:47.960893 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645486 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 21:03:47.960893 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645488 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 21:03:47.960893 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645491 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 21:03:47.960893 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645493 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 21:03:47.960893 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645496 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 21:03:47.960893 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645498 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 21:03:47.960893 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645503 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 21:03:47.960893 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645506 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 21:03:47.960893 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645510 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 21:03:47.960893 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645512 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 21:03:47.962424 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645515 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 21:03:47.962424 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645517 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 21:03:47.962424 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645520 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 21:03:47.962424 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645522 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 21:03:47.962424 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645525 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 21:03:47.962424 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645527 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 21:03:47.962424 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645530 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 21:03:47.962424 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645533 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 21:03:47.962424 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645535 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 21:03:47.962424 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645537 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 21:03:47.962424 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645540 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 21:03:47.962424 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645543 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 21:03:47.962424 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645545 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 21:03:47.962424 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645548 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 21:03:47.962424 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645857 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 21:03:47.962424 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645864 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 21:03:47.962424 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645867 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 21:03:47.962424 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645870 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 21:03:47.962424 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645872 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 21:03:47.965329 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645875 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 21:03:47.965329 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645878 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 21:03:47.965329 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645880 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 21:03:47.965329 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645883 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 21:03:47.965329 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645885 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 21:03:47.965329 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645889 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 21:03:47.965329 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645892 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 21:03:47.965329 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645895 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 21:03:47.965329 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645898 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 21:03:47.965329 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645900 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 21:03:47.965329 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645903 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 21:03:47.965329 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645906 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 21:03:47.965329 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645909 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 21:03:47.965329 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645911 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 21:03:47.965329 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645913 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 21:03:47.965329 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645916 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 21:03:47.965329 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645918 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 21:03:47.965329 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645921 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 21:03:47.965329 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645924 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 21:03:47.966906 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645926 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 21:03:47.966906 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645928 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 21:03:47.966906 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645931 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 21:03:47.966906 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645933 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 21:03:47.966906 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645936 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 21:03:47.966906 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645938 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 21:03:47.966906 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645941 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 21:03:47.966906 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645943 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 21:03:47.966906 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645946 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 21:03:47.966906 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645950 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 21:03:47.966906 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645952 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 21:03:47.966906 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645955 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 21:03:47.966906 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645957 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 21:03:47.966906 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645960 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 21:03:47.966906 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645963 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 21:03:47.966906 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645966 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 21:03:47.966906 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645968 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 21:03:47.966906 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645971 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 21:03:47.966906 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645973 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 21:03:47.966906 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645976 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 21:03:47.967578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645978 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 21:03:47.967578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645980 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 21:03:47.967578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645983 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 21:03:47.967578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645986 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 21:03:47.967578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645988 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 21:03:47.967578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645990 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 21:03:47.967578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645993 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 21:03:47.967578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645995 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 21:03:47.967578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.645999 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 21:03:47.967578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646002 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 21:03:47.967578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646004 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 21:03:47.967578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646007 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 21:03:47.967578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646009 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 21:03:47.967578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646012 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 21:03:47.967578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646014 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 21:03:47.967578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646016 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 21:03:47.967578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646019 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 21:03:47.967578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646021 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 21:03:47.967578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646023 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 21:03:47.968224 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646026 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 21:03:47.968224 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646028 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 21:03:47.968224 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646032 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 21:03:47.968224 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646035 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 21:03:47.968224 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646037 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 17 21:03:47.968224 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646040 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 21:03:47.968224 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646042 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 21:03:47.968224 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646044 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 21:03:47.968224 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646047 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 21:03:47.968224 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646050 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 21:03:47.968224 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646052 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 21:03:47.968224 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646055 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 21:03:47.968224 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646058 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 21:03:47.968224 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646060 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 21:03:47.968224 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646063 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 21:03:47.968224 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646065 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 21:03:47.968224 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646067 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 21:03:47.968224 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646070 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 21:03:47.968224 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646072 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 21:03:47.968224 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646075 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 21:03:47.968794 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646078 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 21:03:47.968794 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646080 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 21:03:47.968794 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646082 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 21:03:47.968794 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646085 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 21:03:47.968794 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646087 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 21:03:47.968794 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646090 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 21:03:47.968794 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646092 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 21:03:47.968794 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646094 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 21:03:47.968794 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646097 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 21:03:47.968794 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646099 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 21:03:47.968794 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646101 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 21:03:47.968794 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646104 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 21:03:47.968794 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646106 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 21:03:47.968794 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646109 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 21:03:47.968794 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646112 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 21:03:47.968794 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.646115 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 21:03:47.968794 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646197 2580 flags.go:64] FLAG: --address="0.0.0.0" Jul 17 21:03:47.968794 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646207 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 17 21:03:47.968794 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646216 2580 flags.go:64] FLAG: --anonymous-auth="true" Jul 17 21:03:47.968794 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646222 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 17 21:03:47.968794 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646226 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 17 21:03:47.969368 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646230 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 17 21:03:47.969368 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646234 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 17 21:03:47.969368 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646238 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 17 21:03:47.969368 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646241 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 17 21:03:47.969368 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646244 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 17 21:03:47.969368 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646247 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 17 21:03:47.969368 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646250 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 17 21:03:47.969368 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646253 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 17 21:03:47.969368 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646256 2580 flags.go:64] FLAG: --cgroup-root="" Jul 17 21:03:47.969368 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646258 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 17 21:03:47.969368 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646261 2580 flags.go:64] FLAG: --client-ca-file="" Jul 17 21:03:47.969368 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646264 2580 flags.go:64] FLAG: --cloud-provider="external" Jul 17 21:03:47.969368 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646267 2580 flags.go:64] FLAG: --cluster-dns="[]" Jul 17 21:03:47.969368 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646270 2580 flags.go:64] FLAG: --cluster-domain="" Jul 17 21:03:47.969368 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646273 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 17 21:03:47.969368 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646276 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 17 21:03:47.969368 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646279 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 17 21:03:47.969368 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646286 2580 flags.go:64] FLAG: --container-log-max-files="5" Jul 17 21:03:47.969368 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646289 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 17 21:03:47.969368 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646292 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 17 21:03:47.969368 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646295 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 17 21:03:47.969368 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646298 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 17 21:03:47.969368 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646301 2580 flags.go:64] FLAG: --contention-profiling="false" Jul 17 21:03:47.969368 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646304 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 17 21:03:47.970016 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646307 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 17 21:03:47.970016 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646311 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 17 21:03:47.970016 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646314 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 17 21:03:47.970016 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646317 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 17 21:03:47.970016 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646320 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 17 21:03:47.970016 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646323 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 17 21:03:47.970016 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646325 2580 flags.go:64] FLAG: --enable-load-reader="false" Jul 17 21:03:47.970016 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646328 2580 flags.go:64] FLAG: --enable-server="true" Jul 17 21:03:47.970016 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646331 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 17 21:03:47.970016 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646338 2580 flags.go:64] FLAG: --event-burst="100" Jul 17 21:03:47.970016 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646342 2580 flags.go:64] FLAG: --event-qps="50" Jul 17 21:03:47.970016 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646345 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 17 21:03:47.970016 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646348 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 17 21:03:47.970016 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646351 2580 flags.go:64] FLAG: --eviction-hard="" Jul 17 21:03:47.970016 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646354 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 17 21:03:47.970016 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646357 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 17 21:03:47.970016 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646360 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 17 21:03:47.970016 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646362 2580 flags.go:64] FLAG: --eviction-soft="" Jul 17 21:03:47.970016 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646365 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 17 21:03:47.970016 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646367 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 17 21:03:47.970016 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646370 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 17 21:03:47.970016 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646373 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jul 17 21:03:47.970016 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646375 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 17 21:03:47.970016 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646378 2580 flags.go:64] FLAG: --fail-swap-on="true" Jul 17 21:03:47.970016 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646381 2580 flags.go:64] FLAG: --feature-gates="" Jul 17 21:03:47.970686 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646385 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jul 17 21:03:47.970686 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646388 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 17 21:03:47.970686 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646391 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 17 21:03:47.970686 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646394 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 17 21:03:47.970686 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646397 2580 flags.go:64] FLAG: --healthz-port="10248" Jul 17 21:03:47.970686 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646399 2580 flags.go:64] FLAG: --help="false" Jul 17 21:03:47.970686 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646402 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-132-253.ec2.internal" Jul 17 21:03:47.970686 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646405 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 17 21:03:47.970686 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646409 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jul 17 21:03:47.970686 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646412 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 17 21:03:47.970686 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646415 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 17 21:03:47.970686 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646418 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 17 21:03:47.970686 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646421 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 17 21:03:47.970686 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646423 2580 flags.go:64] FLAG: --image-service-endpoint="" Jul 17 21:03:47.970686 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646426 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 17 21:03:47.970686 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646429 2580 flags.go:64] FLAG: --kube-api-burst="100" Jul 17 21:03:47.970686 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646432 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 17 21:03:47.970686 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646434 2580 flags.go:64] FLAG: --kube-api-qps="50" Jul 17 21:03:47.970686 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646438 2580 flags.go:64] FLAG: --kube-reserved="" Jul 17 21:03:47.970686 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646440 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 17 21:03:47.970686 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646443 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 17 21:03:47.970686 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646446 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jul 17 21:03:47.970686 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646448 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 17 21:03:47.970686 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646451 2580 flags.go:64] FLAG: --lock-file="" Jul 17 21:03:47.971389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646454 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 17 21:03:47.971389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646456 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 17 21:03:47.971389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646459 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 17 21:03:47.971389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646464 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jul 17 21:03:47.971389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646467 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 17 21:03:47.971389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646469 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jul 17 21:03:47.971389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646472 2580 flags.go:64] FLAG: --logging-format="text" Jul 17 21:03:47.971389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646474 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 17 21:03:47.971389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646479 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 17 21:03:47.971389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646482 2580 flags.go:64] FLAG: --manifest-url="" Jul 17 21:03:47.971389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646484 2580 flags.go:64] FLAG: --manifest-url-header="" Jul 17 21:03:47.971389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646488 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 17 21:03:47.971389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646491 2580 flags.go:64] FLAG: --max-open-files="1000000" Jul 17 21:03:47.971389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646494 2580 flags.go:64] FLAG: --max-pods="110" Jul 17 21:03:47.971389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646497 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 17 21:03:47.971389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646500 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 17 21:03:47.971389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646504 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jul 17 21:03:47.971389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646506 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 17 21:03:47.971389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646509 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 17 21:03:47.971389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646512 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 17 21:03:47.971389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646515 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 17 21:03:47.971389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646521 2580 flags.go:64] FLAG: --node-status-max-images="50" Jul 17 21:03:47.971389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646524 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 17 21:03:47.971389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646527 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jul 17 21:03:47.971389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646530 2580 flags.go:64] FLAG: --pod-cidr="" Jul 17 21:03:47.972314 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646532 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 17 21:03:47.972314 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646537 2580 flags.go:64] FLAG: --pod-manifest-path="" Jul 17 21:03:47.972314 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646541 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jul 17 21:03:47.972314 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646543 2580 flags.go:64] FLAG: --pods-per-core="0" Jul 17 21:03:47.972314 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646546 2580 flags.go:64] FLAG: --port="10250" Jul 17 21:03:47.972314 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646549 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 17 21:03:47.972314 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646551 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-035860459b95f3e87" Jul 17 21:03:47.972314 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646554 2580 flags.go:64] FLAG: --qos-reserved="" Jul 17 21:03:47.972314 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646557 2580 flags.go:64] FLAG: --read-only-port="10255" Jul 17 21:03:47.972314 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646560 2580 flags.go:64] FLAG: --register-node="true" Jul 17 21:03:47.972314 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646562 2580 flags.go:64] FLAG: --register-with-taints="" Jul 17 21:03:47.972314 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646570 2580 flags.go:64] FLAG: --registry-burst="10" Jul 17 21:03:47.972314 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646573 2580 flags.go:64] FLAG: --registry-qps="5" Jul 17 21:03:47.972314 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646576 2580 flags.go:64] FLAG: --reserved-cpus="" Jul 17 21:03:47.972314 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646578 2580 flags.go:64] FLAG: --reserved-memory="" Jul 17 21:03:47.972314 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646582 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 17 21:03:47.972314 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646586 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 17 21:03:47.972314 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646589 2580 flags.go:64] FLAG: --rotate-certificates="false" Jul 17 21:03:47.972314 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646591 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 17 21:03:47.972314 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646594 2580 flags.go:64] FLAG: --runonce="false" Jul 17 21:03:47.972314 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646597 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 17 21:03:47.972314 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646600 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 17 21:03:47.972314 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646602 2580 flags.go:64] FLAG: --seccomp-default="false" Jul 17 21:03:47.972314 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646607 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 17 21:03:47.972314 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646610 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 17 21:03:47.972979 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646612 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 17 21:03:47.972979 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646615 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 17 21:03:47.972979 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646618 2580 flags.go:64] FLAG: --storage-driver-password="root" Jul 17 21:03:47.972979 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646621 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jul 17 21:03:47.972979 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646623 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jul 17 21:03:47.972979 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646626 2580 flags.go:64] FLAG: --storage-driver-user="root" Jul 17 21:03:47.972979 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646629 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 17 21:03:47.972979 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646632 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 17 21:03:47.972979 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646634 2580 flags.go:64] FLAG: --system-cgroups="" Jul 17 21:03:47.972979 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646637 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 17 21:03:47.972979 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646642 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 17 21:03:47.972979 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646645 2580 flags.go:64] FLAG: --tls-cert-file="" Jul 17 21:03:47.972979 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646647 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 17 21:03:47.972979 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646651 2580 flags.go:64] FLAG: --tls-min-version="" Jul 17 21:03:47.972979 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646653 2580 flags.go:64] FLAG: --tls-private-key-file="" Jul 17 21:03:47.972979 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646656 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jul 17 21:03:47.972979 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646659 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 17 21:03:47.972979 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646661 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jul 17 21:03:47.972979 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646664 2580 flags.go:64] FLAG: --v="2" Jul 17 21:03:47.972979 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646667 2580 flags.go:64] FLAG: --version="false" Jul 17 21:03:47.972979 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646671 2580 flags.go:64] FLAG: --vmodule="" Jul 17 21:03:47.972979 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646674 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 17 21:03:47.972979 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.646677 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 17 21:03:47.972979 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647385 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 21:03:47.972979 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647390 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 21:03:48.073615 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647394 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 21:03:48.073615 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647408 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 21:03:48.073615 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647413 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 21:03:48.073615 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647416 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 21:03:48.073615 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647420 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 21:03:48.073615 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647424 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 21:03:48.073615 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647427 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 21:03:48.073615 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647429 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 21:03:48.073615 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647432 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 21:03:48.073615 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647435 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 21:03:48.073615 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647438 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 21:03:48.073615 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647440 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 21:03:48.073615 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647443 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 21:03:48.073615 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647445 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 21:03:48.073615 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647447 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 21:03:48.073615 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647450 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 21:03:48.073615 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647452 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 21:03:48.073615 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647455 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 21:03:48.073615 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647458 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 21:03:48.074435 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647460 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 21:03:48.074435 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647463 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 21:03:48.074435 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647465 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 17 21:03:48.074435 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647468 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 21:03:48.074435 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647470 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 21:03:48.074435 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647473 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 21:03:48.074435 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647475 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 21:03:48.074435 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647478 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 21:03:48.074435 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647480 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 21:03:48.074435 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647483 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 21:03:48.074435 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647485 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 21:03:48.074435 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647489 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 21:03:48.074435 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647491 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 21:03:48.074435 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647494 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 21:03:48.074435 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647496 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 21:03:48.074435 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647498 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 21:03:48.074435 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647501 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 21:03:48.074435 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647503 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 21:03:48.074435 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647508 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 21:03:48.074435 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647510 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 21:03:48.075025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647512 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 21:03:48.075025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647515 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 21:03:48.075025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647518 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 21:03:48.075025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647520 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 21:03:48.075025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647523 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 21:03:48.075025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647525 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 21:03:48.075025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647528 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 21:03:48.075025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647530 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 21:03:48.075025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647533 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 21:03:48.075025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647535 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 21:03:48.075025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647538 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 21:03:48.075025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647540 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 21:03:48.075025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647543 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 21:03:48.075025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647545 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 21:03:48.075025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647548 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 21:03:48.075025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647550 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 21:03:48.075025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647553 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 21:03:48.075025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647555 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 21:03:48.075025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647557 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 21:03:48.075025 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647560 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 21:03:48.075636 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647564 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 21:03:48.075636 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647567 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 21:03:48.075636 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647570 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 21:03:48.075636 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647574 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 21:03:48.075636 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647577 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 21:03:48.075636 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647579 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 21:03:48.075636 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647582 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 21:03:48.075636 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647585 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 21:03:48.075636 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647588 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 21:03:48.075636 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647591 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 21:03:48.075636 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647595 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 21:03:48.075636 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647597 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 21:03:48.075636 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647599 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 21:03:48.075636 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647602 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 21:03:48.075636 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647604 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 21:03:48.075636 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647607 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 21:03:48.075636 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647610 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 21:03:48.075636 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647614 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 21:03:48.075636 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647616 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 21:03:48.076135 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647619 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 21:03:48.076135 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647622 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 21:03:48.076135 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647624 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 21:03:48.076135 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647626 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 21:03:48.076135 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647629 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 21:03:48.076135 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647631 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 21:03:48.076135 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647634 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 21:03:48.076135 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647636 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 21:03:48.076135 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647639 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 21:03:48.076135 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647641 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 21:03:48.076135 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647644 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 21:03:48.076135 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647646 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 21:03:48.076135 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647649 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 21:03:48.076135 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647651 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 21:03:48.076135 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647653 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 21:03:48.076135 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647656 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 21:03:48.076135 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647660 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 21:03:48.076135 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647662 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 21:03:48.076135 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.647665 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 21:03:48.076689 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.648143 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 21:03:48.076689 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.655115 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 17 21:03:48.076689 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.655128 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 17 21:03:48.076689 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.655750 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 17 21:03:48.076689 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.655757 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 17 21:03:48.076689 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655824 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 21:03:48.076689 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655829 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 21:03:48.076689 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655834 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 21:03:48.076689 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655838 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 21:03:48.076689 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655841 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 21:03:48.076689 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655844 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 21:03:48.076689 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655847 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 21:03:48.076689 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655851 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 21:03:48.076689 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655855 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 21:03:48.077069 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655858 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 21:03:48.077069 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655861 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 17 21:03:48.077069 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655864 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 21:03:48.077069 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655867 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 21:03:48.077069 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655870 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 21:03:48.077069 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655872 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 21:03:48.077069 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655875 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 21:03:48.077069 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655877 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 21:03:48.077069 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655880 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 21:03:48.077069 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655883 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 21:03:48.077069 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655885 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 21:03:48.077069 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655888 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 21:03:48.077069 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655891 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 21:03:48.077069 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655893 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 21:03:48.077069 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655896 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 21:03:48.077069 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655899 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 21:03:48.077069 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655901 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 21:03:48.077069 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655904 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 21:03:48.077069 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655908 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 21:03:48.077069 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655911 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 21:03:48.079738 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655913 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 21:03:48.079738 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655916 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 21:03:48.079738 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655918 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 21:03:48.079738 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655921 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 21:03:48.079738 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655923 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 21:03:48.079738 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655926 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 21:03:48.079738 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655929 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 21:03:48.079738 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655931 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 21:03:48.079738 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655934 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 21:03:48.079738 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655936 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 21:03:48.079738 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655938 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 21:03:48.079738 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655941 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 21:03:48.079738 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655943 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 21:03:48.079738 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655946 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 21:03:48.079738 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655948 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 21:03:48.079738 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655950 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 21:03:48.079738 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655953 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 21:03:48.079738 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655955 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 21:03:48.079738 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655959 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 21:03:48.079738 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655962 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 21:03:48.080348 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655964 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 21:03:48.080348 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655967 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 21:03:48.080348 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655972 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 21:03:48.080348 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655974 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 21:03:48.080348 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655976 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 21:03:48.080348 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655979 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 21:03:48.080348 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655981 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 21:03:48.080348 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655984 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 21:03:48.080348 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655986 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 21:03:48.080348 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655989 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 21:03:48.080348 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655991 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 21:03:48.080348 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655994 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 21:03:48.080348 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.655997 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 21:03:48.080348 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656000 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 21:03:48.080348 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656002 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 21:03:48.080348 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656005 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 21:03:48.080348 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656007 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 21:03:48.080348 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656010 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 21:03:48.080348 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656012 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 21:03:48.080953 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656015 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 21:03:48.080953 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656019 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 21:03:48.080953 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656022 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 21:03:48.080953 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656025 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 21:03:48.080953 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656028 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 21:03:48.080953 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656031 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 21:03:48.080953 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656033 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 21:03:48.080953 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656036 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 21:03:48.080953 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656038 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 21:03:48.080953 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656040 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 21:03:48.080953 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656043 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 21:03:48.080953 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656046 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 21:03:48.080953 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656049 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 21:03:48.080953 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656051 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 21:03:48.080953 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656054 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 21:03:48.080953 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656058 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 21:03:48.080953 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656060 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 21:03:48.080953 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656063 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 21:03:48.080953 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656065 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 21:03:48.081578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656068 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 21:03:48.081578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656070 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 21:03:48.081578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656072 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 21:03:48.081578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656075 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 21:03:48.081578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656077 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 21:03:48.081578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656081 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 21:03:48.081578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656084 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 21:03:48.081578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656086 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 21:03:48.081578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656089 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 21:03:48.081578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656091 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 21:03:48.081578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656094 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 21:03:48.081578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656097 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 21:03:48.081578 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.656102 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 21:03:48.081578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656222 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 21:03:48.081578 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656228 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 21:03:48.082227 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656231 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 21:03:48.082227 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656234 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 21:03:48.082227 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656236 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 21:03:48.082227 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656239 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 21:03:48.082227 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656242 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 21:03:48.082227 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656244 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 21:03:48.082227 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656247 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 21:03:48.082227 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656250 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 21:03:48.082227 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656253 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 21:03:48.082227 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656255 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 21:03:48.082227 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656258 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 21:03:48.082227 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656261 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 21:03:48.082227 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656264 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 21:03:48.082227 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656268 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 21:03:48.082227 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656270 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 21:03:48.082227 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656273 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 21:03:48.082227 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656275 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 21:03:48.082227 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656278 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 21:03:48.082227 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656280 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 21:03:48.082227 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656283 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 21:03:48.082828 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656285 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 21:03:48.082828 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656288 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 21:03:48.082828 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656291 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 21:03:48.082828 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656294 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 21:03:48.082828 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656297 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 21:03:48.082828 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656299 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 21:03:48.082828 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656302 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 21:03:48.082828 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656305 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 21:03:48.082828 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656307 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 21:03:48.082828 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656309 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 21:03:48.082828 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656312 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 21:03:48.082828 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656314 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 21:03:48.082828 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656317 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 21:03:48.082828 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656320 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 21:03:48.082828 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656323 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 21:03:48.082828 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656325 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 21:03:48.082828 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656328 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 21:03:48.082828 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656330 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 21:03:48.082828 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656333 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 21:03:48.083452 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656335 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 21:03:48.083452 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656338 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 21:03:48.083452 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656340 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 21:03:48.083452 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656343 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 21:03:48.083452 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656347 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 21:03:48.083452 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656349 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 21:03:48.083452 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656354 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 21:03:48.083452 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656357 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 21:03:48.083452 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656360 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 21:03:48.083452 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656363 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 21:03:48.083452 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656365 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 21:03:48.083452 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656368 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 21:03:48.083452 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656370 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 21:03:48.083452 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656372 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 21:03:48.083452 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656375 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 21:03:48.083452 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656377 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 21:03:48.083452 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656382 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 21:03:48.083452 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656384 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 21:03:48.083452 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656388 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 21:03:48.083937 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656391 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 21:03:48.083937 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656394 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 21:03:48.083937 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656397 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 21:03:48.083937 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656400 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 21:03:48.083937 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656402 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 21:03:48.083937 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656405 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 21:03:48.083937 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656408 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 21:03:48.083937 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656411 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 21:03:48.083937 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656414 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 21:03:48.083937 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656416 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 21:03:48.083937 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656419 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 21:03:48.083937 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656422 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 21:03:48.083937 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656424 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 21:03:48.083937 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656427 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 21:03:48.083937 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656429 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 21:03:48.083937 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656432 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 21:03:48.083937 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656436 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 21:03:48.083937 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656439 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 21:03:48.083937 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656443 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 21:03:48.084498 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656447 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 21:03:48.084498 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656449 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 21:03:48.084498 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656452 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 21:03:48.084498 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656454 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 21:03:48.084498 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656457 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 21:03:48.084498 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656459 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 17 21:03:48.084498 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656461 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 21:03:48.084498 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656464 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 21:03:48.084498 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656466 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 21:03:48.084498 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656469 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 21:03:48.084498 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656472 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 21:03:48.084498 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656475 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 21:03:48.084498 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656478 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 21:03:48.084498 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656480 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 21:03:48.084498 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656483 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 21:03:48.084498 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656485 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 21:03:48.084498 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656488 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 21:03:48.084498 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656490 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 21:03:48.084498 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656493 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 21:03:48.084498 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.656495 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 21:03:48.084998 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.656500 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 21:03:48.084998 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.656585 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jul 17 21:03:48.084998 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.659934 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 17 21:03:48.084998 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.661296 2580 server.go:1019] "Starting client certificate rotation" Jul 17 21:03:48.084998 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.661391 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 21:03:48.084998 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.661417 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 21:03:48.084998 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.664347 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 21:03:48.084998 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.666482 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 21:03:48.084998 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.676662 2580 log.go:25] "Validated CRI v1 runtime API" Jul 17 21:03:48.084998 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.679425 2580 log.go:25] "Validated CRI v1 image API" Jul 17 21:03:48.084998 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.680364 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 17 21:03:48.084998 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.683901 2580 fs.go:135] Filesystem UUIDs: map[4e154425-1c4c-437e-a906-0e731cf64593:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b44bcf56-e8d7-4d74-99a4-0767f094e66b:/dev/nvme0n1p3] Jul 17 21:03:48.085384 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.683922 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 17 21:03:48.085449 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.688562 2580 manager.go:216] Machine: {Timestamp:2026-07-17 21:03:47.688106387 +0000 UTC m=+0.285789021 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3200549 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fe472ad232a6ee3f0457cfc3c0091 SystemUUID:ec2fe472-ad23-2a6e-e3f0-457cfc3c0091 BootID:4461bdab-e5ed-4742-ac85-b52e6ce7570b Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b3:d8:bf:54:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b3:d8:bf:54:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:68:71:90:35:e3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 17 21:03:48.085449 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.688653 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 17 21:03:48.085449 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.688716 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 17 21:03:48.085449 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.690079 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 17 21:03:48.085449 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.690099 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-253.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 17 21:03:48.085449 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.691219 2580 topology_manager.go:138] "Creating topology manager with none policy" Jul 17 21:03:48.085449 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.691229 2580 container_manager_linux.go:309] "Creating device plugin manager" Jul 17 21:03:48.085449 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.691237 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.691808 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.693055 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.694981 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.697340 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.697439 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.697463 2580 kubelet.go:486] "Attempting to sync node with API server" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.697472 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.697485 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.697495 2580 kubelet.go:398] "Adding apiserver pod source" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.697503 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.697774 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.697790 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.699537 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.701439 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.701465 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.702501 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.702514 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.702520 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.702525 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.702533 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.702540 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.702550 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.702555 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.702561 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.702566 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.702574 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.702579 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.703149 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.703159 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.706036 2580 server.go:1268] "Started kubelet" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.706123 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.707086 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.707160 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.708146 2580 server.go:310] "Adding debug handlers to kubelet server" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.708682 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.710310 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:47.710341 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:47.710421 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 17 21:03:48.085779 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:47.712335 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 17 21:03:48.087052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.715451 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 17 21:03:48.087052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.715459 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 17 21:03:48.087052 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:47.715544 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-253.ec2.internal\" not found" Jul 17 21:03:48.087052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.716119 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 17 21:03:48.087052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.716144 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 17 21:03:48.087052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.716157 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 17 21:03:48.087052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.716244 2580 factory.go:55] Registering systemd factory Jul 17 21:03:48.087052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.716258 2580 factory.go:223] Registration of the systemd container factory successfully Jul 17 21:03:48.087052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.716258 2580 reconstruct.go:97] "Volume reconstruction finished" Jul 17 21:03:48.087052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.716287 2580 reconciler.go:29] "Reconciler: start to sync state" Jul 17 21:03:48.087052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.716546 2580 factory.go:153] Registering CRI-O factory Jul 17 21:03:48.087052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.716560 2580 factory.go:223] Registration of the crio container factory successfully Jul 17 21:03:48.087052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.716605 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 17 21:03:48.087052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.716622 2580 factory.go:103] Registering Raw factory Jul 17 21:03:48.087052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.716632 2580 manager.go:1196] Started watching for new ooms in manager Jul 17 21:03:48.087052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.716898 2580 manager.go:349] Starting recovery of all containers Jul 17 21:03:48.087052 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:47.720061 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 17 21:03:48.087052 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:47.719732 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18c32f9cc3401d81 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-17 21:03:47.706011009 +0000 UTC m=+0.303693642,LastTimestamp:2026-07-17 21:03:47.706011009 +0000 UTC m=+0.303693642,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}" Jul 17 21:03:48.087052 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:47.720665 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 17 21:03:48.087052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.725785 2580 manager.go:354] Recovery completed Jul 17 21:03:48.087052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.731007 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 21:03:48.087052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.732807 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory" Jul 17 21:03:48.087052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.732839 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 21:03:48.087052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.732848 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID" Jul 17 21:03:48.087052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.734071 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 17 21:03:48.087052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.734082 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 17 21:03:48.087052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.734097 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 17 21:03:48.087052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.734096 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 21:03:48.087807 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:47.735582 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18c32f9cc4d948ae default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-253.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-17 21:03:47.732826286 +0000 UTC m=+0.330508923,LastTimestamp:2026-07-17 21:03:47.732826286 +0000 UTC m=+0.330508923,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}" Jul 17 21:03:48.087807 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.735660 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory" Jul 17 21:03:48.087807 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.735682 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 21:03:48.087807 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.735703 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID" Jul 17 21:03:48.087807 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.736400 2580 policy_none.go:49] "None policy: Start" Jul 17 21:03:48.087807 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.736412 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 17 21:03:48.087807 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.736421 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 17 21:03:48.087807 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.738396 2580 policy_none.go:47] "Start" Jul 17 21:03:48.087807 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:47.745281 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18c32f9cc4d98b7e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-253.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-17 21:03:47.73284339 +0000 UTC m=+0.330526023,LastTimestamp:2026-07-17 21:03:47.73284339 +0000 UTC m=+0.330526023,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}" Jul 17 21:03:48.087807 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.750488 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w8tmn" Jul 17 21:03:48.087807 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:47.756001 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18c32f9cc4d9ad97 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-253.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-07-17 21:03:47.732852119 +0000 UTC m=+0.330534751,LastTimestamp:2026-07-17 21:03:47.732852119 +0000 UTC m=+0.330534751,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}" Jul 17 21:03:48.087807 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.759427 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w8tmn" Jul 17 21:03:48.087807 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.809740 2580 manager.go:337] "Starting Device Plugin manager" Jul 17 21:03:48.087807 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:47.809769 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 17 21:03:48.087807 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.809778 2580 server.go:87] "Starting device plugin registration server" Jul 17 21:03:48.087807 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.809978 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 17 21:03:48.087807 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.809990 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 17 21:03:48.087807 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.810122 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 17 21:03:48.087807 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.810206 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 17 21:03:48.087807 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.810213 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:47.810582 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:47.810630 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-253.ec2.internal\" not found" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.849956 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.851026 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.851054 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.851070 2580 kubelet.go:2448] "Starting kubelet main sync loop" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:47.851096 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.853651 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.910946 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.912614 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.912636 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.912645 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.912663 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.921499 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-253.ec2.internal" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:47.921518 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-253.ec2.internal\": node \"ip-10-0-132-253.ec2.internal\" not found" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:47.938070 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-253.ec2.internal\" not found" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.951778 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal"] Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.951930 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.953170 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.953204 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.953215 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.956271 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.956387 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.956414 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.958464 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.958488 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.958497 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.958500 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.958519 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.958577 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.961309 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.961336 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.962003 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory" Jul 17 21:03:48.196044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.962030 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 21:03:48.196947 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:47.962041 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID" Jul 17 21:03:48.196947 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:47.964254 2580 helpers.go:245] readString: Failed to read "/sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod297a8395d5b8d476174e085156e9219b.slice/cpu.weight": open /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod297a8395d5b8d476174e085156e9219b.slice/cpu.weight: no such device Jul 17 21:03:48.196947 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:47.987643 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal" Jul 17 21:03:48.196947 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:47.991923 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal" Jul 17 21:03:48.196947 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:48.017904 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/297a8395d5b8d476174e085156e9219b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal\" (UID: \"297a8395d5b8d476174e085156e9219b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" Jul 17 21:03:48.196947 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:48.017926 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/297a8395d5b8d476174e085156e9219b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal\" (UID: \"297a8395d5b8d476174e085156e9219b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" Jul 17 21:03:48.196947 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:48.017941 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8f24a48751c3182921e8a0c236d6d9a6-config\") pod \"kube-apiserver-proxy-ip-10-0-132-253.ec2.internal\" (UID: \"8f24a48751c3182921e8a0c236d6d9a6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal" Jul 17 21:03:48.196947 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:48.043428 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-253.ec2.internal\" not found" Jul 17 21:03:48.196947 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:48.118758 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/297a8395d5b8d476174e085156e9219b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal\" (UID: \"297a8395d5b8d476174e085156e9219b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" Jul 17 21:03:48.196947 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:48.118779 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/297a8395d5b8d476174e085156e9219b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal\" (UID: \"297a8395d5b8d476174e085156e9219b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" Jul 17 21:03:48.196947 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:48.118794 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8f24a48751c3182921e8a0c236d6d9a6-config\") pod \"kube-apiserver-proxy-ip-10-0-132-253.ec2.internal\" (UID: \"8f24a48751c3182921e8a0c236d6d9a6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal" Jul 17 21:03:48.196947 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:48.118827 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8f24a48751c3182921e8a0c236d6d9a6-config\") pod \"kube-apiserver-proxy-ip-10-0-132-253.ec2.internal\" (UID: \"8f24a48751c3182921e8a0c236d6d9a6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal" Jul 17 21:03:48.196947 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:48.118853 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/297a8395d5b8d476174e085156e9219b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal\" (UID: \"297a8395d5b8d476174e085156e9219b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" Jul 17 21:03:48.196947 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:48.118869 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/297a8395d5b8d476174e085156e9219b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal\" (UID: \"297a8395d5b8d476174e085156e9219b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" Jul 17 21:03:48.196947 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:48.143860 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-253.ec2.internal\" not found" Jul 17 21:03:48.314103 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:48.244537 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-253.ec2.internal\" not found" Jul 17 21:03:48.314103 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:48.294724 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal" Jul 17 21:03:48.314103 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:48.296911 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" Jul 17 21:03:48.434783 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:48.344863 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-253.ec2.internal\" not found" Jul 17 21:03:48.550003 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:48.446470 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-253.ec2.internal\" not found" Jul 17 21:03:48.550003 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:48.546866 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-253.ec2.internal\" not found" Jul 17 21:03:48.668041 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:48.647721 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-253.ec2.internal\" not found" Jul 17 21:03:48.668041 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:48.660807 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 17 21:03:48.668041 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:48.660931 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 17 21:03:48.802817 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:48.748055 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-253.ec2.internal\" not found" Jul 17 21:03:48.802817 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:48.764563 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 20:58:48 +0000 UTC" deadline="2028-05-03 17:38:47.079903246 +0000 UTC" Jul 17 21:03:48.802817 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:48.764590 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15740h34m58.315316202s" Jul 17 21:03:48.802817 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:48.793359 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 21:03:48.923673 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:48.816430 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" Jul 17 21:03:48.923673 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:48.839010 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 21:03:48.923673 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:48.840625 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal" Jul 17 21:03:48.923673 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:48.856429 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 21:03:48.923673 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:48.912403 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 21:03:49.142093 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.104739 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 21:03:49.790720 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.706301 2580 apiserver.go:52] "Watching apiserver" Jul 17 21:03:49.790720 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.714194 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 17 21:03:49.790720 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.714556 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-jkpqn","openshift-image-registry/node-ca-cxh8j","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal","openshift-multus/multus-68t46","openshift-multus/multus-additional-cni-plugins-8gbd6","openshift-multus/network-metrics-daemon-7z4zp","kube-system/konnectivity-agent-r9wzc","kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal","openshift-cluster-node-tuning-operator/tuned-br6dk","openshift-network-diagnostics/network-check-target-rwnns","openshift-network-operator/iptables-alerter-tv7wq","openshift-ovn-kubernetes/ovnkube-node-lj5lm","kube-system/global-pull-secret-syncer-rwxkq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rc86b"] Jul 17 21:03:49.790720 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.717101 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 17 21:03:49.790720 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.717359 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r9wzc" Jul 17 21:03:49.790720 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.723824 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rc86b" Jul 17 21:03:49.790720 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.723890 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-68t46" Jul 17 21:03:49.790720 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.724129 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:03:49.790720 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:49.724181 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwxkq" podUID="a4e45558-98a1-423e-8184-3cd1848415f3" Jul 17 21:03:49.790720 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.725102 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 17 21:03:49.790720 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.725158 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 17 21:03:49.790720 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.725486 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4xvxh\"" Jul 17 21:03:49.790720 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.726734 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 17 21:03:49.790720 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.726884 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bba97561-0dcd-43f6-ac53-876925d16126-agent-certs\") pod \"konnectivity-agent-r9wzc\" (UID: \"bba97561-0dcd-43f6-ac53-876925d16126\") " pod="kube-system/konnectivity-agent-r9wzc" Jul 17 21:03:49.790720 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.726924 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bba97561-0dcd-43f6-ac53-876925d16126-konnectivity-ca\") pod \"konnectivity-agent-r9wzc\" (UID: \"bba97561-0dcd-43f6-ac53-876925d16126\") " pod="kube-system/konnectivity-agent-r9wzc" Jul 17 21:03:49.790720 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.727126 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 17 21:03:49.790720 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.727250 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 17 21:03:49.790720 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.727294 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 17 21:03:49.790720 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.727385 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 17 21:03:49.790720 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.727395 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 17 21:03:49.790720 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.727446 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 17 21:03:49.790720 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.727857 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zpw7v\"" Jul 17 21:03:49.790720 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.728074 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-m6vq6\"" Jul 17 21:03:49.790720 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.729154 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8gbd6" Jul 17 21:03:49.790720 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.731532 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vv8qv\"" Jul 17 21:03:49.791882 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.731569 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 17 21:03:49.791882 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.731597 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 17 21:03:49.791882 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.731773 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:03:49.791882 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:49.731821 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7z4zp" podUID="c55f0556-d46b-468c-922b-364681e608cc" Jul 17 21:03:49.791882 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.732064 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 21:03:49.791882 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.735404 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:49.791882 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.742524 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:03:49.791882 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:49.742587 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwnns" podUID="d6024dec-941f-41a6-9986-808ce67207cb" Jul 17 21:03:49.791882 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.742601 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cxh8j" Jul 17 21:03:49.791882 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.742639 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jkpqn" Jul 17 21:03:49.791882 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.742737 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 17 21:03:49.791882 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.742839 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 17 21:03:49.791882 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.743024 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4qxcd\"" Jul 17 21:03:49.791882 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.743242 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tv7wq" Jul 17 21:03:49.791882 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.745217 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 17 21:03:49.791882 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.745320 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 17 21:03:49.791882 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.745487 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 17 21:03:49.791882 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.745756 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:49.791882 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.745813 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 17 21:03:49.791882 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.745827 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qbbjl\"" Jul 17 21:03:49.791882 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.745874 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 17 21:03:49.791882 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.745881 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 17 21:03:49.791882 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.745878 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 17 21:03:49.791882 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.745970 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5fbm9\"" Jul 17 21:03:49.791882 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.746438 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 17 21:03:49.791882 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.746565 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gptsd\"" Jul 17 21:03:49.791882 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.750113 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 17 21:03:49.791882 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.750163 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 17 21:03:49.792777 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.750182 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 17 21:03:49.792777 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.750326 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 17 21:03:49.792777 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.750345 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 17 21:03:49.792777 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.750347 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qbj6k\"" Jul 17 21:03:49.792777 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.761311 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 17 21:03:49.792777 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.761339 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-svgcj" Jul 17 21:03:49.792777 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.766760 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-svgcj" Jul 17 21:03:49.920668 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.814526 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 21:03:49.920668 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.817466 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 17 21:03:49.920668 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.827955 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/547aa59b-bc0d-4eb0-9c28-1635fc1d925c-cnibin\") pod \"multus-additional-cni-plugins-8gbd6\" (UID: \"547aa59b-bc0d-4eb0-9c28-1635fc1d925c\") " pod="openshift-multus/multus-additional-cni-plugins-8gbd6" Jul 17 21:03:49.920668 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.827978 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/547aa59b-bc0d-4eb0-9c28-1635fc1d925c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8gbd6\" (UID: \"547aa59b-bc0d-4eb0-9c28-1635fc1d925c\") " pod="openshift-multus/multus-additional-cni-plugins-8gbd6" Jul 17 21:03:49.920668 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.827996 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/547aa59b-bc0d-4eb0-9c28-1635fc1d925c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8gbd6\" (UID: \"547aa59b-bc0d-4eb0-9c28-1635fc1d925c\") " pod="openshift-multus/multus-additional-cni-plugins-8gbd6" Jul 17 21:03:49.920668 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828016 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2wl4\" (UniqueName: \"kubernetes.io/projected/c55f0556-d46b-468c-922b-364681e608cc-kube-api-access-x2wl4\") pod \"network-metrics-daemon-7z4zp\" (UID: \"c55f0556-d46b-468c-922b-364681e608cc\") " pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:03:49.920668 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828080 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b789bc82-e958-4d32-b4b1-3bc92349bde3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rc86b\" (UID: \"b789bc82-e958-4d32-b4b1-3bc92349bde3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rc86b" Jul 17 21:03:49.920668 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828117 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5m6z\" (UniqueName: \"kubernetes.io/projected/b789bc82-e958-4d32-b4b1-3bc92349bde3-kube-api-access-b5m6z\") pod \"aws-ebs-csi-driver-node-rc86b\" (UID: \"b789bc82-e958-4d32-b4b1-3bc92349bde3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rc86b" Jul 17 21:03:49.920668 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828139 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-host-run-multus-certs\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:49.920668 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828154 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ebc23e94-e431-4530-a0d3-4ecd7f6e81f1-hosts-file\") pod \"node-resolver-jkpqn\" (UID: \"ebc23e94-e431-4530-a0d3-4ecd7f6e81f1\") " pod="openshift-dns/node-resolver-jkpqn" Jul 17 21:03:49.920668 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828168 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-host-kubelet\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:49.920668 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828182 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-env-overrides\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:49.920668 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828224 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eb3851f8-584c-480e-9884-642854ae1515-iptables-alerter-script\") pod \"iptables-alerter-tv7wq\" (UID: \"eb3851f8-584c-480e-9884-642854ae1515\") " pod="openshift-network-operator/iptables-alerter-tv7wq" Jul 17 21:03:49.920668 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828251 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-host-var-lib-cni-multus\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:49.921482 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828267 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-run-openvswitch\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:49.921482 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828286 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzlkw\" (UniqueName: \"kubernetes.io/projected/547aa59b-bc0d-4eb0-9c28-1635fc1d925c-kube-api-access-mzlkw\") pod \"multus-additional-cni-plugins-8gbd6\" (UID: \"547aa59b-bc0d-4eb0-9c28-1635fc1d925c\") " pod="openshift-multus/multus-additional-cni-plugins-8gbd6" Jul 17 21:03:49.921482 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828308 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-cnibin\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:49.921482 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828322 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-multus-socket-dir-parent\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:49.921482 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828336 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-systemd-units\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:49.921482 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828367 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-etc-openvswitch\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:49.921482 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828383 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:49.921482 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828398 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drnvj\" (UniqueName: \"kubernetes.io/projected/22bb795e-5fc2-4387-93a0-c177879fddd7-kube-api-access-drnvj\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:49.921482 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828419 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c55f0556-d46b-468c-922b-364681e608cc-metrics-certs\") pod \"network-metrics-daemon-7z4zp\" (UID: \"c55f0556-d46b-468c-922b-364681e608cc\") " pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:03:49.921482 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828437 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebc23e94-e431-4530-a0d3-4ecd7f6e81f1-tmp-dir\") pod \"node-resolver-jkpqn\" (UID: \"ebc23e94-e431-4530-a0d3-4ecd7f6e81f1\") " pod="openshift-dns/node-resolver-jkpqn" Jul 17 21:03:49.921482 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828459 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a4e45558-98a1-423e-8184-3cd1848415f3-kubelet-config\") pod \"global-pull-secret-syncer-rwxkq\" (UID: \"a4e45558-98a1-423e-8184-3cd1848415f3\") " pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:03:49.921482 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828474 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4e45558-98a1-423e-8184-3cd1848415f3-original-pull-secret\") pod \"global-pull-secret-syncer-rwxkq\" (UID: \"a4e45558-98a1-423e-8184-3cd1848415f3\") " pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:03:49.921482 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828507 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/547aa59b-bc0d-4eb0-9c28-1635fc1d925c-cni-binary-copy\") pod \"multus-additional-cni-plugins-8gbd6\" (UID: \"547aa59b-bc0d-4eb0-9c28-1635fc1d925c\") " pod="openshift-multus/multus-additional-cni-plugins-8gbd6" Jul 17 21:03:49.923406 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828530 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-etc-modprobe-d\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:49.923406 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828545 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2kb9\" (UniqueName: \"kubernetes.io/projected/ba506437-d762-4054-98cd-573339a34e5f-kube-api-access-c2kb9\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:49.923406 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828578 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-multus-cni-dir\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:49.923406 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828607 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-multus-conf-dir\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:49.923406 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828621 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-node-log\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:49.923406 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828647 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-host-cni-netd\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:49.923406 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828667 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bba97561-0dcd-43f6-ac53-876925d16126-agent-certs\") pod \"konnectivity-agent-r9wzc\" (UID: \"bba97561-0dcd-43f6-ac53-876925d16126\") " pod="kube-system/konnectivity-agent-r9wzc" Jul 17 21:03:49.923406 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828689 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b789bc82-e958-4d32-b4b1-3bc92349bde3-device-dir\") pod \"aws-ebs-csi-driver-node-rc86b\" (UID: \"b789bc82-e958-4d32-b4b1-3bc92349bde3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rc86b" Jul 17 21:03:49.923406 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828705 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-etc-sysctl-conf\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:49.923406 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828718 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba506437-d762-4054-98cd-573339a34e5f-tmp\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:49.923406 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828731 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/243ec811-8044-4a40-94a4-12034fff80c7-host\") pod \"node-ca-cxh8j\" (UID: \"243ec811-8044-4a40-94a4-12034fff80c7\") " pod="openshift-image-registry/node-ca-cxh8j" Jul 17 21:03:49.923406 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828745 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-host-run-k8s-cni-cncf-io\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:49.923406 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828770 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-host-run-ovn-kubernetes\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:49.923406 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828805 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-ovnkube-script-lib\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:49.923950 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828826 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a4e45558-98a1-423e-8184-3cd1848415f3-dbus\") pod \"global-pull-secret-syncer-rwxkq\" (UID: \"a4e45558-98a1-423e-8184-3cd1848415f3\") " pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:03:49.923950 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828842 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b789bc82-e958-4d32-b4b1-3bc92349bde3-registration-dir\") pod \"aws-ebs-csi-driver-node-rc86b\" (UID: \"b789bc82-e958-4d32-b4b1-3bc92349bde3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rc86b" Jul 17 21:03:49.923950 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828857 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/243ec811-8044-4a40-94a4-12034fff80c7-serviceca\") pod \"node-ca-cxh8j\" (UID: \"243ec811-8044-4a40-94a4-12034fff80c7\") " pod="openshift-image-registry/node-ca-cxh8j" Jul 17 21:03:49.923950 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828873 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb3851f8-584c-480e-9884-642854ae1515-host-slash\") pod \"iptables-alerter-tv7wq\" (UID: \"eb3851f8-584c-480e-9884-642854ae1515\") " pod="openshift-network-operator/iptables-alerter-tv7wq" Jul 17 21:03:49.923950 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828892 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gn2c\" (UniqueName: \"kubernetes.io/projected/eb3851f8-584c-480e-9884-642854ae1515-kube-api-access-7gn2c\") pod \"iptables-alerter-tv7wq\" (UID: \"eb3851f8-584c-480e-9884-642854ae1515\") " pod="openshift-network-operator/iptables-alerter-tv7wq" Jul 17 21:03:49.923950 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828905 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-run-systemd\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:49.923950 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828922 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-etc-sysconfig\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:49.923950 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828935 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-lib-modules\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:49.923950 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828956 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-etc-kubernetes\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:49.923950 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.828981 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-host-cni-bin\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:49.923950 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829014 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b789bc82-e958-4d32-b4b1-3bc92349bde3-sys-fs\") pod \"aws-ebs-csi-driver-node-rc86b\" (UID: \"b789bc82-e958-4d32-b4b1-3bc92349bde3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rc86b" Jul 17 21:03:49.923950 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829029 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-run\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:49.923950 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829044 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-var-lib-kubelet\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:49.923950 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829058 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba506437-d762-4054-98cd-573339a34e5f-etc-tuned\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:49.924430 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829071 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-system-cni-dir\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:49.924430 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829084 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-hostroot\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:49.924430 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829112 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-host-slash\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:49.924430 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829132 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-host-run-netns\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:49.924430 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829151 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bba97561-0dcd-43f6-ac53-876925d16126-konnectivity-ca\") pod \"konnectivity-agent-r9wzc\" (UID: \"bba97561-0dcd-43f6-ac53-876925d16126\") " pod="kube-system/konnectivity-agent-r9wzc" Jul 17 21:03:49.924430 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829221 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b789bc82-e958-4d32-b4b1-3bc92349bde3-socket-dir\") pod \"aws-ebs-csi-driver-node-rc86b\" (UID: \"b789bc82-e958-4d32-b4b1-3bc92349bde3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rc86b" Jul 17 21:03:49.924430 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829243 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b789bc82-e958-4d32-b4b1-3bc92349bde3-etc-selinux\") pod \"aws-ebs-csi-driver-node-rc86b\" (UID: \"b789bc82-e958-4d32-b4b1-3bc92349bde3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rc86b" Jul 17 21:03:49.924430 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829272 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/547aa59b-bc0d-4eb0-9c28-1635fc1d925c-os-release\") pod \"multus-additional-cni-plugins-8gbd6\" (UID: \"547aa59b-bc0d-4eb0-9c28-1635fc1d925c\") " pod="openshift-multus/multus-additional-cni-plugins-8gbd6" Jul 17 21:03:49.924430 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829288 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-etc-sysctl-d\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:49.924430 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829306 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-sys\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:49.924430 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829323 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-var-lib-openvswitch\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:49.924430 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829338 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-ovnkube-config\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:49.924430 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829356 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c55t\" (UniqueName: \"kubernetes.io/projected/ebc23e94-e431-4530-a0d3-4ecd7f6e81f1-kube-api-access-8c55t\") pod \"node-resolver-jkpqn\" (UID: \"ebc23e94-e431-4530-a0d3-4ecd7f6e81f1\") " pod="openshift-dns/node-resolver-jkpqn" Jul 17 21:03:49.924430 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829375 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb4kk\" (UniqueName: \"kubernetes.io/projected/d6024dec-941f-41a6-9986-808ce67207cb-kube-api-access-fb4kk\") pod \"network-check-target-rwnns\" (UID: \"d6024dec-941f-41a6-9986-808ce67207cb\") " pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:03:49.925047 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829394 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl7wl\" (UniqueName: \"kubernetes.io/projected/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-kube-api-access-kl7wl\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:49.925047 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829417 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/547aa59b-bc0d-4eb0-9c28-1635fc1d925c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8gbd6\" (UID: \"547aa59b-bc0d-4eb0-9c28-1635fc1d925c\") " pod="openshift-multus/multus-additional-cni-plugins-8gbd6" Jul 17 21:03:49.925047 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829443 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/22bb795e-5fc2-4387-93a0-c177879fddd7-multus-daemon-config\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:49.925047 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829469 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zprxc\" (UniqueName: \"kubernetes.io/projected/243ec811-8044-4a40-94a4-12034fff80c7-kube-api-access-zprxc\") pod \"node-ca-cxh8j\" (UID: \"243ec811-8044-4a40-94a4-12034fff80c7\") " pod="openshift-image-registry/node-ca-cxh8j" Jul 17 21:03:49.925047 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829493 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-os-release\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:49.925047 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829508 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22bb795e-5fc2-4387-93a0-c177879fddd7-cni-binary-copy\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:49.925047 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829521 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-host-run-netns\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:49.925047 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829551 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-host-var-lib-cni-bin\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:49.925047 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829572 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-host-var-lib-kubelet\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:49.925047 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829586 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-log-socket\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:49.925047 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829603 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-etc-kubernetes\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:49.925047 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829622 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-etc-systemd\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:49.925047 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829636 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-host\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:49.925047 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829650 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-run-ovn\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:49.925500 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829671 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-ovn-node-metrics-cert\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:49.925500 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.829702 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/547aa59b-bc0d-4eb0-9c28-1635fc1d925c-system-cni-dir\") pod \"multus-additional-cni-plugins-8gbd6\" (UID: \"547aa59b-bc0d-4eb0-9c28-1635fc1d925c\") " pod="openshift-multus/multus-additional-cni-plugins-8gbd6" Jul 17 21:03:49.925500 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.830033 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bba97561-0dcd-43f6-ac53-876925d16126-konnectivity-ca\") pod \"konnectivity-agent-r9wzc\" (UID: \"bba97561-0dcd-43f6-ac53-876925d16126\") " pod="kube-system/konnectivity-agent-r9wzc" Jul 17 21:03:49.925500 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.830653 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 17 21:03:49.925500 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.833735 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bba97561-0dcd-43f6-ac53-876925d16126-agent-certs\") pod \"konnectivity-agent-r9wzc\" (UID: \"bba97561-0dcd-43f6-ac53-876925d16126\") " pod="kube-system/konnectivity-agent-r9wzc" Jul 17 21:03:50.008057 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.929844 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b789bc82-e958-4d32-b4b1-3bc92349bde3-sys-fs\") pod \"aws-ebs-csi-driver-node-rc86b\" (UID: \"b789bc82-e958-4d32-b4b1-3bc92349bde3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rc86b" Jul 17 21:03:50.008057 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.929866 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-run\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:50.008057 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.929881 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-var-lib-kubelet\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:50.008057 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.929898 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba506437-d762-4054-98cd-573339a34e5f-etc-tuned\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:50.008057 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.929922 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-system-cni-dir\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.008057 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.929961 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b789bc82-e958-4d32-b4b1-3bc92349bde3-sys-fs\") pod \"aws-ebs-csi-driver-node-rc86b\" (UID: \"b789bc82-e958-4d32-b4b1-3bc92349bde3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rc86b" Jul 17 21:03:50.008057 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.929972 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-hostroot\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.008057 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.929978 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-var-lib-kubelet\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:50.008057 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.929996 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-host-slash\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.008057 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930021 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-hostroot\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.008057 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930034 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-system-cni-dir\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.008057 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930032 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-run\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:50.008057 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930037 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-host-slash\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.008057 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930059 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-host-run-netns\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.008057 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930083 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b789bc82-e958-4d32-b4b1-3bc92349bde3-socket-dir\") pod \"aws-ebs-csi-driver-node-rc86b\" (UID: \"b789bc82-e958-4d32-b4b1-3bc92349bde3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rc86b" Jul 17 21:03:50.008598 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930106 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b789bc82-e958-4d32-b4b1-3bc92349bde3-etc-selinux\") pod \"aws-ebs-csi-driver-node-rc86b\" (UID: \"b789bc82-e958-4d32-b4b1-3bc92349bde3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rc86b" Jul 17 21:03:50.008598 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930132 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/547aa59b-bc0d-4eb0-9c28-1635fc1d925c-os-release\") pod \"multus-additional-cni-plugins-8gbd6\" (UID: \"547aa59b-bc0d-4eb0-9c28-1635fc1d925c\") " pod="openshift-multus/multus-additional-cni-plugins-8gbd6" Jul 17 21:03:50.008598 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930153 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-etc-sysctl-d\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:50.008598 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930176 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-sys\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:50.008598 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930134 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-host-run-netns\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.008598 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930213 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b789bc82-e958-4d32-b4b1-3bc92349bde3-etc-selinux\") pod \"aws-ebs-csi-driver-node-rc86b\" (UID: \"b789bc82-e958-4d32-b4b1-3bc92349bde3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rc86b" Jul 17 21:03:50.008598 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930219 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-var-lib-openvswitch\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.008598 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930237 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b789bc82-e958-4d32-b4b1-3bc92349bde3-socket-dir\") pod \"aws-ebs-csi-driver-node-rc86b\" (UID: \"b789bc82-e958-4d32-b4b1-3bc92349bde3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rc86b" Jul 17 21:03:50.008598 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930253 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-ovnkube-config\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.008598 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930266 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/547aa59b-bc0d-4eb0-9c28-1635fc1d925c-os-release\") pod \"multus-additional-cni-plugins-8gbd6\" (UID: \"547aa59b-bc0d-4eb0-9c28-1635fc1d925c\") " pod="openshift-multus/multus-additional-cni-plugins-8gbd6" Jul 17 21:03:50.008598 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930272 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-sys\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:50.008598 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930295 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-var-lib-openvswitch\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.008598 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930343 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c55t\" (UniqueName: \"kubernetes.io/projected/ebc23e94-e431-4530-a0d3-4ecd7f6e81f1-kube-api-access-8c55t\") pod \"node-resolver-jkpqn\" (UID: \"ebc23e94-e431-4530-a0d3-4ecd7f6e81f1\") " pod="openshift-dns/node-resolver-jkpqn" Jul 17 21:03:50.008598 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930347 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-etc-sysctl-d\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:50.008963 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930373 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb4kk\" (UniqueName: \"kubernetes.io/projected/d6024dec-941f-41a6-9986-808ce67207cb-kube-api-access-fb4kk\") pod \"network-check-target-rwnns\" (UID: \"d6024dec-941f-41a6-9986-808ce67207cb\") " pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:03:50.008963 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930398 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl7wl\" (UniqueName: \"kubernetes.io/projected/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-kube-api-access-kl7wl\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.008963 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930422 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/547aa59b-bc0d-4eb0-9c28-1635fc1d925c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8gbd6\" (UID: \"547aa59b-bc0d-4eb0-9c28-1635fc1d925c\") " pod="openshift-multus/multus-additional-cni-plugins-8gbd6" Jul 17 21:03:50.008963 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930440 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/22bb795e-5fc2-4387-93a0-c177879fddd7-multus-daemon-config\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.008963 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930458 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zprxc\" (UniqueName: \"kubernetes.io/projected/243ec811-8044-4a40-94a4-12034fff80c7-kube-api-access-zprxc\") pod \"node-ca-cxh8j\" (UID: \"243ec811-8044-4a40-94a4-12034fff80c7\") " pod="openshift-image-registry/node-ca-cxh8j" Jul 17 21:03:50.008963 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930482 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-os-release\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.008963 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930503 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22bb795e-5fc2-4387-93a0-c177879fddd7-cni-binary-copy\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.008963 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930526 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-host-run-netns\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.008963 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930554 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-host-var-lib-cni-bin\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.008963 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930599 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-host-var-lib-kubelet\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.008963 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930607 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/547aa59b-bc0d-4eb0-9c28-1635fc1d925c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8gbd6\" (UID: \"547aa59b-bc0d-4eb0-9c28-1635fc1d925c\") " pod="openshift-multus/multus-additional-cni-plugins-8gbd6" Jul 17 21:03:50.008963 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930623 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-log-socket\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.008963 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930665 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-host-run-netns\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.008963 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930675 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-log-socket\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.008963 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930691 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-os-release\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.009412 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930729 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-etc-kubernetes\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:50.009412 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930779 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-etc-systemd\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:50.009412 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930794 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-host\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:50.009412 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930717 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-host-var-lib-cni-bin\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.009412 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930740 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-host-var-lib-kubelet\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.009412 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930824 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-run-ovn\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.009412 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930868 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-ovnkube-config\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.009412 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930886 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-etc-kubernetes\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:50.009412 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930871 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-host\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:50.009412 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930871 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-etc-systemd\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:50.009412 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930924 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-ovn-node-metrics-cert\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.009412 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930951 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/547aa59b-bc0d-4eb0-9c28-1635fc1d925c-system-cni-dir\") pod \"multus-additional-cni-plugins-8gbd6\" (UID: \"547aa59b-bc0d-4eb0-9c28-1635fc1d925c\") " pod="openshift-multus/multus-additional-cni-plugins-8gbd6" Jul 17 21:03:50.009412 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930975 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-run-ovn\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.009412 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.930977 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/547aa59b-bc0d-4eb0-9c28-1635fc1d925c-cnibin\") pod \"multus-additional-cni-plugins-8gbd6\" (UID: \"547aa59b-bc0d-4eb0-9c28-1635fc1d925c\") " pod="openshift-multus/multus-additional-cni-plugins-8gbd6" Jul 17 21:03:50.009412 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931012 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/547aa59b-bc0d-4eb0-9c28-1635fc1d925c-cnibin\") pod \"multus-additional-cni-plugins-8gbd6\" (UID: \"547aa59b-bc0d-4eb0-9c28-1635fc1d925c\") " pod="openshift-multus/multus-additional-cni-plugins-8gbd6" Jul 17 21:03:50.009809 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931024 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/547aa59b-bc0d-4eb0-9c28-1635fc1d925c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8gbd6\" (UID: \"547aa59b-bc0d-4eb0-9c28-1635fc1d925c\") " pod="openshift-multus/multus-additional-cni-plugins-8gbd6" Jul 17 21:03:50.009809 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931034 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/547aa59b-bc0d-4eb0-9c28-1635fc1d925c-system-cni-dir\") pod \"multus-additional-cni-plugins-8gbd6\" (UID: \"547aa59b-bc0d-4eb0-9c28-1635fc1d925c\") " pod="openshift-multus/multus-additional-cni-plugins-8gbd6" Jul 17 21:03:50.009809 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931049 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/547aa59b-bc0d-4eb0-9c28-1635fc1d925c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8gbd6\" (UID: \"547aa59b-bc0d-4eb0-9c28-1635fc1d925c\") " pod="openshift-multus/multus-additional-cni-plugins-8gbd6" Jul 17 21:03:50.009809 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931068 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2wl4\" (UniqueName: \"kubernetes.io/projected/c55f0556-d46b-468c-922b-364681e608cc-kube-api-access-x2wl4\") pod \"network-metrics-daemon-7z4zp\" (UID: \"c55f0556-d46b-468c-922b-364681e608cc\") " pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:03:50.009809 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931098 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b789bc82-e958-4d32-b4b1-3bc92349bde3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rc86b\" (UID: \"b789bc82-e958-4d32-b4b1-3bc92349bde3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rc86b" Jul 17 21:03:50.009809 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931126 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5m6z\" (UniqueName: \"kubernetes.io/projected/b789bc82-e958-4d32-b4b1-3bc92349bde3-kube-api-access-b5m6z\") pod \"aws-ebs-csi-driver-node-rc86b\" (UID: \"b789bc82-e958-4d32-b4b1-3bc92349bde3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rc86b" Jul 17 21:03:50.009809 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931151 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-host-run-multus-certs\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.009809 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931200 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22bb795e-5fc2-4387-93a0-c177879fddd7-cni-binary-copy\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.009809 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931207 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ebc23e94-e431-4530-a0d3-4ecd7f6e81f1-hosts-file\") pod \"node-resolver-jkpqn\" (UID: \"ebc23e94-e431-4530-a0d3-4ecd7f6e81f1\") " pod="openshift-dns/node-resolver-jkpqn" Jul 17 21:03:50.009809 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931229 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-host-kubelet\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.009809 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931251 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-env-overrides\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.009809 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931275 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eb3851f8-584c-480e-9884-642854ae1515-iptables-alerter-script\") pod \"iptables-alerter-tv7wq\" (UID: \"eb3851f8-584c-480e-9884-642854ae1515\") " pod="openshift-network-operator/iptables-alerter-tv7wq" Jul 17 21:03:50.009809 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931304 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-host-var-lib-cni-multus\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.009809 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931308 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b789bc82-e958-4d32-b4b1-3bc92349bde3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rc86b\" (UID: \"b789bc82-e958-4d32-b4b1-3bc92349bde3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rc86b" Jul 17 21:03:50.010169 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931328 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-run-openvswitch\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.010169 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931336 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-host-kubelet\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.010169 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931355 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzlkw\" (UniqueName: \"kubernetes.io/projected/547aa59b-bc0d-4eb0-9c28-1635fc1d925c-kube-api-access-mzlkw\") pod \"multus-additional-cni-plugins-8gbd6\" (UID: \"547aa59b-bc0d-4eb0-9c28-1635fc1d925c\") " pod="openshift-multus/multus-additional-cni-plugins-8gbd6" Jul 17 21:03:50.010169 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931375 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-host-run-multus-certs\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.010169 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931379 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-cnibin\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.010169 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931327 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/22bb795e-5fc2-4387-93a0-c177879fddd7-multus-daemon-config\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.010169 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931400 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ebc23e94-e431-4530-a0d3-4ecd7f6e81f1-hosts-file\") pod \"node-resolver-jkpqn\" (UID: \"ebc23e94-e431-4530-a0d3-4ecd7f6e81f1\") " pod="openshift-dns/node-resolver-jkpqn" Jul 17 21:03:50.010169 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931404 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-multus-socket-dir-parent\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.010169 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931448 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-host-var-lib-cni-multus\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.010169 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931464 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-multus-socket-dir-parent\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.010169 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931485 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-run-openvswitch\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.010169 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931523 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-systemd-units\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.010169 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931550 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-etc-openvswitch\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.010169 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931589 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.010169 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931619 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drnvj\" (UniqueName: \"kubernetes.io/projected/22bb795e-5fc2-4387-93a0-c177879fddd7-kube-api-access-drnvj\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.010614 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931638 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-cnibin\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.010614 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931649 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c55f0556-d46b-468c-922b-364681e608cc-metrics-certs\") pod \"network-metrics-daemon-7z4zp\" (UID: \"c55f0556-d46b-468c-922b-364681e608cc\") " pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:03:50.010614 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931682 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/547aa59b-bc0d-4eb0-9c28-1635fc1d925c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8gbd6\" (UID: \"547aa59b-bc0d-4eb0-9c28-1635fc1d925c\") " pod="openshift-multus/multus-additional-cni-plugins-8gbd6" Jul 17 21:03:50.010614 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931694 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-etc-openvswitch\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.010614 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931718 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-env-overrides\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.010614 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931728 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebc23e94-e431-4530-a0d3-4ecd7f6e81f1-tmp-dir\") pod \"node-resolver-jkpqn\" (UID: \"ebc23e94-e431-4530-a0d3-4ecd7f6e81f1\") " pod="openshift-dns/node-resolver-jkpqn" Jul 17 21:03:50.010614 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:49.931736 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 21:03:50.010614 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931772 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a4e45558-98a1-423e-8184-3cd1848415f3-kubelet-config\") pod \"global-pull-secret-syncer-rwxkq\" (UID: \"a4e45558-98a1-423e-8184-3cd1848415f3\") " pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:03:50.010614 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931799 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4e45558-98a1-423e-8184-3cd1848415f3-original-pull-secret\") pod \"global-pull-secret-syncer-rwxkq\" (UID: \"a4e45558-98a1-423e-8184-3cd1848415f3\") " pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:03:50.010614 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931828 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/547aa59b-bc0d-4eb0-9c28-1635fc1d925c-cni-binary-copy\") pod \"multus-additional-cni-plugins-8gbd6\" (UID: \"547aa59b-bc0d-4eb0-9c28-1635fc1d925c\") " pod="openshift-multus/multus-additional-cni-plugins-8gbd6" Jul 17 21:03:50.010614 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931828 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.010614 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931854 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-systemd-units\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.010614 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931887 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eb3851f8-584c-480e-9884-642854ae1515-iptables-alerter-script\") pod \"iptables-alerter-tv7wq\" (UID: \"eb3851f8-584c-480e-9884-642854ae1515\") " pod="openshift-network-operator/iptables-alerter-tv7wq" Jul 17 21:03:50.010614 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.931975 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a4e45558-98a1-423e-8184-3cd1848415f3-kubelet-config\") pod \"global-pull-secret-syncer-rwxkq\" (UID: \"a4e45558-98a1-423e-8184-3cd1848415f3\") " pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:03:50.010995 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:49.931992 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c55f0556-d46b-468c-922b-364681e608cc-metrics-certs podName:c55f0556-d46b-468c-922b-364681e608cc nodeName:}" failed. No retries permitted until 2026-07-17 21:03:50.431953112 +0000 UTC m=+3.029635738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c55f0556-d46b-468c-922b-364681e608cc-metrics-certs") pod "network-metrics-daemon-7z4zp" (UID: "c55f0556-d46b-468c-922b-364681e608cc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 21:03:50.010995 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:49.931995 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 21:03:50.010995 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:49.932060 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e45558-98a1-423e-8184-3cd1848415f3-original-pull-secret podName:a4e45558-98a1-423e-8184-3cd1848415f3 nodeName:}" failed. No retries permitted until 2026-07-17 21:03:50.432044269 +0000 UTC m=+3.029726894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4e45558-98a1-423e-8184-3cd1848415f3-original-pull-secret") pod "global-pull-secret-syncer-rwxkq" (UID: "a4e45558-98a1-423e-8184-3cd1848415f3") : object "kube-system"/"original-pull-secret" not registered Jul 17 21:03:50.010995 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932169 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-etc-modprobe-d\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:50.010995 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932219 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2kb9\" (UniqueName: \"kubernetes.io/projected/ba506437-d762-4054-98cd-573339a34e5f-kube-api-access-c2kb9\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:50.010995 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932260 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebc23e94-e431-4530-a0d3-4ecd7f6e81f1-tmp-dir\") pod \"node-resolver-jkpqn\" (UID: \"ebc23e94-e431-4530-a0d3-4ecd7f6e81f1\") " pod="openshift-dns/node-resolver-jkpqn" Jul 17 21:03:50.010995 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932293 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-etc-modprobe-d\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:50.010995 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932361 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-multus-cni-dir\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.010995 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932380 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-multus-conf-dir\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.010995 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932395 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-node-log\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.010995 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932415 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-host-cni-netd\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.010995 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932430 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b789bc82-e958-4d32-b4b1-3bc92349bde3-device-dir\") pod \"aws-ebs-csi-driver-node-rc86b\" (UID: \"b789bc82-e958-4d32-b4b1-3bc92349bde3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rc86b" Jul 17 21:03:50.010995 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932445 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-etc-sysctl-conf\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:50.010995 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932461 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba506437-d762-4054-98cd-573339a34e5f-tmp\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:50.011398 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932464 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba506437-d762-4054-98cd-573339a34e5f-etc-tuned\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:50.011398 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932475 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/243ec811-8044-4a40-94a4-12034fff80c7-host\") pod \"node-ca-cxh8j\" (UID: \"243ec811-8044-4a40-94a4-12034fff80c7\") " pod="openshift-image-registry/node-ca-cxh8j" Jul 17 21:03:50.011398 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932485 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-multus-cni-dir\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.011398 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932498 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-host-run-k8s-cni-cncf-io\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.011398 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932522 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-host-cni-netd\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.011398 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932530 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-multus-conf-dir\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.011398 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932533 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-host-run-k8s-cni-cncf-io\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.011398 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932557 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b789bc82-e958-4d32-b4b1-3bc92349bde3-device-dir\") pod \"aws-ebs-csi-driver-node-rc86b\" (UID: \"b789bc82-e958-4d32-b4b1-3bc92349bde3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rc86b" Jul 17 21:03:50.011398 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932565 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-node-log\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.011398 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932568 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-host-run-ovn-kubernetes\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.011398 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932575 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/547aa59b-bc0d-4eb0-9c28-1635fc1d925c-cni-binary-copy\") pod \"multus-additional-cni-plugins-8gbd6\" (UID: \"547aa59b-bc0d-4eb0-9c28-1635fc1d925c\") " pod="openshift-multus/multus-additional-cni-plugins-8gbd6" Jul 17 21:03:50.011398 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932600 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-host-run-ovn-kubernetes\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.011398 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932611 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-ovnkube-script-lib\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.011398 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932620 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/243ec811-8044-4a40-94a4-12034fff80c7-host\") pod \"node-ca-cxh8j\" (UID: \"243ec811-8044-4a40-94a4-12034fff80c7\") " pod="openshift-image-registry/node-ca-cxh8j" Jul 17 21:03:50.011398 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932638 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a4e45558-98a1-423e-8184-3cd1848415f3-dbus\") pod \"global-pull-secret-syncer-rwxkq\" (UID: \"a4e45558-98a1-423e-8184-3cd1848415f3\") " pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:03:50.011802 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932663 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b789bc82-e958-4d32-b4b1-3bc92349bde3-registration-dir\") pod \"aws-ebs-csi-driver-node-rc86b\" (UID: \"b789bc82-e958-4d32-b4b1-3bc92349bde3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rc86b" Jul 17 21:03:50.011802 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932685 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/243ec811-8044-4a40-94a4-12034fff80c7-serviceca\") pod \"node-ca-cxh8j\" (UID: \"243ec811-8044-4a40-94a4-12034fff80c7\") " pod="openshift-image-registry/node-ca-cxh8j" Jul 17 21:03:50.011802 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932708 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb3851f8-584c-480e-9884-642854ae1515-host-slash\") pod \"iptables-alerter-tv7wq\" (UID: \"eb3851f8-584c-480e-9884-642854ae1515\") " pod="openshift-network-operator/iptables-alerter-tv7wq" Jul 17 21:03:50.011802 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932719 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-etc-sysctl-conf\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:50.011802 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932734 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gn2c\" (UniqueName: \"kubernetes.io/projected/eb3851f8-584c-480e-9884-642854ae1515-kube-api-access-7gn2c\") pod \"iptables-alerter-tv7wq\" (UID: \"eb3851f8-584c-480e-9884-642854ae1515\") " pod="openshift-network-operator/iptables-alerter-tv7wq" Jul 17 21:03:50.011802 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932727 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a4e45558-98a1-423e-8184-3cd1848415f3-dbus\") pod \"global-pull-secret-syncer-rwxkq\" (UID: \"a4e45558-98a1-423e-8184-3cd1848415f3\") " pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:03:50.011802 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932780 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-run-systemd\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.011802 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932792 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b789bc82-e958-4d32-b4b1-3bc92349bde3-registration-dir\") pod \"aws-ebs-csi-driver-node-rc86b\" (UID: \"b789bc82-e958-4d32-b4b1-3bc92349bde3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rc86b" Jul 17 21:03:50.011802 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932805 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-etc-sysconfig\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:50.011802 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932838 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/547aa59b-bc0d-4eb0-9c28-1635fc1d925c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8gbd6\" (UID: \"547aa59b-bc0d-4eb0-9c28-1635fc1d925c\") " pod="openshift-multus/multus-additional-cni-plugins-8gbd6" Jul 17 21:03:50.011802 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932879 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb3851f8-584c-480e-9884-642854ae1515-host-slash\") pod \"iptables-alerter-tv7wq\" (UID: \"eb3851f8-584c-480e-9884-642854ae1515\") " pod="openshift-network-operator/iptables-alerter-tv7wq" Jul 17 21:03:50.011802 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.932914 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-run-systemd\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.011802 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.933030 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-etc-sysconfig\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:50.011802 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.946083 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-lib-modules\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:50.012210 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.946109 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba506437-d762-4054-98cd-573339a34e5f-tmp\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:50.012210 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.946138 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-etc-kubernetes\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.012210 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.946178 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-host-cni-bin\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.012210 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.946257 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22bb795e-5fc2-4387-93a0-c177879fddd7-etc-kubernetes\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.012210 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.946095 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-ovnkube-script-lib\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.012210 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.946285 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-ovn-node-metrics-cert\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.012210 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:49.946311 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 21:03:50.012210 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.946288 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-host-cni-bin\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.012210 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:49.946328 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 21:03:50.012210 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:49.946342 2580 projected.go:196] Error preparing data for projected volume kube-api-access-fb4kk for pod openshift-network-diagnostics/network-check-target-rwnns: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 21:03:50.012210 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.946341 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba506437-d762-4054-98cd-573339a34e5f-lib-modules\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:50.012210 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:49.946393 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6024dec-941f-41a6-9986-808ce67207cb-kube-api-access-fb4kk podName:d6024dec-941f-41a6-9986-808ce67207cb nodeName:}" failed. No retries permitted until 2026-07-17 21:03:50.446374394 +0000 UTC m=+3.044057036 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fb4kk" (UniqueName: "kubernetes.io/projected/d6024dec-941f-41a6-9986-808ce67207cb-kube-api-access-fb4kk") pod "network-check-target-rwnns" (UID: "d6024dec-941f-41a6-9986-808ce67207cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 21:03:50.012210 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.946573 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/243ec811-8044-4a40-94a4-12034fff80c7-serviceca\") pod \"node-ca-cxh8j\" (UID: \"243ec811-8044-4a40-94a4-12034fff80c7\") " pod="openshift-image-registry/node-ca-cxh8j" Jul 17 21:03:50.012210 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.953439 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c55t\" (UniqueName: \"kubernetes.io/projected/ebc23e94-e431-4530-a0d3-4ecd7f6e81f1-kube-api-access-8c55t\") pod \"node-resolver-jkpqn\" (UID: \"ebc23e94-e431-4530-a0d3-4ecd7f6e81f1\") " pod="openshift-dns/node-resolver-jkpqn" Jul 17 21:03:50.012210 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.953877 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2wl4\" (UniqueName: \"kubernetes.io/projected/c55f0556-d46b-468c-922b-364681e608cc-kube-api-access-x2wl4\") pod \"network-metrics-daemon-7z4zp\" (UID: \"c55f0556-d46b-468c-922b-364681e608cc\") " pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:03:50.012640 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.963007 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gn2c\" (UniqueName: \"kubernetes.io/projected/eb3851f8-584c-480e-9884-642854ae1515-kube-api-access-7gn2c\") pod \"iptables-alerter-tv7wq\" (UID: \"eb3851f8-584c-480e-9884-642854ae1515\") " pod="openshift-network-operator/iptables-alerter-tv7wq" Jul 17 21:03:50.012640 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.963026 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zprxc\" (UniqueName: \"kubernetes.io/projected/243ec811-8044-4a40-94a4-12034fff80c7-kube-api-access-zprxc\") pod \"node-ca-cxh8j\" (UID: \"243ec811-8044-4a40-94a4-12034fff80c7\") " pod="openshift-image-registry/node-ca-cxh8j" Jul 17 21:03:50.012640 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.963159 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5m6z\" (UniqueName: \"kubernetes.io/projected/b789bc82-e958-4d32-b4b1-3bc92349bde3-kube-api-access-b5m6z\") pod \"aws-ebs-csi-driver-node-rc86b\" (UID: \"b789bc82-e958-4d32-b4b1-3bc92349bde3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rc86b" Jul 17 21:03:50.012640 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.963552 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drnvj\" (UniqueName: \"kubernetes.io/projected/22bb795e-5fc2-4387-93a0-c177879fddd7-kube-api-access-drnvj\") pod \"multus-68t46\" (UID: \"22bb795e-5fc2-4387-93a0-c177879fddd7\") " pod="openshift-multus/multus-68t46" Jul 17 21:03:50.012640 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.964152 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl7wl\" (UniqueName: \"kubernetes.io/projected/6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd-kube-api-access-kl7wl\") pod \"ovnkube-node-lj5lm\" (UID: \"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.012640 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.964565 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzlkw\" (UniqueName: \"kubernetes.io/projected/547aa59b-bc0d-4eb0-9c28-1635fc1d925c-kube-api-access-mzlkw\") pod \"multus-additional-cni-plugins-8gbd6\" (UID: \"547aa59b-bc0d-4eb0-9c28-1635fc1d925c\") " pod="openshift-multus/multus-additional-cni-plugins-8gbd6" Jul 17 21:03:50.012640 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:49.965077 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2kb9\" (UniqueName: \"kubernetes.io/projected/ba506437-d762-4054-98cd-573339a34e5f-kube-api-access-c2kb9\") pod \"tuned-br6dk\" (UID: \"ba506437-d762-4054-98cd-573339a34e5f\") " pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:50.068478 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:50.068453 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r9wzc" Jul 17 21:03:50.091435 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:50.091416 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rc86b" Jul 17 21:03:50.099298 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:50.099275 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-68t46" Jul 17 21:03:50.115781 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:50.115755 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8gbd6" Jul 17 21:03:50.129559 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:50.129532 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-br6dk" Jul 17 21:03:50.177045 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:50.177001 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cxh8j" Jul 17 21:03:50.194726 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:50.194704 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jkpqn" Jul 17 21:03:50.227809 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:50.227789 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tv7wq" Jul 17 21:03:50.233220 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:50.233204 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:03:50.388200 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:50.388156 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f24a48751c3182921e8a0c236d6d9a6.slice/crio-0bc0eb5d727b17a8d8c1a29838a553ee123ba9c610b2348210b30eae899951bf WatchSource:0}: Error finding container 0bc0eb5d727b17a8d8c1a29838a553ee123ba9c610b2348210b30eae899951bf: Status 404 returned error can't find the container with id 0bc0eb5d727b17a8d8c1a29838a553ee123ba9c610b2348210b30eae899951bf Jul 17 21:03:50.394574 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:50.394556 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 21:03:50.439279 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:50.439242 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb789bc82_e958_4d32_b4b1_3bc92349bde3.slice/crio-994382a166bc717a41f9bc297b3ab9fb23ea6df6eaa3096004618c9912c08510 WatchSource:0}: Error finding container 994382a166bc717a41f9bc297b3ab9fb23ea6df6eaa3096004618c9912c08510: Status 404 returned error can't find the container with id 994382a166bc717a41f9bc297b3ab9fb23ea6df6eaa3096004618c9912c08510 Jul 17 21:03:50.449812 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:50.449791 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c55f0556-d46b-468c-922b-364681e608cc-metrics-certs\") pod \"network-metrics-daemon-7z4zp\" (UID: \"c55f0556-d46b-468c-922b-364681e608cc\") " pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:03:50.449899 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:50.449821 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4e45558-98a1-423e-8184-3cd1848415f3-original-pull-secret\") pod \"global-pull-secret-syncer-rwxkq\" (UID: \"a4e45558-98a1-423e-8184-3cd1848415f3\") " pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:03:50.449899 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:50.449852 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb4kk\" (UniqueName: \"kubernetes.io/projected/d6024dec-941f-41a6-9986-808ce67207cb-kube-api-access-fb4kk\") pod \"network-check-target-rwnns\" (UID: \"d6024dec-941f-41a6-9986-808ce67207cb\") " pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:03:50.449985 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:50.449936 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 21:03:50.450019 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:50.449984 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 21:03:50.450019 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:50.449990 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e45558-98a1-423e-8184-3cd1848415f3-original-pull-secret podName:a4e45558-98a1-423e-8184-3cd1848415f3 nodeName:}" failed. No retries permitted until 2026-07-17 21:03:51.449972499 +0000 UTC m=+4.047655120 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4e45558-98a1-423e-8184-3cd1848415f3-original-pull-secret") pod "global-pull-secret-syncer-rwxkq" (UID: "a4e45558-98a1-423e-8184-3cd1848415f3") : object "kube-system"/"original-pull-secret" not registered Jul 17 21:03:50.450105 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:50.449941 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 21:03:50.450105 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:50.450035 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 21:03:50.450105 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:50.450048 2580 projected.go:196] Error preparing data for projected volume kube-api-access-fb4kk for pod openshift-network-diagnostics/network-check-target-rwnns: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 21:03:50.450105 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:50.450035 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c55f0556-d46b-468c-922b-364681e608cc-metrics-certs podName:c55f0556-d46b-468c-922b-364681e608cc nodeName:}" failed. No retries permitted until 2026-07-17 21:03:51.450022327 +0000 UTC m=+4.047704951 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c55f0556-d46b-468c-922b-364681e608cc-metrics-certs") pod "network-metrics-daemon-7z4zp" (UID: "c55f0556-d46b-468c-922b-364681e608cc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 21:03:50.450105 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:50.450092 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6024dec-941f-41a6-9986-808ce67207cb-kube-api-access-fb4kk podName:d6024dec-941f-41a6-9986-808ce67207cb nodeName:}" failed. No retries permitted until 2026-07-17 21:03:51.450081286 +0000 UTC m=+4.047763908 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fb4kk" (UniqueName: "kubernetes.io/projected/d6024dec-941f-41a6-9986-808ce67207cb-kube-api-access-fb4kk") pod "network-check-target-rwnns" (UID: "d6024dec-941f-41a6-9986-808ce67207cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 21:03:50.472236 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:50.472212 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbba97561_0dcd_43f6_ac53_876925d16126.slice/crio-2cce1e14734a2f307b7e10ee85a1fc13c9c2701f8519e643a79028951d5d682b WatchSource:0}: Error finding container 2cce1e14734a2f307b7e10ee85a1fc13c9c2701f8519e643a79028951d5d682b: Status 404 returned error can't find the container with id 2cce1e14734a2f307b7e10ee85a1fc13c9c2701f8519e643a79028951d5d682b Jul 17 21:03:50.527291 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:50.527269 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f3e6b5c_d932_4a7c_957b_7f0cf8991dfd.slice/crio-3dac6853ec6eeeb914bdf4ae530dd3f2b9d6134327bf53ab06bf6bb2295fe1c9 WatchSource:0}: Error finding container 3dac6853ec6eeeb914bdf4ae530dd3f2b9d6134327bf53ab06bf6bb2295fe1c9: Status 404 returned error can't find the container with id 3dac6853ec6eeeb914bdf4ae530dd3f2b9d6134327bf53ab06bf6bb2295fe1c9 Jul 17 21:03:50.533600 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:50.533581 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba506437_d762_4054_98cd_573339a34e5f.slice/crio-bbd984ed65fde81f2744a42836aa449b019440d9be84585cb15fa86338f4877d WatchSource:0}: Error finding container bbd984ed65fde81f2744a42836aa449b019440d9be84585cb15fa86338f4877d: Status 404 returned error can't find the container with id bbd984ed65fde81f2744a42836aa449b019440d9be84585cb15fa86338f4877d Jul 17 21:03:50.600449 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:50.600426 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22bb795e_5fc2_4387_93a0_c177879fddd7.slice/crio-7c62a1558461192e61d1790c62813d9ff1b7568db01c9b1c58949ce27526f0ff WatchSource:0}: Error finding container 7c62a1558461192e61d1790c62813d9ff1b7568db01c9b1c58949ce27526f0ff: Status 404 returned error can't find the container with id 7c62a1558461192e61d1790c62813d9ff1b7568db01c9b1c58949ce27526f0ff Jul 17 21:03:50.606693 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:50.606674 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebc23e94_e431_4530_a0d3_4ecd7f6e81f1.slice/crio-ea293d13d2f5d03709e237ab61b7839f4ce81b2b537b80df0e12f5b83e539a9d WatchSource:0}: Error finding container ea293d13d2f5d03709e237ab61b7839f4ce81b2b537b80df0e12f5b83e539a9d: Status 404 returned error can't find the container with id ea293d13d2f5d03709e237ab61b7839f4ce81b2b537b80df0e12f5b83e539a9d Jul 17 21:03:50.613887 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:50.613868 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod297a8395d5b8d476174e085156e9219b.slice/crio-62fb6cc2911980381d19afa3bf6f270328a87e4ffa4fb8193fb319a112559c00 WatchSource:0}: Error finding container 62fb6cc2911980381d19afa3bf6f270328a87e4ffa4fb8193fb319a112559c00: Status 404 returned error can't find the container with id 62fb6cc2911980381d19afa3bf6f270328a87e4ffa4fb8193fb319a112559c00 Jul 17 21:03:50.636799 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:50.636779 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb3851f8_584c_480e_9884_642854ae1515.slice/crio-f509877f5c744e367833d731bd21dd54e915d0736a1f828b47e17353c1579e9f WatchSource:0}: Error finding container f509877f5c744e367833d731bd21dd54e915d0736a1f828b47e17353c1579e9f: Status 404 returned error can't find the container with id f509877f5c744e367833d731bd21dd54e915d0736a1f828b47e17353c1579e9f Jul 17 21:03:50.653678 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:03:50.653654 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod547aa59b_bc0d_4eb0_9c28_1635fc1d925c.slice/crio-aec54ff52dd9761bb55e5371eabd9b0462beeaa37d2f2db3408cbded34879779 WatchSource:0}: Error finding container aec54ff52dd9761bb55e5371eabd9b0462beeaa37d2f2db3408cbded34879779: Status 404 returned error can't find the container with id aec54ff52dd9761bb55e5371eabd9b0462beeaa37d2f2db3408cbded34879779 Jul 17 21:03:50.770252 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:50.770155 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 20:58:50 +0000 UTC" deadline="2028-04-06 13:17:31.867579792 +0000 UTC" Jul 17 21:03:50.770252 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:50.770217 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15088h13m41.097365723s" Jul 17 21:03:50.861543 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:50.861486 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tv7wq" event={"ID":"eb3851f8-584c-480e-9884-642854ae1515","Type":"ContainerStarted","Data":"f509877f5c744e367833d731bd21dd54e915d0736a1f828b47e17353c1579e9f"} Jul 17 21:03:50.862949 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:50.862916 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" event={"ID":"297a8395d5b8d476174e085156e9219b","Type":"ContainerStarted","Data":"62fb6cc2911980381d19afa3bf6f270328a87e4ffa4fb8193fb319a112559c00"} Jul 17 21:03:50.864493 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:50.864468 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-68t46" event={"ID":"22bb795e-5fc2-4387-93a0-c177879fddd7","Type":"ContainerStarted","Data":"7c62a1558461192e61d1790c62813d9ff1b7568db01c9b1c58949ce27526f0ff"} Jul 17 21:03:50.865864 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:50.865840 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rc86b" event={"ID":"b789bc82-e958-4d32-b4b1-3bc92349bde3","Type":"ContainerStarted","Data":"994382a166bc717a41f9bc297b3ab9fb23ea6df6eaa3096004618c9912c08510"} Jul 17 21:03:50.867367 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:50.867335 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal" event={"ID":"8f24a48751c3182921e8a0c236d6d9a6","Type":"ContainerStarted","Data":"0bc0eb5d727b17a8d8c1a29838a553ee123ba9c610b2348210b30eae899951bf"} Jul 17 21:03:50.869420 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:50.869374 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8gbd6" event={"ID":"547aa59b-bc0d-4eb0-9c28-1635fc1d925c","Type":"ContainerStarted","Data":"aec54ff52dd9761bb55e5371eabd9b0462beeaa37d2f2db3408cbded34879779"} Jul 17 21:03:50.870859 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:50.870788 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jkpqn" event={"ID":"ebc23e94-e431-4530-a0d3-4ecd7f6e81f1","Type":"ContainerStarted","Data":"ea293d13d2f5d03709e237ab61b7839f4ce81b2b537b80df0e12f5b83e539a9d"} Jul 17 21:03:50.872112 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:50.872067 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-br6dk" event={"ID":"ba506437-d762-4054-98cd-573339a34e5f","Type":"ContainerStarted","Data":"bbd984ed65fde81f2744a42836aa449b019440d9be84585cb15fa86338f4877d"} Jul 17 21:03:50.874062 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:50.874034 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" event={"ID":"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd","Type":"ContainerStarted","Data":"3dac6853ec6eeeb914bdf4ae530dd3f2b9d6134327bf53ab06bf6bb2295fe1c9"} Jul 17 21:03:50.876549 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:50.876501 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r9wzc" event={"ID":"bba97561-0dcd-43f6-ac53-876925d16126","Type":"ContainerStarted","Data":"2cce1e14734a2f307b7e10ee85a1fc13c9c2701f8519e643a79028951d5d682b"} Jul 17 21:03:51.458037 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:51.457991 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c55f0556-d46b-468c-922b-364681e608cc-metrics-certs\") pod \"network-metrics-daemon-7z4zp\" (UID: \"c55f0556-d46b-468c-922b-364681e608cc\") " pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:03:51.458037 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:51.458043 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4e45558-98a1-423e-8184-3cd1848415f3-original-pull-secret\") pod \"global-pull-secret-syncer-rwxkq\" (UID: \"a4e45558-98a1-423e-8184-3cd1848415f3\") " pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:03:51.458862 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:51.458095 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb4kk\" (UniqueName: \"kubernetes.io/projected/d6024dec-941f-41a6-9986-808ce67207cb-kube-api-access-fb4kk\") pod \"network-check-target-rwnns\" (UID: \"d6024dec-941f-41a6-9986-808ce67207cb\") " pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:03:51.458862 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:51.458261 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 21:03:51.458862 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:51.458295 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 21:03:51.458862 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:51.458310 2580 projected.go:196] Error preparing data for projected volume kube-api-access-fb4kk for pod openshift-network-diagnostics/network-check-target-rwnns: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 21:03:51.458862 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:51.458368 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6024dec-941f-41a6-9986-808ce67207cb-kube-api-access-fb4kk podName:d6024dec-941f-41a6-9986-808ce67207cb nodeName:}" failed. No retries permitted until 2026-07-17 21:03:53.458348102 +0000 UTC m=+6.056030730 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fb4kk" (UniqueName: "kubernetes.io/projected/d6024dec-941f-41a6-9986-808ce67207cb-kube-api-access-fb4kk") pod "network-check-target-rwnns" (UID: "d6024dec-941f-41a6-9986-808ce67207cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 21:03:51.459136 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:51.459073 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 21:03:51.459136 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:51.459131 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c55f0556-d46b-468c-922b-364681e608cc-metrics-certs podName:c55f0556-d46b-468c-922b-364681e608cc nodeName:}" failed. No retries permitted until 2026-07-17 21:03:53.459113962 +0000 UTC m=+6.056796591 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c55f0556-d46b-468c-922b-364681e608cc-metrics-certs") pod "network-metrics-daemon-7z4zp" (UID: "c55f0556-d46b-468c-922b-364681e608cc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 21:03:51.459242 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:51.459198 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 21:03:51.459373 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:51.459252 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e45558-98a1-423e-8184-3cd1848415f3-original-pull-secret podName:a4e45558-98a1-423e-8184-3cd1848415f3 nodeName:}" failed. No retries permitted until 2026-07-17 21:03:53.459229837 +0000 UTC m=+6.056912459 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4e45558-98a1-423e-8184-3cd1848415f3-original-pull-secret") pod "global-pull-secret-syncer-rwxkq" (UID: "a4e45558-98a1-423e-8184-3cd1848415f3") : object "kube-system"/"original-pull-secret" not registered Jul 17 21:03:51.770739 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:51.770620 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 20:58:50 +0000 UTC" deadline="2027-12-30 08:21:43.366408888 +0000 UTC" Jul 17 21:03:51.770739 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:51.770658 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12731h17m51.595755614s" Jul 17 21:03:51.854684 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:51.854426 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:03:51.854684 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:51.854568 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7z4zp" podUID="c55f0556-d46b-468c-922b-364681e608cc" Jul 17 21:03:51.861835 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:51.860987 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:03:51.861835 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:51.861135 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwnns" podUID="d6024dec-941f-41a6-9986-808ce67207cb" Jul 17 21:03:51.861835 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:51.861226 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:03:51.861835 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:51.861355 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwxkq" podUID="a4e45558-98a1-423e-8184-3cd1848415f3" Jul 17 21:03:53.477335 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:53.476385 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c55f0556-d46b-468c-922b-364681e608cc-metrics-certs\") pod \"network-metrics-daemon-7z4zp\" (UID: \"c55f0556-d46b-468c-922b-364681e608cc\") " pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:03:53.477335 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:53.476437 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4e45558-98a1-423e-8184-3cd1848415f3-original-pull-secret\") pod \"global-pull-secret-syncer-rwxkq\" (UID: \"a4e45558-98a1-423e-8184-3cd1848415f3\") " pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:03:53.477335 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:53.476504 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb4kk\" (UniqueName: \"kubernetes.io/projected/d6024dec-941f-41a6-9986-808ce67207cb-kube-api-access-fb4kk\") pod \"network-check-target-rwnns\" (UID: \"d6024dec-941f-41a6-9986-808ce67207cb\") " pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:03:53.477335 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:53.476648 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 21:03:53.477335 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:53.476665 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 21:03:53.477335 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:53.476679 2580 projected.go:196] Error preparing data for projected volume kube-api-access-fb4kk for pod openshift-network-diagnostics/network-check-target-rwnns: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 21:03:53.477335 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:53.476742 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6024dec-941f-41a6-9986-808ce67207cb-kube-api-access-fb4kk podName:d6024dec-941f-41a6-9986-808ce67207cb nodeName:}" failed. No retries permitted until 2026-07-17 21:03:57.476722794 +0000 UTC m=+10.074405417 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fb4kk" (UniqueName: "kubernetes.io/projected/d6024dec-941f-41a6-9986-808ce67207cb-kube-api-access-fb4kk") pod "network-check-target-rwnns" (UID: "d6024dec-941f-41a6-9986-808ce67207cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 21:03:53.477335 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:53.477131 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 21:03:53.477335 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:53.477179 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c55f0556-d46b-468c-922b-364681e608cc-metrics-certs podName:c55f0556-d46b-468c-922b-364681e608cc nodeName:}" failed. No retries permitted until 2026-07-17 21:03:57.477163792 +0000 UTC m=+10.074846421 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c55f0556-d46b-468c-922b-364681e608cc-metrics-certs") pod "network-metrics-daemon-7z4zp" (UID: "c55f0556-d46b-468c-922b-364681e608cc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 21:03:53.477335 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:53.477244 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 21:03:53.477335 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:53.477296 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e45558-98a1-423e-8184-3cd1848415f3-original-pull-secret podName:a4e45558-98a1-423e-8184-3cd1848415f3 nodeName:}" failed. No retries permitted until 2026-07-17 21:03:57.47728364 +0000 UTC m=+10.074966277 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4e45558-98a1-423e-8184-3cd1848415f3-original-pull-secret") pod "global-pull-secret-syncer-rwxkq" (UID: "a4e45558-98a1-423e-8184-3cd1848415f3") : object "kube-system"/"original-pull-secret" not registered Jul 17 21:03:53.851917 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:53.851833 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:03:53.852079 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:53.851833 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:03:53.852079 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:53.851963 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwnns" podUID="d6024dec-941f-41a6-9986-808ce67207cb" Jul 17 21:03:53.852189 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:53.852079 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7z4zp" podUID="c55f0556-d46b-468c-922b-364681e608cc" Jul 17 21:03:53.852189 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:53.852127 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:03:53.852319 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:53.852229 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwxkq" podUID="a4e45558-98a1-423e-8184-3cd1848415f3" Jul 17 21:03:55.852415 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:55.852378 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:03:55.852415 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:55.852409 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:03:55.852886 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:55.852419 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:03:55.852886 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:55.852505 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7z4zp" podUID="c55f0556-d46b-468c-922b-364681e608cc" Jul 17 21:03:55.852886 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:55.852550 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwnns" podUID="d6024dec-941f-41a6-9986-808ce67207cb" Jul 17 21:03:55.852886 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:55.852620 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwxkq" podUID="a4e45558-98a1-423e-8184-3cd1848415f3" Jul 17 21:03:57.506826 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:57.506782 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb4kk\" (UniqueName: \"kubernetes.io/projected/d6024dec-941f-41a6-9986-808ce67207cb-kube-api-access-fb4kk\") pod \"network-check-target-rwnns\" (UID: \"d6024dec-941f-41a6-9986-808ce67207cb\") " pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:03:57.507343 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:57.506855 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c55f0556-d46b-468c-922b-364681e608cc-metrics-certs\") pod \"network-metrics-daemon-7z4zp\" (UID: \"c55f0556-d46b-468c-922b-364681e608cc\") " pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:03:57.507343 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:57.506883 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4e45558-98a1-423e-8184-3cd1848415f3-original-pull-secret\") pod \"global-pull-secret-syncer-rwxkq\" (UID: \"a4e45558-98a1-423e-8184-3cd1848415f3\") " pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:03:57.507343 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:57.506964 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 21:03:57.507343 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:57.506977 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 21:03:57.507343 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:57.506990 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 21:03:57.507343 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:57.507002 2580 projected.go:196] Error preparing data for projected volume kube-api-access-fb4kk for pod openshift-network-diagnostics/network-check-target-rwnns: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 21:03:57.507343 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:57.507029 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 21:03:57.507343 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:57.507049 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e45558-98a1-423e-8184-3cd1848415f3-original-pull-secret podName:a4e45558-98a1-423e-8184-3cd1848415f3 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:05.507028838 +0000 UTC m=+18.104711482 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4e45558-98a1-423e-8184-3cd1848415f3-original-pull-secret") pod "global-pull-secret-syncer-rwxkq" (UID: "a4e45558-98a1-423e-8184-3cd1848415f3") : object "kube-system"/"original-pull-secret" not registered Jul 17 21:03:57.507343 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:57.507068 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6024dec-941f-41a6-9986-808ce67207cb-kube-api-access-fb4kk podName:d6024dec-941f-41a6-9986-808ce67207cb nodeName:}" failed. No retries permitted until 2026-07-17 21:04:05.507058474 +0000 UTC m=+18.104741104 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fb4kk" (UniqueName: "kubernetes.io/projected/d6024dec-941f-41a6-9986-808ce67207cb-kube-api-access-fb4kk") pod "network-check-target-rwnns" (UID: "d6024dec-941f-41a6-9986-808ce67207cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 21:03:57.507343 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:57.507098 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c55f0556-d46b-468c-922b-364681e608cc-metrics-certs podName:c55f0556-d46b-468c-922b-364681e608cc nodeName:}" failed. No retries permitted until 2026-07-17 21:04:05.507077373 +0000 UTC m=+18.104759995 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c55f0556-d46b-468c-922b-364681e608cc-metrics-certs") pod "network-metrics-daemon-7z4zp" (UID: "c55f0556-d46b-468c-922b-364681e608cc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 21:03:57.853135 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:57.852349 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:03:57.853135 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:57.852479 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7z4zp" podUID="c55f0556-d46b-468c-922b-364681e608cc" Jul 17 21:03:57.853135 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:57.852819 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:03:57.853135 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:57.852915 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwnns" podUID="d6024dec-941f-41a6-9986-808ce67207cb" Jul 17 21:03:57.853135 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:57.852974 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:03:57.853135 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:57.853051 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwxkq" podUID="a4e45558-98a1-423e-8184-3cd1848415f3" Jul 17 21:03:59.852075 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:59.852044 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:03:59.852541 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:59.852162 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwxkq" podUID="a4e45558-98a1-423e-8184-3cd1848415f3" Jul 17 21:03:59.852541 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:59.852044 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:03:59.852987 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:59.852920 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwnns" podUID="d6024dec-941f-41a6-9986-808ce67207cb" Jul 17 21:03:59.853294 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:03:59.853275 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:03:59.854207 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:03:59.853413 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7z4zp" podUID="c55f0556-d46b-468c-922b-364681e608cc" Jul 17 21:04:01.851543 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:01.851516 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:04:01.851999 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:01.851619 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwnns" podUID="d6024dec-941f-41a6-9986-808ce67207cb" Jul 17 21:04:01.851999 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:01.851507 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:04:01.851999 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:01.851661 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:04:01.851999 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:01.851787 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7z4zp" podUID="c55f0556-d46b-468c-922b-364681e608cc" Jul 17 21:04:01.851999 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:01.851887 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwxkq" podUID="a4e45558-98a1-423e-8184-3cd1848415f3" Jul 17 21:04:03.854311 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:03.854277 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:04:03.854311 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:03.854297 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:04:03.854829 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:03.854277 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:04:03.854829 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:03.854383 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwnns" podUID="d6024dec-941f-41a6-9986-808ce67207cb" Jul 17 21:04:03.854829 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:03.854451 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwxkq" podUID="a4e45558-98a1-423e-8184-3cd1848415f3" Jul 17 21:04:03.854829 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:03.854507 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7z4zp" podUID="c55f0556-d46b-468c-922b-364681e608cc" Jul 17 21:04:05.570135 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:05.570105 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c55f0556-d46b-468c-922b-364681e608cc-metrics-certs\") pod \"network-metrics-daemon-7z4zp\" (UID: \"c55f0556-d46b-468c-922b-364681e608cc\") " pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:04:05.570135 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:05.570139 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4e45558-98a1-423e-8184-3cd1848415f3-original-pull-secret\") pod \"global-pull-secret-syncer-rwxkq\" (UID: \"a4e45558-98a1-423e-8184-3cd1848415f3\") " pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:04:05.570601 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:05.570249 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 21:04:05.570601 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:05.570292 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e45558-98a1-423e-8184-3cd1848415f3-original-pull-secret podName:a4e45558-98a1-423e-8184-3cd1848415f3 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:21.570279549 +0000 UTC m=+34.167962170 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4e45558-98a1-423e-8184-3cd1848415f3-original-pull-secret") pod "global-pull-secret-syncer-rwxkq" (UID: "a4e45558-98a1-423e-8184-3cd1848415f3") : object "kube-system"/"original-pull-secret" not registered Jul 17 21:04:05.570601 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:05.570249 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 21:04:05.570601 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:05.570370 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c55f0556-d46b-468c-922b-364681e608cc-metrics-certs podName:c55f0556-d46b-468c-922b-364681e608cc nodeName:}" failed. No retries permitted until 2026-07-17 21:04:21.570357286 +0000 UTC m=+34.168039906 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c55f0556-d46b-468c-922b-364681e608cc-metrics-certs") pod "network-metrics-daemon-7z4zp" (UID: "c55f0556-d46b-468c-922b-364681e608cc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 21:04:05.570601 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:05.570320 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb4kk\" (UniqueName: \"kubernetes.io/projected/d6024dec-941f-41a6-9986-808ce67207cb-kube-api-access-fb4kk\") pod \"network-check-target-rwnns\" (UID: \"d6024dec-941f-41a6-9986-808ce67207cb\") " pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:04:05.570601 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:05.570425 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 21:04:05.570601 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:05.570446 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 21:04:05.570601 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:05.570458 2580 projected.go:196] Error preparing data for projected volume kube-api-access-fb4kk for pod openshift-network-diagnostics/network-check-target-rwnns: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 21:04:05.570601 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:05.570506 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6024dec-941f-41a6-9986-808ce67207cb-kube-api-access-fb4kk podName:d6024dec-941f-41a6-9986-808ce67207cb nodeName:}" failed. No retries permitted until 2026-07-17 21:04:21.570493114 +0000 UTC m=+34.168175737 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fb4kk" (UniqueName: "kubernetes.io/projected/d6024dec-941f-41a6-9986-808ce67207cb-kube-api-access-fb4kk") pod "network-check-target-rwnns" (UID: "d6024dec-941f-41a6-9986-808ce67207cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 21:04:05.854919 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:05.854858 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:04:05.854919 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:05.854888 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:04:05.855097 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:05.854858 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:04:05.855097 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:05.854971 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7z4zp" podUID="c55f0556-d46b-468c-922b-364681e608cc" Jul 17 21:04:05.855097 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:05.855037 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwnns" podUID="d6024dec-941f-41a6-9986-808ce67207cb" Jul 17 21:04:05.855241 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:05.855121 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwxkq" podUID="a4e45558-98a1-423e-8184-3cd1848415f3" Jul 17 21:04:07.852827 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:07.852795 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:04:07.853279 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:07.852904 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7z4zp" podUID="c55f0556-d46b-468c-922b-364681e608cc" Jul 17 21:04:07.853279 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:07.852967 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:04:07.853279 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:07.853082 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwxkq" podUID="a4e45558-98a1-423e-8184-3cd1848415f3" Jul 17 21:04:07.853279 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:07.853124 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:04:07.853279 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:07.853208 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwnns" podUID="d6024dec-941f-41a6-9986-808ce67207cb" Jul 17 21:04:09.851694 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:09.851656 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:04:09.852073 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:09.851656 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:04:09.852073 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:09.851776 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwxkq" podUID="a4e45558-98a1-423e-8184-3cd1848415f3" Jul 17 21:04:09.852073 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:09.851656 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:04:09.852073 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:09.851874 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7z4zp" podUID="c55f0556-d46b-468c-922b-364681e608cc" Jul 17 21:04:09.852073 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:09.851909 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwnns" podUID="d6024dec-941f-41a6-9986-808ce67207cb" Jul 17 21:04:10.938312 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:10.937908 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cxh8j" event={"ID":"243ec811-8044-4a40-94a4-12034fff80c7","Type":"ContainerStarted","Data":"f6f005a81829352586dbe7f844309e58d895c52cf629e22b559044895c8cd985"} Jul 17 21:04:10.943161 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:10.943130 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-68t46" event={"ID":"22bb795e-5fc2-4387-93a0-c177879fddd7","Type":"ContainerStarted","Data":"0079596eb7b26dd822b50b3f78a62e993d51f4c225085a93ed672e89312193ce"} Jul 17 21:04:10.945247 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:10.945216 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rc86b" event={"ID":"b789bc82-e958-4d32-b4b1-3bc92349bde3","Type":"ContainerStarted","Data":"2c5108f46713ba86c2af63c5089c363cf2e0711f952ed9136368c295b639f672"} Jul 17 21:04:10.947028 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:10.947008 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal" event={"ID":"8f24a48751c3182921e8a0c236d6d9a6","Type":"ContainerStarted","Data":"f1b855913108cacd5b33a312e7979a2baedb5ee439c6d97b018d7f948a4d5e24"} Jul 17 21:04:10.949891 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:10.949800 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8gbd6" event={"ID":"547aa59b-bc0d-4eb0-9c28-1635fc1d925c","Type":"ContainerStarted","Data":"3c4aa6ee07718ba736e44d94b987f7d5b0463116170fc0522689a6944fef7103"} Jul 17 21:04:10.953417 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:10.953367 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-br6dk" event={"ID":"ba506437-d762-4054-98cd-573339a34e5f","Type":"ContainerStarted","Data":"611c834fb029197d5d25b2bacaa68d23edb698b5800aefafe07c51d2af01268e"} Jul 17 21:04:10.955137 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:10.955118 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" event={"ID":"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd","Type":"ContainerStarted","Data":"ef1ec562d522b5440d9295ed5900aeefbc4fa158d8fdc55b83e420365729ce75"} Jul 17 21:04:10.956805 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:10.956783 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r9wzc" event={"ID":"bba97561-0dcd-43f6-ac53-876925d16126","Type":"ContainerStarted","Data":"7bab3bab615a9e5c182b89ec75c713115b4e3b7e8516d07bbf587b99f1036337"} Jul 17 21:04:10.966311 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:10.966238 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-68t46" podStartSLOduration=3.525170268 podStartE2EDuration="22.966223048s" totalImagesPullingTime="19.44105278s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:10.965887032 +0000 UTC m=+23.563569675" watchObservedRunningTime="2026-07-17 21:04:10.966223048 +0000 UTC m=+23.563905692" Jul 17 21:04:11.004870 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:11.004721 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jkpqn" podStartSLOduration=3.569823324 podStartE2EDuration="23.004703061s" totalImagesPullingTime="19.434879737s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:11.003792874 +0000 UTC m=+23.601475516" watchObservedRunningTime="2026-07-17 21:04:11.004703061 +0000 UTC m=+23.602385708" Jul 17 21:04:11.021320 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:11.021271 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal" podStartSLOduration=22.021256638 podStartE2EDuration="22.021256638s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:11.02105043 +0000 UTC m=+23.618733071" watchObservedRunningTime="2026-07-17 21:04:11.021256638 +0000 UTC m=+23.618939282" Jul 17 21:04:11.038784 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:11.038739 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-br6dk" podStartSLOduration=3.531032166 podStartE2EDuration="23.038722691s" totalImagesPullingTime="19.507690525s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:11.038689815 +0000 UTC m=+23.636372459" watchObservedRunningTime="2026-07-17 21:04:11.038722691 +0000 UTC m=+23.636405336" Jul 17 21:04:11.054409 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:11.054302 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-r9wzc" podStartSLOduration=3.484028083 podStartE2EDuration="23.054286192s" totalImagesPullingTime="19.570258109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:11.053869307 +0000 UTC m=+23.651551951" watchObservedRunningTime="2026-07-17 21:04:11.054286192 +0000 UTC m=+23.651968835" Jul 17 21:04:11.852427 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:11.852244 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:04:11.852644 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:11.852260 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:04:11.852644 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:11.852497 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwxkq" podUID="a4e45558-98a1-423e-8184-3cd1848415f3" Jul 17 21:04:11.852644 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:11.852322 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:04:11.852644 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:11.852613 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7z4zp" podUID="c55f0556-d46b-468c-922b-364681e608cc" Jul 17 21:04:11.852812 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:11.852675 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwnns" podUID="d6024dec-941f-41a6-9986-808ce67207cb" Jul 17 21:04:11.959957 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:11.959924 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tv7wq" event={"ID":"eb3851f8-584c-480e-9884-642854ae1515","Type":"ContainerStarted","Data":"1709f4584b47b8575a6c9f4bb240a4839623faa031374c01b9527a1770f688e1"} Jul 17 21:04:11.961363 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:11.961337 2580 generic.go:356] "Generic (PLEG): container finished" podID="297a8395d5b8d476174e085156e9219b" containerID="7123ecaee3da51ea7483d43e23e2e518007fe73fd55eee27241f9fc78f4fff14" exitCode=0 Jul 17 21:04:11.961481 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:11.961457 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" event={"ID":"297a8395d5b8d476174e085156e9219b","Type":"ContainerDied","Data":"7123ecaee3da51ea7483d43e23e2e518007fe73fd55eee27241f9fc78f4fff14"} Jul 17 21:04:11.962798 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:11.962774 2580 generic.go:356] "Generic (PLEG): container finished" podID="547aa59b-bc0d-4eb0-9c28-1635fc1d925c" containerID="3c4aa6ee07718ba736e44d94b987f7d5b0463116170fc0522689a6944fef7103" exitCode=0 Jul 17 21:04:11.962881 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:11.962850 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8gbd6" event={"ID":"547aa59b-bc0d-4eb0-9c28-1635fc1d925c","Type":"ContainerDied","Data":"3c4aa6ee07718ba736e44d94b987f7d5b0463116170fc0522689a6944fef7103"} Jul 17 21:04:11.964301 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:11.964277 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jkpqn" event={"ID":"ebc23e94-e431-4530-a0d3-4ecd7f6e81f1","Type":"ContainerStarted","Data":"a381b2ac4afc7622c2d092381ee8cd99059e54916bb2b5c26e52abba311adefe"} Jul 17 21:04:11.966478 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:11.966464 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lj5lm_6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd/ovn-acl-logging/0.log" Jul 17 21:04:11.966756 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:11.966738 2580 generic.go:356] "Generic (PLEG): container finished" podID="6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd" containerID="6dffff850b9e84d2070b0745497b93440913183a233c818c8c1921ddc0ac6815" exitCode=1 Jul 17 21:04:11.966831 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:11.966812 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" event={"ID":"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd","Type":"ContainerStarted","Data":"3b50b6b0e86d4319e66a2324d4bd5551e96dabdc8a0445c1bf67a221e958327c"} Jul 17 21:04:11.966906 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:11.966891 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" event={"ID":"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd","Type":"ContainerStarted","Data":"898a758c3274de07317adec8a1fb3e0ba31854f712c298aa589dbf849ba5dc98"} Jul 17 21:04:11.966975 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:11.966961 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" event={"ID":"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd","Type":"ContainerStarted","Data":"e4826393c57071e1f9b39f75a1c544ce5e53e5ce51e67e3496229e98daf30a16"} Jul 17 21:04:11.967027 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:11.967015 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" event={"ID":"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd","Type":"ContainerDied","Data":"6dffff850b9e84d2070b0745497b93440913183a233c818c8c1921ddc0ac6815"} Jul 17 21:04:11.976530 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:11.976498 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tv7wq" podStartSLOduration=4.637104871 podStartE2EDuration="23.976487841s" totalImagesPullingTime="19.33938297s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:11.976485921 +0000 UTC m=+24.574168564" watchObservedRunningTime="2026-07-17 21:04:11.976487841 +0000 UTC m=+24.574170484" Jul 17 21:04:12.317815 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:12.317733 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-r9wzc" Jul 17 21:04:12.318538 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:12.318515 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-r9wzc" Jul 17 21:04:12.661075 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:12.661054 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 17 21:04:12.830008 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:12.829663 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T21:04:12.661071457Z","UUID":"04aa4e40-6500-457e-bdb7-bf18db9a768e","Handler":null,"Name":"","Endpoint":""} Jul 17 21:04:12.831200 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:12.831177 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 17 21:04:12.831321 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:12.831230 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 17 21:04:12.970803 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:12.970719 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" event={"ID":"297a8395d5b8d476174e085156e9219b","Type":"ContainerStarted","Data":"e0f0e98a9fad7e122bea4241806f71ad202ad01fdf596a4b4eed9842f631d0c6"} Jul 17 21:04:12.973000 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:12.972963 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rc86b" event={"ID":"b789bc82-e958-4d32-b4b1-3bc92349bde3","Type":"ContainerStarted","Data":"ef0aca8b0c3f9a61d2467f3ad0a54b96d994d7290176682dc843686582866d92"} Jul 17 21:04:12.976219 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:12.976150 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lj5lm_6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd/ovn-acl-logging/0.log" Jul 17 21:04:12.976668 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:12.976642 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" event={"ID":"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd","Type":"ContainerStarted","Data":"decf84409e3da81e29730b62f9fa3f410ae317fce7b95f60168bb0f4675f77ea"} Jul 17 21:04:12.978306 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:12.978278 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cxh8j" event={"ID":"243ec811-8044-4a40-94a4-12034fff80c7","Type":"ContainerStarted","Data":"35348dbd71711817faf2b7d61d9623d601f981c66979c5156bb21dda0c132932"} Jul 17 21:04:12.978739 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:12.978718 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-r9wzc" Jul 17 21:04:12.979223 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:12.979202 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-r9wzc" Jul 17 21:04:12.988510 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:12.988463 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" podStartSLOduration=23.988449351 podStartE2EDuration="23.988449351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:12.988241074 +0000 UTC m=+25.585923716" watchObservedRunningTime="2026-07-17 21:04:12.988449351 +0000 UTC m=+25.586131994" Jul 17 21:04:13.005432 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:13.005388 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cxh8j" podStartSLOduration=22.688558785 podStartE2EDuration="25.005376002s" totalImagesPullingTime="2.316817217s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:13.005246291 +0000 UTC m=+25.602928938" watchObservedRunningTime="2026-07-17 21:04:13.005376002 +0000 UTC m=+25.603058644" Jul 17 21:04:13.851608 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:13.851567 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:04:13.851877 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:13.851567 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:04:13.851877 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:13.851688 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwnns" podUID="d6024dec-941f-41a6-9986-808ce67207cb" Jul 17 21:04:13.851877 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:13.851779 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwxkq" podUID="a4e45558-98a1-423e-8184-3cd1848415f3" Jul 17 21:04:13.851877 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:13.851567 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:04:13.852124 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:13.851896 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7z4zp" podUID="c55f0556-d46b-468c-922b-364681e608cc" Jul 17 21:04:14.985477 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:14.985437 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rc86b" event={"ID":"b789bc82-e958-4d32-b4b1-3bc92349bde3","Type":"ContainerStarted","Data":"5f56684a16e3bd93f3eae4b96e5f3ed78eabd400978dbb6ba91f687b42aab4cb"} Jul 17 21:04:14.988799 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:14.988776 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lj5lm_6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd/ovn-acl-logging/0.log" Jul 17 21:04:14.989169 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:14.989147 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" event={"ID":"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd","Type":"ContainerStarted","Data":"90ccd9b6e2767ed2d3ec235e92ca1fedc8d0336355e6b50333d9f7e1d567bc8d"} Jul 17 21:04:15.005578 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:15.005526 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rc86b" podStartSLOduration=4.563794092 podStartE2EDuration="27.005506536s" totalImagesPullingTime="22.441712444s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:15.004641178 +0000 UTC m=+27.602323824" watchObservedRunningTime="2026-07-17 21:04:15.005506536 +0000 UTC m=+27.603189180" Jul 17 21:04:15.851651 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:15.851618 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:04:15.851824 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:15.851682 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:04:15.851824 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:15.851619 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:04:15.851824 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:15.851766 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwnns" podUID="d6024dec-941f-41a6-9986-808ce67207cb" Jul 17 21:04:15.851982 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:15.851874 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7z4zp" podUID="c55f0556-d46b-468c-922b-364681e608cc" Jul 17 21:04:15.851982 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:15.851953 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwxkq" podUID="a4e45558-98a1-423e-8184-3cd1848415f3" Jul 17 21:04:16.995855 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:16.995571 2580 generic.go:356] "Generic (PLEG): container finished" podID="547aa59b-bc0d-4eb0-9c28-1635fc1d925c" containerID="7b730420d34aa1961d902b238c26c0e760e6d528ca7d041259b31a1aca2c67b7" exitCode=0 Jul 17 21:04:16.996380 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:16.995638 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8gbd6" event={"ID":"547aa59b-bc0d-4eb0-9c28-1635fc1d925c","Type":"ContainerDied","Data":"7b730420d34aa1961d902b238c26c0e760e6d528ca7d041259b31a1aca2c67b7"} Jul 17 21:04:16.999201 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:16.999173 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lj5lm_6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd/ovn-acl-logging/0.log" Jul 17 21:04:16.999544 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:16.999523 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" event={"ID":"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd","Type":"ContainerStarted","Data":"cd6810c387696bf8d5e57e89b14b6e3cc34c6fe7c589a34ee4a5a3bf46291d53"} Jul 17 21:04:16.999761 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:16.999748 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:04:16.999819 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:16.999788 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:04:16.999903 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:16.999888 2580 scope.go:117] "RemoveContainer" containerID="6dffff850b9e84d2070b0745497b93440913183a233c818c8c1921ddc0ac6815" Jul 17 21:04:17.015573 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:17.015552 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:04:17.854607 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:17.854574 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:04:17.854795 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:17.854702 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7z4zp" podUID="c55f0556-d46b-468c-922b-364681e608cc" Jul 17 21:04:17.855114 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:17.855089 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:04:17.855235 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:17.855180 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwnns" podUID="d6024dec-941f-41a6-9986-808ce67207cb" Jul 17 21:04:17.855297 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:17.855256 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:04:17.855347 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:17.855327 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwxkq" podUID="a4e45558-98a1-423e-8184-3cd1848415f3" Jul 17 21:04:18.007785 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:18.007763 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lj5lm_6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd/ovn-acl-logging/0.log" Jul 17 21:04:18.008131 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:18.008083 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" event={"ID":"6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd","Type":"ContainerStarted","Data":"88b6297db9234d9deeee763f03d23d388fbacff288f3f2f812c430a9718c06b8"} Jul 17 21:04:18.008385 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:18.008364 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:04:18.022600 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:18.022578 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:04:18.047762 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:18.047717 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" podStartSLOduration=9.748693041 podStartE2EDuration="30.047705015s" totalImagesPullingTime="20.299011974s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:18.047412771 +0000 UTC m=+30.645095415" watchObservedRunningTime="2026-07-17 21:04:18.047705015 +0000 UTC m=+30.645387674" Jul 17 21:04:18.670678 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:18.670595 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7z4zp"] Jul 17 21:04:18.670863 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:18.670735 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:04:18.670920 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:18.670861 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7z4zp" podUID="c55f0556-d46b-468c-922b-364681e608cc" Jul 17 21:04:18.672703 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:18.672682 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rwxkq"] Jul 17 21:04:18.672845 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:18.672753 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:04:18.672845 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:18.672827 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwxkq" podUID="a4e45558-98a1-423e-8184-3cd1848415f3" Jul 17 21:04:18.673299 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:18.673277 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rwnns"] Jul 17 21:04:18.673396 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:18.673383 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:04:18.673491 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:18.673473 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwnns" podUID="d6024dec-941f-41a6-9986-808ce67207cb" Jul 17 21:04:19.012744 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:19.012653 2580 generic.go:356] "Generic (PLEG): container finished" podID="547aa59b-bc0d-4eb0-9c28-1635fc1d925c" containerID="0585d9d1894b31a361a94718e26bbbe646c4bb8a13c6d2e486fcb830d2f39a90" exitCode=0 Jul 17 21:04:19.013244 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:19.012741 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8gbd6" event={"ID":"547aa59b-bc0d-4eb0-9c28-1635fc1d925c","Type":"ContainerDied","Data":"0585d9d1894b31a361a94718e26bbbe646c4bb8a13c6d2e486fcb830d2f39a90"} Jul 17 21:04:20.851992 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:20.851960 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:04:20.852481 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:20.852063 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwxkq" podUID="a4e45558-98a1-423e-8184-3cd1848415f3" Jul 17 21:04:20.852481 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:20.851960 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:04:20.852481 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:20.851960 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:04:20.852481 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:20.852130 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwnns" podUID="d6024dec-941f-41a6-9986-808ce67207cb" Jul 17 21:04:20.852481 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:20.852203 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7z4zp" podUID="c55f0556-d46b-468c-922b-364681e608cc" Jul 17 21:04:21.018965 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:21.018935 2580 generic.go:356] "Generic (PLEG): container finished" podID="547aa59b-bc0d-4eb0-9c28-1635fc1d925c" containerID="b683494878faa0b8556bbc9f2bb154a6fb21710765bba41498a177ddf5ff7494" exitCode=0 Jul 17 21:04:21.019101 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:21.018976 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8gbd6" event={"ID":"547aa59b-bc0d-4eb0-9c28-1635fc1d925c","Type":"ContainerDied","Data":"b683494878faa0b8556bbc9f2bb154a6fb21710765bba41498a177ddf5ff7494"} Jul 17 21:04:21.595253 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:21.595212 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4e45558-98a1-423e-8184-3cd1848415f3-original-pull-secret\") pod \"global-pull-secret-syncer-rwxkq\" (UID: \"a4e45558-98a1-423e-8184-3cd1848415f3\") " pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:04:21.595253 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:21.595265 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb4kk\" (UniqueName: \"kubernetes.io/projected/d6024dec-941f-41a6-9986-808ce67207cb-kube-api-access-fb4kk\") pod \"network-check-target-rwnns\" (UID: \"d6024dec-941f-41a6-9986-808ce67207cb\") " pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:04:21.595456 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:21.595301 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c55f0556-d46b-468c-922b-364681e608cc-metrics-certs\") pod \"network-metrics-daemon-7z4zp\" (UID: \"c55f0556-d46b-468c-922b-364681e608cc\") " pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:04:21.595456 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:21.595346 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 21:04:21.595456 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:21.595382 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 21:04:21.595456 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:21.595402 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e45558-98a1-423e-8184-3cd1848415f3-original-pull-secret podName:a4e45558-98a1-423e-8184-3cd1848415f3 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:53.595388018 +0000 UTC m=+66.193070639 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4e45558-98a1-423e-8184-3cd1848415f3-original-pull-secret") pod "global-pull-secret-syncer-rwxkq" (UID: "a4e45558-98a1-423e-8184-3cd1848415f3") : object "kube-system"/"original-pull-secret" not registered Jul 17 21:04:21.595456 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:21.595430 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c55f0556-d46b-468c-922b-364681e608cc-metrics-certs podName:c55f0556-d46b-468c-922b-364681e608cc nodeName:}" failed. No retries permitted until 2026-07-17 21:04:53.595413319 +0000 UTC m=+66.193095943 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c55f0556-d46b-468c-922b-364681e608cc-metrics-certs") pod "network-metrics-daemon-7z4zp" (UID: "c55f0556-d46b-468c-922b-364681e608cc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 21:04:21.595456 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:21.595431 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 21:04:21.595456 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:21.595454 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 21:04:21.595688 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:21.595466 2580 projected.go:196] Error preparing data for projected volume kube-api-access-fb4kk for pod openshift-network-diagnostics/network-check-target-rwnns: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 21:04:21.595688 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:21.595498 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6024dec-941f-41a6-9986-808ce67207cb-kube-api-access-fb4kk podName:d6024dec-941f-41a6-9986-808ce67207cb nodeName:}" failed. No retries permitted until 2026-07-17 21:04:53.595489823 +0000 UTC m=+66.193172447 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fb4kk" (UniqueName: "kubernetes.io/projected/d6024dec-941f-41a6-9986-808ce67207cb-kube-api-access-fb4kk") pod "network-check-target-rwnns" (UID: "d6024dec-941f-41a6-9986-808ce67207cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 21:04:22.852055 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:22.851975 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:04:22.852055 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:22.852007 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:04:22.852055 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:22.852008 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:04:22.852579 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:22.852085 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwnns" podUID="d6024dec-941f-41a6-9986-808ce67207cb" Jul 17 21:04:22.852579 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:22.852201 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwxkq" podUID="a4e45558-98a1-423e-8184-3cd1848415f3" Jul 17 21:04:22.852579 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:22.852279 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7z4zp" podUID="c55f0556-d46b-468c-922b-364681e608cc" Jul 17 21:04:24.215690 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.215660 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeReady" Jul 17 21:04:24.216175 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.215803 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 17 21:04:24.263129 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.263095 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-975kn"] Jul 17 21:04:24.266281 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.266260 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-82mmq"] Jul 17 21:04:24.266430 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.266413 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-975kn" Jul 17 21:04:24.268854 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.268706 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 17 21:04:24.268854 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.268755 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 17 21:04:24.268854 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.268754 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nzpb7\"" Jul 17 21:04:24.269032 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.268859 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-82mmq" Jul 17 21:04:24.271820 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.271797 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4hvk8\"" Jul 17 21:04:24.271820 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.271808 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 17 21:04:24.271971 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.271831 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 17 21:04:24.272722 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.272700 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 17 21:04:24.277702 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.277683 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-82mmq"] Jul 17 21:04:24.278869 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.278845 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-975kn"] Jul 17 21:04:24.314478 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.314452 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5vxk\" (UniqueName: \"kubernetes.io/projected/caf45719-aa88-4cd5-be7b-59181000ebc4-kube-api-access-g5vxk\") pod \"dns-default-975kn\" (UID: \"caf45719-aa88-4cd5-be7b-59181000ebc4\") " pod="openshift-dns/dns-default-975kn" Jul 17 21:04:24.314587 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.314485 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27b81838-ea05-4402-8c37-3538241228db-cert\") pod \"ingress-canary-82mmq\" (UID: \"27b81838-ea05-4402-8c37-3538241228db\") " pod="openshift-ingress-canary/ingress-canary-82mmq" Jul 17 21:04:24.314587 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.314533 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/caf45719-aa88-4cd5-be7b-59181000ebc4-config-volume\") pod \"dns-default-975kn\" (UID: \"caf45719-aa88-4cd5-be7b-59181000ebc4\") " pod="openshift-dns/dns-default-975kn" Jul 17 21:04:24.314587 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.314558 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qcs2\" (UniqueName: \"kubernetes.io/projected/27b81838-ea05-4402-8c37-3538241228db-kube-api-access-8qcs2\") pod \"ingress-canary-82mmq\" (UID: \"27b81838-ea05-4402-8c37-3538241228db\") " pod="openshift-ingress-canary/ingress-canary-82mmq" Jul 17 21:04:24.314750 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.314629 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/caf45719-aa88-4cd5-be7b-59181000ebc4-tmp-dir\") pod \"dns-default-975kn\" (UID: \"caf45719-aa88-4cd5-be7b-59181000ebc4\") " pod="openshift-dns/dns-default-975kn" Jul 17 21:04:24.314750 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.314666 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/caf45719-aa88-4cd5-be7b-59181000ebc4-metrics-tls\") pod \"dns-default-975kn\" (UID: \"caf45719-aa88-4cd5-be7b-59181000ebc4\") " pod="openshift-dns/dns-default-975kn" Jul 17 21:04:24.415699 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.415620 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/caf45719-aa88-4cd5-be7b-59181000ebc4-tmp-dir\") pod \"dns-default-975kn\" (UID: \"caf45719-aa88-4cd5-be7b-59181000ebc4\") " pod="openshift-dns/dns-default-975kn" Jul 17 21:04:24.415699 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.415668 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/caf45719-aa88-4cd5-be7b-59181000ebc4-metrics-tls\") pod \"dns-default-975kn\" (UID: \"caf45719-aa88-4cd5-be7b-59181000ebc4\") " pod="openshift-dns/dns-default-975kn" Jul 17 21:04:24.415907 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.415736 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5vxk\" (UniqueName: \"kubernetes.io/projected/caf45719-aa88-4cd5-be7b-59181000ebc4-kube-api-access-g5vxk\") pod \"dns-default-975kn\" (UID: \"caf45719-aa88-4cd5-be7b-59181000ebc4\") " pod="openshift-dns/dns-default-975kn" Jul 17 21:04:24.415907 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.415765 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27b81838-ea05-4402-8c37-3538241228db-cert\") pod \"ingress-canary-82mmq\" (UID: \"27b81838-ea05-4402-8c37-3538241228db\") " pod="openshift-ingress-canary/ingress-canary-82mmq" Jul 17 21:04:24.415907 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.415808 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/caf45719-aa88-4cd5-be7b-59181000ebc4-config-volume\") pod \"dns-default-975kn\" (UID: \"caf45719-aa88-4cd5-be7b-59181000ebc4\") " pod="openshift-dns/dns-default-975kn" Jul 17 21:04:24.415907 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.415830 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qcs2\" (UniqueName: \"kubernetes.io/projected/27b81838-ea05-4402-8c37-3538241228db-kube-api-access-8qcs2\") pod \"ingress-canary-82mmq\" (UID: \"27b81838-ea05-4402-8c37-3538241228db\") " pod="openshift-ingress-canary/ingress-canary-82mmq" Jul 17 21:04:24.415907 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:24.415858 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 21:04:24.416153 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:24.415939 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf45719-aa88-4cd5-be7b-59181000ebc4-metrics-tls podName:caf45719-aa88-4cd5-be7b-59181000ebc4 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:24.915916678 +0000 UTC m=+37.513599322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/caf45719-aa88-4cd5-be7b-59181000ebc4-metrics-tls") pod "dns-default-975kn" (UID: "caf45719-aa88-4cd5-be7b-59181000ebc4") : secret "dns-default-metrics-tls" not found Jul 17 21:04:24.416153 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.415962 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/caf45719-aa88-4cd5-be7b-59181000ebc4-tmp-dir\") pod \"dns-default-975kn\" (UID: \"caf45719-aa88-4cd5-be7b-59181000ebc4\") " pod="openshift-dns/dns-default-975kn" Jul 17 21:04:24.416507 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.416481 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/caf45719-aa88-4cd5-be7b-59181000ebc4-config-volume\") pod \"dns-default-975kn\" (UID: \"caf45719-aa88-4cd5-be7b-59181000ebc4\") " pod="openshift-dns/dns-default-975kn" Jul 17 21:04:24.420745 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.420597 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27b81838-ea05-4402-8c37-3538241228db-cert\") pod \"ingress-canary-82mmq\" (UID: \"27b81838-ea05-4402-8c37-3538241228db\") " pod="openshift-ingress-canary/ingress-canary-82mmq" Jul 17 21:04:24.427113 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.427095 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5vxk\" (UniqueName: \"kubernetes.io/projected/caf45719-aa88-4cd5-be7b-59181000ebc4-kube-api-access-g5vxk\") pod \"dns-default-975kn\" (UID: \"caf45719-aa88-4cd5-be7b-59181000ebc4\") " pod="openshift-dns/dns-default-975kn" Jul 17 21:04:24.427371 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.427350 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qcs2\" (UniqueName: \"kubernetes.io/projected/27b81838-ea05-4402-8c37-3538241228db-kube-api-access-8qcs2\") pod \"ingress-canary-82mmq\" (UID: \"27b81838-ea05-4402-8c37-3538241228db\") " pod="openshift-ingress-canary/ingress-canary-82mmq" Jul 17 21:04:24.586563 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.586526 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-82mmq" Jul 17 21:04:24.735202 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.735137 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-82mmq"] Jul 17 21:04:24.740045 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:04:24.740017 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27b81838_ea05_4402_8c37_3538241228db.slice/crio-a02228aec4e3474a37b5b7ee345587840cbacd2a7c62e7ea096e96c2f448238f WatchSource:0}: Error finding container a02228aec4e3474a37b5b7ee345587840cbacd2a7c62e7ea096e96c2f448238f: Status 404 returned error can't find the container with id a02228aec4e3474a37b5b7ee345587840cbacd2a7c62e7ea096e96c2f448238f Jul 17 21:04:24.851836 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.851800 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:04:24.851836 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.851822 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:04:24.852031 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.851832 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:04:24.855069 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.855048 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 21:04:24.855178 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.855050 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pkggp\"" Jul 17 21:04:24.855784 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.855762 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 21:04:24.855895 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.855800 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5j5fp\"" Jul 17 21:04:24.855961 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.855932 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 17 21:04:24.856058 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.856036 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 17 21:04:24.919923 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:24.919894 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/caf45719-aa88-4cd5-be7b-59181000ebc4-metrics-tls\") pod \"dns-default-975kn\" (UID: \"caf45719-aa88-4cd5-be7b-59181000ebc4\") " pod="openshift-dns/dns-default-975kn" Jul 17 21:04:24.920044 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:24.920005 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 21:04:24.920097 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:24.920075 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf45719-aa88-4cd5-be7b-59181000ebc4-metrics-tls podName:caf45719-aa88-4cd5-be7b-59181000ebc4 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:25.920057419 +0000 UTC m=+38.517740056 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/caf45719-aa88-4cd5-be7b-59181000ebc4-metrics-tls") pod "dns-default-975kn" (UID: "caf45719-aa88-4cd5-be7b-59181000ebc4") : secret "dns-default-metrics-tls" not found Jul 17 21:04:25.029215 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:25.029101 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-82mmq" event={"ID":"27b81838-ea05-4402-8c37-3538241228db","Type":"ContainerStarted","Data":"a02228aec4e3474a37b5b7ee345587840cbacd2a7c62e7ea096e96c2f448238f"} Jul 17 21:04:25.928455 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:25.928409 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/caf45719-aa88-4cd5-be7b-59181000ebc4-metrics-tls\") pod \"dns-default-975kn\" (UID: \"caf45719-aa88-4cd5-be7b-59181000ebc4\") " pod="openshift-dns/dns-default-975kn" Jul 17 21:04:25.928887 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:25.928569 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 21:04:25.928887 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:25.928642 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf45719-aa88-4cd5-be7b-59181000ebc4-metrics-tls podName:caf45719-aa88-4cd5-be7b-59181000ebc4 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:27.928619293 +0000 UTC m=+40.526301929 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/caf45719-aa88-4cd5-be7b-59181000ebc4-metrics-tls") pod "dns-default-975kn" (UID: "caf45719-aa88-4cd5-be7b-59181000ebc4") : secret "dns-default-metrics-tls" not found Jul 17 21:04:27.036822 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:27.036791 2580 generic.go:356] "Generic (PLEG): container finished" podID="547aa59b-bc0d-4eb0-9c28-1635fc1d925c" containerID="8151a82728056414af48c565ca874db84ea934be585de7b7999ec35f4a22c612" exitCode=0 Jul 17 21:04:27.037288 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:27.036863 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8gbd6" event={"ID":"547aa59b-bc0d-4eb0-9c28-1635fc1d925c","Type":"ContainerDied","Data":"8151a82728056414af48c565ca874db84ea934be585de7b7999ec35f4a22c612"} Jul 17 21:04:27.944356 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:27.944326 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/caf45719-aa88-4cd5-be7b-59181000ebc4-metrics-tls\") pod \"dns-default-975kn\" (UID: \"caf45719-aa88-4cd5-be7b-59181000ebc4\") " pod="openshift-dns/dns-default-975kn" Jul 17 21:04:27.944532 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:27.944446 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 21:04:27.944532 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:27.944510 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf45719-aa88-4cd5-be7b-59181000ebc4-metrics-tls podName:caf45719-aa88-4cd5-be7b-59181000ebc4 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:31.944488736 +0000 UTC m=+44.542171359 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/caf45719-aa88-4cd5-be7b-59181000ebc4-metrics-tls") pod "dns-default-975kn" (UID: "caf45719-aa88-4cd5-be7b-59181000ebc4") : secret "dns-default-metrics-tls" not found Jul 17 21:04:28.043533 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:28.043499 2580 generic.go:356] "Generic (PLEG): container finished" podID="547aa59b-bc0d-4eb0-9c28-1635fc1d925c" containerID="639bb9fd24bb5b73ad157e75dbd2b88567f552b44f1f7e423da19eb436c16549" exitCode=0 Jul 17 21:04:28.044043 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:28.043543 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8gbd6" event={"ID":"547aa59b-bc0d-4eb0-9c28-1635fc1d925c","Type":"ContainerDied","Data":"639bb9fd24bb5b73ad157e75dbd2b88567f552b44f1f7e423da19eb436c16549"} Jul 17 21:04:29.047795 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:29.047758 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-82mmq" event={"ID":"27b81838-ea05-4402-8c37-3538241228db","Type":"ContainerStarted","Data":"76f3ee1ce3bf45e2913fe734af212497865fd22ce6b2825254c803347c97ca2c"} Jul 17 21:04:29.050937 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:29.050913 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8gbd6" event={"ID":"547aa59b-bc0d-4eb0-9c28-1635fc1d925c","Type":"ContainerStarted","Data":"777a140867502cd7d72683f853b439b1f58d69b95ca3560d12c1826d877f2cdd"} Jul 17 21:04:29.084784 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:29.084739 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-82mmq" podStartSLOduration=1.410471164 podStartE2EDuration="5.084726102s" totalImagesPullingTime="3.674254938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:04:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:29.084125895 +0000 UTC m=+41.681808538" watchObservedRunningTime="2026-07-17 21:04:29.084726102 +0000 UTC m=+41.682408815" Jul 17 21:04:29.140952 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:29.140911 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8gbd6" podStartSLOduration=9.863861149 podStartE2EDuration="41.140896632s" totalImagesPullingTime="31.277035483s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:29.13999769 +0000 UTC m=+41.737680333" watchObservedRunningTime="2026-07-17 21:04:29.140896632 +0000 UTC m=+41.738579275" Jul 17 21:04:31.969530 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:31.969492 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/caf45719-aa88-4cd5-be7b-59181000ebc4-metrics-tls\") pod \"dns-default-975kn\" (UID: \"caf45719-aa88-4cd5-be7b-59181000ebc4\") " pod="openshift-dns/dns-default-975kn" Jul 17 21:04:31.969909 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:31.969621 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 21:04:31.969909 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:31.969673 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf45719-aa88-4cd5-be7b-59181000ebc4-metrics-tls podName:caf45719-aa88-4cd5-be7b-59181000ebc4 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:39.969659814 +0000 UTC m=+52.567342435 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/caf45719-aa88-4cd5-be7b-59181000ebc4-metrics-tls") pod "dns-default-975kn" (UID: "caf45719-aa88-4cd5-be7b-59181000ebc4") : secret "dns-default-metrics-tls" not found Jul 17 21:04:32.324072 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.324041 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-bk9fq"] Jul 17 21:04:32.352848 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.352821 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-bk9fq"] Jul 17 21:04:32.352961 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.352913 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-bk9fq" Jul 17 21:04:32.355855 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.355833 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 17 21:04:32.356508 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.356427 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-fb6pw\"" Jul 17 21:04:32.357079 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.357058 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 17 21:04:32.357261 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.357240 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 17 21:04:32.357961 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.357778 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 17 21:04:32.363831 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.363812 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 17 21:04:32.372181 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.372158 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c7148bac-9a70-453b-a952-2a7a5e4a0ea6-serving-cert\") pod \"console-operator-565b7b569d-bk9fq\" (UID: \"c7148bac-9a70-453b-a952-2a7a5e4a0ea6\") " pod="openshift-console-operator/console-operator-565b7b569d-bk9fq" Jul 17 21:04:32.372289 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.372255 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc9xx\" (UniqueName: \"kubernetes.io/projected/c7148bac-9a70-453b-a952-2a7a5e4a0ea6-kube-api-access-xc9xx\") pod \"console-operator-565b7b569d-bk9fq\" (UID: \"c7148bac-9a70-453b-a952-2a7a5e4a0ea6\") " pod="openshift-console-operator/console-operator-565b7b569d-bk9fq" Jul 17 21:04:32.372352 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.372289 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c7148bac-9a70-453b-a952-2a7a5e4a0ea6-trusted-ca\") pod \"console-operator-565b7b569d-bk9fq\" (UID: \"c7148bac-9a70-453b-a952-2a7a5e4a0ea6\") " pod="openshift-console-operator/console-operator-565b7b569d-bk9fq" Jul 17 21:04:32.372404 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.372360 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c7148bac-9a70-453b-a952-2a7a5e4a0ea6-config\") pod \"console-operator-565b7b569d-bk9fq\" (UID: \"c7148bac-9a70-453b-a952-2a7a5e4a0ea6\") " pod="openshift-console-operator/console-operator-565b7b569d-bk9fq" Jul 17 21:04:32.439884 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.439852 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-s6nd9"] Jul 17 21:04:32.458276 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.458250 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-jww4g"] Jul 17 21:04:32.458393 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.458369 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-s6nd9" Jul 17 21:04:32.460977 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.460958 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 17 21:04:32.460977 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.460971 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 17 21:04:32.461124 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.460959 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-vpqsc\"" Jul 17 21:04:32.473409 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.473390 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmkzb\" (UniqueName: \"kubernetes.io/projected/9d5f3a68-9243-4c4d-967c-d43498c8a1e9-kube-api-access-zmkzb\") pod \"volume-data-source-validator-78cf4c6f6-s6nd9\" (UID: \"9d5f3a68-9243-4c4d-967c-d43498c8a1e9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-s6nd9" Jul 17 21:04:32.473511 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.473422 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c7148bac-9a70-453b-a952-2a7a5e4a0ea6-serving-cert\") pod \"console-operator-565b7b569d-bk9fq\" (UID: \"c7148bac-9a70-453b-a952-2a7a5e4a0ea6\") " pod="openshift-console-operator/console-operator-565b7b569d-bk9fq" Jul 17 21:04:32.473621 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.473598 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc9xx\" (UniqueName: \"kubernetes.io/projected/c7148bac-9a70-453b-a952-2a7a5e4a0ea6-kube-api-access-xc9xx\") pod \"console-operator-565b7b569d-bk9fq\" (UID: \"c7148bac-9a70-453b-a952-2a7a5e4a0ea6\") " pod="openshift-console-operator/console-operator-565b7b569d-bk9fq" Jul 17 21:04:32.473693 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.473649 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c7148bac-9a70-453b-a952-2a7a5e4a0ea6-trusted-ca\") pod \"console-operator-565b7b569d-bk9fq\" (UID: \"c7148bac-9a70-453b-a952-2a7a5e4a0ea6\") " pod="openshift-console-operator/console-operator-565b7b569d-bk9fq" Jul 17 21:04:32.473693 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.473683 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c7148bac-9a70-453b-a952-2a7a5e4a0ea6-config\") pod \"console-operator-565b7b569d-bk9fq\" (UID: \"c7148bac-9a70-453b-a952-2a7a5e4a0ea6\") " pod="openshift-console-operator/console-operator-565b7b569d-bk9fq" Jul 17 21:04:32.474471 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.474451 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c7148bac-9a70-453b-a952-2a7a5e4a0ea6-config\") pod \"console-operator-565b7b569d-bk9fq\" (UID: \"c7148bac-9a70-453b-a952-2a7a5e4a0ea6\") " pod="openshift-console-operator/console-operator-565b7b569d-bk9fq" Jul 17 21:04:32.474893 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.474876 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c7148bac-9a70-453b-a952-2a7a5e4a0ea6-trusted-ca\") pod \"console-operator-565b7b569d-bk9fq\" (UID: \"c7148bac-9a70-453b-a952-2a7a5e4a0ea6\") " pod="openshift-console-operator/console-operator-565b7b569d-bk9fq" Jul 17 21:04:32.477321 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.477304 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c7148bac-9a70-453b-a952-2a7a5e4a0ea6-serving-cert\") pod \"console-operator-565b7b569d-bk9fq\" (UID: \"c7148bac-9a70-453b-a952-2a7a5e4a0ea6\") " pod="openshift-console-operator/console-operator-565b7b569d-bk9fq" Jul 17 21:04:32.484090 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.484063 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc9xx\" (UniqueName: \"kubernetes.io/projected/c7148bac-9a70-453b-a952-2a7a5e4a0ea6-kube-api-access-xc9xx\") pod \"console-operator-565b7b569d-bk9fq\" (UID: \"c7148bac-9a70-453b-a952-2a7a5e4a0ea6\") " pod="openshift-console-operator/console-operator-565b7b569d-bk9fq" Jul 17 21:04:32.486394 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.486373 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-s6nd9"] Jul 17 21:04:32.486456 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.486415 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-jww4g"] Jul 17 21:04:32.486506 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.486488 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-jww4g" Jul 17 21:04:32.489785 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.489770 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 17 21:04:32.489865 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.489806 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-vbcgg\"" Jul 17 21:04:32.490315 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.490299 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 17 21:04:32.490876 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.490863 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 17 21:04:32.490876 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.490870 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 17 21:04:32.496771 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.496755 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 17 21:04:32.574778 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.574711 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/804719d7-515b-43b2-b9c3-06ca4f9108c0-service-ca-bundle\") pod \"insights-operator-555d9d7885-jww4g\" (UID: \"804719d7-515b-43b2-b9c3-06ca4f9108c0\") " pod="openshift-insights/insights-operator-555d9d7885-jww4g" Jul 17 21:04:32.574864 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.574771 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/804719d7-515b-43b2-b9c3-06ca4f9108c0-snapshots\") pod \"insights-operator-555d9d7885-jww4g\" (UID: \"804719d7-515b-43b2-b9c3-06ca4f9108c0\") " pod="openshift-insights/insights-operator-555d9d7885-jww4g" Jul 17 21:04:32.574864 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.574846 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/804719d7-515b-43b2-b9c3-06ca4f9108c0-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-jww4g\" (UID: \"804719d7-515b-43b2-b9c3-06ca4f9108c0\") " pod="openshift-insights/insights-operator-555d9d7885-jww4g" Jul 17 21:04:32.574934 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.574885 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/804719d7-515b-43b2-b9c3-06ca4f9108c0-serving-cert\") pod \"insights-operator-555d9d7885-jww4g\" (UID: \"804719d7-515b-43b2-b9c3-06ca4f9108c0\") " pod="openshift-insights/insights-operator-555d9d7885-jww4g" Jul 17 21:04:32.574964 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.574939 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vltx5\" (UniqueName: \"kubernetes.io/projected/804719d7-515b-43b2-b9c3-06ca4f9108c0-kube-api-access-vltx5\") pod \"insights-operator-555d9d7885-jww4g\" (UID: \"804719d7-515b-43b2-b9c3-06ca4f9108c0\") " pod="openshift-insights/insights-operator-555d9d7885-jww4g" Jul 17 21:04:32.574993 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.574964 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmkzb\" (UniqueName: \"kubernetes.io/projected/9d5f3a68-9243-4c4d-967c-d43498c8a1e9-kube-api-access-zmkzb\") pod \"volume-data-source-validator-78cf4c6f6-s6nd9\" (UID: \"9d5f3a68-9243-4c4d-967c-d43498c8a1e9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-s6nd9" Jul 17 21:04:32.574993 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.574982 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/804719d7-515b-43b2-b9c3-06ca4f9108c0-tmp\") pod \"insights-operator-555d9d7885-jww4g\" (UID: \"804719d7-515b-43b2-b9c3-06ca4f9108c0\") " pod="openshift-insights/insights-operator-555d9d7885-jww4g" Jul 17 21:04:32.584718 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.584693 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmkzb\" (UniqueName: \"kubernetes.io/projected/9d5f3a68-9243-4c4d-967c-d43498c8a1e9-kube-api-access-zmkzb\") pod \"volume-data-source-validator-78cf4c6f6-s6nd9\" (UID: \"9d5f3a68-9243-4c4d-967c-d43498c8a1e9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-s6nd9" Jul 17 21:04:32.663713 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.663693 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-bk9fq" Jul 17 21:04:32.676149 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.676130 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/804719d7-515b-43b2-b9c3-06ca4f9108c0-snapshots\") pod \"insights-operator-555d9d7885-jww4g\" (UID: \"804719d7-515b-43b2-b9c3-06ca4f9108c0\") " pod="openshift-insights/insights-operator-555d9d7885-jww4g" Jul 17 21:04:32.676236 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.676161 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/804719d7-515b-43b2-b9c3-06ca4f9108c0-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-jww4g\" (UID: \"804719d7-515b-43b2-b9c3-06ca4f9108c0\") " pod="openshift-insights/insights-operator-555d9d7885-jww4g" Jul 17 21:04:32.676236 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.676177 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/804719d7-515b-43b2-b9c3-06ca4f9108c0-serving-cert\") pod \"insights-operator-555d9d7885-jww4g\" (UID: \"804719d7-515b-43b2-b9c3-06ca4f9108c0\") " pod="openshift-insights/insights-operator-555d9d7885-jww4g" Jul 17 21:04:32.676303 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.676236 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vltx5\" (UniqueName: \"kubernetes.io/projected/804719d7-515b-43b2-b9c3-06ca4f9108c0-kube-api-access-vltx5\") pod \"insights-operator-555d9d7885-jww4g\" (UID: \"804719d7-515b-43b2-b9c3-06ca4f9108c0\") " pod="openshift-insights/insights-operator-555d9d7885-jww4g" Jul 17 21:04:32.676303 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.676258 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/804719d7-515b-43b2-b9c3-06ca4f9108c0-tmp\") pod \"insights-operator-555d9d7885-jww4g\" (UID: \"804719d7-515b-43b2-b9c3-06ca4f9108c0\") " pod="openshift-insights/insights-operator-555d9d7885-jww4g" Jul 17 21:04:32.676380 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.676300 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/804719d7-515b-43b2-b9c3-06ca4f9108c0-service-ca-bundle\") pod \"insights-operator-555d9d7885-jww4g\" (UID: \"804719d7-515b-43b2-b9c3-06ca4f9108c0\") " pod="openshift-insights/insights-operator-555d9d7885-jww4g" Jul 17 21:04:32.676826 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.676799 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/804719d7-515b-43b2-b9c3-06ca4f9108c0-tmp\") pod \"insights-operator-555d9d7885-jww4g\" (UID: \"804719d7-515b-43b2-b9c3-06ca4f9108c0\") " pod="openshift-insights/insights-operator-555d9d7885-jww4g" Jul 17 21:04:32.676917 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.676899 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/804719d7-515b-43b2-b9c3-06ca4f9108c0-snapshots\") pod \"insights-operator-555d9d7885-jww4g\" (UID: \"804719d7-515b-43b2-b9c3-06ca4f9108c0\") " pod="openshift-insights/insights-operator-555d9d7885-jww4g" Jul 17 21:04:32.676973 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.676919 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/804719d7-515b-43b2-b9c3-06ca4f9108c0-service-ca-bundle\") pod \"insights-operator-555d9d7885-jww4g\" (UID: \"804719d7-515b-43b2-b9c3-06ca4f9108c0\") " pod="openshift-insights/insights-operator-555d9d7885-jww4g" Jul 17 21:04:32.677510 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.677489 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/804719d7-515b-43b2-b9c3-06ca4f9108c0-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-jww4g\" (UID: \"804719d7-515b-43b2-b9c3-06ca4f9108c0\") " pod="openshift-insights/insights-operator-555d9d7885-jww4g" Jul 17 21:04:32.678419 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.678403 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/804719d7-515b-43b2-b9c3-06ca4f9108c0-serving-cert\") pod \"insights-operator-555d9d7885-jww4g\" (UID: \"804719d7-515b-43b2-b9c3-06ca4f9108c0\") " pod="openshift-insights/insights-operator-555d9d7885-jww4g" Jul 17 21:04:32.685972 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.685951 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vltx5\" (UniqueName: \"kubernetes.io/projected/804719d7-515b-43b2-b9c3-06ca4f9108c0-kube-api-access-vltx5\") pod \"insights-operator-555d9d7885-jww4g\" (UID: \"804719d7-515b-43b2-b9c3-06ca4f9108c0\") " pod="openshift-insights/insights-operator-555d9d7885-jww4g" Jul 17 21:04:32.767380 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.767350 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-s6nd9" Jul 17 21:04:32.795773 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.795751 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-jww4g" Jul 17 21:04:32.811400 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.811237 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-bk9fq"] Jul 17 21:04:32.813977 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:04:32.813950 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7148bac_9a70_453b_a952_2a7a5e4a0ea6.slice/crio-bf4a77a81bdaa443d46acf7a11b0d1fb2697176708a73b269a4847f498fc7191 WatchSource:0}: Error finding container bf4a77a81bdaa443d46acf7a11b0d1fb2697176708a73b269a4847f498fc7191: Status 404 returned error can't find the container with id bf4a77a81bdaa443d46acf7a11b0d1fb2697176708a73b269a4847f498fc7191 Jul 17 21:04:32.953954 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.953923 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-s6nd9"] Jul 17 21:04:32.957955 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:04:32.957931 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d5f3a68_9243_4c4d_967c_d43498c8a1e9.slice/crio-f83b02b63c32d290b690dc51643dc32e38e60160caf1bba266d1657691678968 WatchSource:0}: Error finding container f83b02b63c32d290b690dc51643dc32e38e60160caf1bba266d1657691678968: Status 404 returned error can't find the container with id f83b02b63c32d290b690dc51643dc32e38e60160caf1bba266d1657691678968 Jul 17 21:04:32.971939 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:32.971917 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-jww4g"] Jul 17 21:04:32.975060 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:04:32.975037 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod804719d7_515b_43b2_b9c3_06ca4f9108c0.slice/crio-00df6dfd395d75274b1b67d31df0100b2b6c8186f3acf15409b6bdbba77cff19 WatchSource:0}: Error finding container 00df6dfd395d75274b1b67d31df0100b2b6c8186f3acf15409b6bdbba77cff19: Status 404 returned error can't find the container with id 00df6dfd395d75274b1b67d31df0100b2b6c8186f3acf15409b6bdbba77cff19 Jul 17 21:04:33.062000 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:33.061966 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-jww4g" event={"ID":"804719d7-515b-43b2-b9c3-06ca4f9108c0","Type":"ContainerStarted","Data":"00df6dfd395d75274b1b67d31df0100b2b6c8186f3acf15409b6bdbba77cff19"} Jul 17 21:04:33.063012 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:33.062987 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-bk9fq" event={"ID":"c7148bac-9a70-453b-a952-2a7a5e4a0ea6","Type":"ContainerStarted","Data":"bf4a77a81bdaa443d46acf7a11b0d1fb2697176708a73b269a4847f498fc7191"} Jul 17 21:04:33.063976 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:33.063954 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-s6nd9" event={"ID":"9d5f3a68-9243-4c4d-967c-d43498c8a1e9","Type":"ContainerStarted","Data":"f83b02b63c32d290b690dc51643dc32e38e60160caf1bba266d1657691678968"} Jul 17 21:04:34.106861 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.106825 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5879d7dbf6-6rrr8"] Jul 17 21:04:34.135494 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.135462 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5879d7dbf6-6rrr8"] Jul 17 21:04:34.135627 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.135595 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:04:34.138645 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.138458 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gp6nq\"" Jul 17 21:04:34.138645 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.138541 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 17 21:04:34.138645 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.138571 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 17 21:04:34.138876 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.138700 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 17 21:04:34.143861 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.143840 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 17 21:04:34.189664 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.189524 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bba29410-5b7f-4187-8a11-91b4185cddbb-trusted-ca\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:04:34.189664 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.189645 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bba29410-5b7f-4187-8a11-91b4185cddbb-image-registry-private-configuration\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:04:34.189838 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.189699 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bba29410-5b7f-4187-8a11-91b4185cddbb-ca-trust-extracted\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:04:34.189838 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.189724 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-certificates\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:04:34.189838 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.189771 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tc7b\" (UniqueName: \"kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-kube-api-access-9tc7b\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:04:34.189989 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.189838 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-bound-sa-token\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:04:34.189989 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.189874 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-tls\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:04:34.189989 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.189897 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bba29410-5b7f-4187-8a11-91b4185cddbb-installation-pull-secrets\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:04:34.291034 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.291000 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bba29410-5b7f-4187-8a11-91b4185cddbb-image-registry-private-configuration\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:04:34.291207 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.291062 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bba29410-5b7f-4187-8a11-91b4185cddbb-ca-trust-extracted\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:04:34.291207 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.291091 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-certificates\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:04:34.291207 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.291131 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tc7b\" (UniqueName: \"kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-kube-api-access-9tc7b\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:04:34.291207 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.291161 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-bound-sa-token\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:04:34.291407 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.291206 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-tls\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:04:34.291407 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.291234 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bba29410-5b7f-4187-8a11-91b4185cddbb-installation-pull-secrets\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:04:34.291407 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.291310 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bba29410-5b7f-4187-8a11-91b4185cddbb-trusted-ca\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:04:34.291564 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:34.291471 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 21:04:34.291564 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:34.291492 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5879d7dbf6-6rrr8: secret "image-registry-tls" not found Jul 17 21:04:34.291564 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.291509 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bba29410-5b7f-4187-8a11-91b4185cddbb-ca-trust-extracted\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:04:34.291564 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:34.291550 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-tls podName:bba29410-5b7f-4187-8a11-91b4185cddbb nodeName:}" failed. No retries permitted until 2026-07-17 21:04:34.791528418 +0000 UTC m=+47.389211040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-tls") pod "image-registry-5879d7dbf6-6rrr8" (UID: "bba29410-5b7f-4187-8a11-91b4185cddbb") : secret "image-registry-tls" not found Jul 17 21:04:34.292127 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.292096 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-certificates\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:04:34.292471 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.292449 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bba29410-5b7f-4187-8a11-91b4185cddbb-trusted-ca\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:04:34.294313 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.294289 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bba29410-5b7f-4187-8a11-91b4185cddbb-installation-pull-secrets\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:04:34.294402 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.294323 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bba29410-5b7f-4187-8a11-91b4185cddbb-image-registry-private-configuration\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:04:34.300622 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.300579 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-bound-sa-token\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:04:34.300842 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.300818 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tc7b\" (UniqueName: \"kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-kube-api-access-9tc7b\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:04:34.794473 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:34.794428 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-tls\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:04:34.794650 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:34.794603 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 21:04:34.794650 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:34.794624 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5879d7dbf6-6rrr8: secret "image-registry-tls" not found Jul 17 21:04:34.794755 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:34.794697 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-tls podName:bba29410-5b7f-4187-8a11-91b4185cddbb nodeName:}" failed. No retries permitted until 2026-07-17 21:04:35.794673937 +0000 UTC m=+48.392356557 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-tls") pod "image-registry-5879d7dbf6-6rrr8" (UID: "bba29410-5b7f-4187-8a11-91b4185cddbb") : secret "image-registry-tls" not found Jul 17 21:04:35.803923 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:35.803889 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-tls\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:04:35.804279 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:35.803997 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 21:04:35.804279 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:35.804008 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5879d7dbf6-6rrr8: secret "image-registry-tls" not found Jul 17 21:04:35.804279 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:35.804058 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-tls podName:bba29410-5b7f-4187-8a11-91b4185cddbb nodeName:}" failed. No retries permitted until 2026-07-17 21:04:37.804045115 +0000 UTC m=+50.401727736 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-tls") pod "image-registry-5879d7dbf6-6rrr8" (UID: "bba29410-5b7f-4187-8a11-91b4185cddbb") : secret "image-registry-tls" not found Jul 17 21:04:36.284727 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:36.284701 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlfvd"] Jul 17 21:04:36.320866 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:36.320843 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlfvd"] Jul 17 21:04:36.321061 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:36.320952 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlfvd" Jul 17 21:04:36.328666 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:36.328621 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 17 21:04:36.328666 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:36.328622 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 17 21:04:36.329315 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:36.329286 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 17 21:04:36.330325 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:36.330130 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-cqj2w\"" Jul 17 21:04:36.330634 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:36.330415 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 17 21:04:36.408317 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:36.408263 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c9ee56af-87eb-42ae-bf0b-96477c5a90cb-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-tlfvd\" (UID: \"c9ee56af-87eb-42ae-bf0b-96477c5a90cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlfvd" Jul 17 21:04:36.408399 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:36.408373 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c9ee56af-87eb-42ae-bf0b-96477c5a90cb-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-tlfvd\" (UID: \"c9ee56af-87eb-42ae-bf0b-96477c5a90cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlfvd" Jul 17 21:04:36.408440 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:36.408401 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r6jg\" (UniqueName: \"kubernetes.io/projected/c9ee56af-87eb-42ae-bf0b-96477c5a90cb-kube-api-access-5r6jg\") pod \"kube-storage-version-migrator-operator-7658d9b749-tlfvd\" (UID: \"c9ee56af-87eb-42ae-bf0b-96477c5a90cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlfvd" Jul 17 21:04:36.509577 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:36.509548 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c9ee56af-87eb-42ae-bf0b-96477c5a90cb-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-tlfvd\" (UID: \"c9ee56af-87eb-42ae-bf0b-96477c5a90cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlfvd" Jul 17 21:04:36.509712 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:36.509581 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r6jg\" (UniqueName: \"kubernetes.io/projected/c9ee56af-87eb-42ae-bf0b-96477c5a90cb-kube-api-access-5r6jg\") pod \"kube-storage-version-migrator-operator-7658d9b749-tlfvd\" (UID: \"c9ee56af-87eb-42ae-bf0b-96477c5a90cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlfvd" Jul 17 21:04:36.509712 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:36.509621 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c9ee56af-87eb-42ae-bf0b-96477c5a90cb-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-tlfvd\" (UID: \"c9ee56af-87eb-42ae-bf0b-96477c5a90cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlfvd" Jul 17 21:04:36.510132 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:36.510110 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c9ee56af-87eb-42ae-bf0b-96477c5a90cb-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-tlfvd\" (UID: \"c9ee56af-87eb-42ae-bf0b-96477c5a90cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlfvd" Jul 17 21:04:36.511862 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:36.511835 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c9ee56af-87eb-42ae-bf0b-96477c5a90cb-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-tlfvd\" (UID: \"c9ee56af-87eb-42ae-bf0b-96477c5a90cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlfvd" Jul 17 21:04:36.518493 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:36.518473 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r6jg\" (UniqueName: \"kubernetes.io/projected/c9ee56af-87eb-42ae-bf0b-96477c5a90cb-kube-api-access-5r6jg\") pod \"kube-storage-version-migrator-operator-7658d9b749-tlfvd\" (UID: \"c9ee56af-87eb-42ae-bf0b-96477c5a90cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlfvd" Jul 17 21:04:36.635928 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:36.635896 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlfvd" Jul 17 21:04:36.776703 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:36.776671 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlfvd"] Jul 17 21:04:36.781096 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:04:36.781071 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9ee56af_87eb_42ae_bf0b_96477c5a90cb.slice/crio-d06964cc39065e60ed3be42a1268cc03a0f6ecbd913f06e02d9f0917edac94b8 WatchSource:0}: Error finding container d06964cc39065e60ed3be42a1268cc03a0f6ecbd913f06e02d9f0917edac94b8: Status 404 returned error can't find the container with id d06964cc39065e60ed3be42a1268cc03a0f6ecbd913f06e02d9f0917edac94b8 Jul 17 21:04:37.075005 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:37.074973 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-s6nd9" event={"ID":"9d5f3a68-9243-4c4d-967c-d43498c8a1e9","Type":"ContainerStarted","Data":"bfcb5223ac68226d1bbe8287b8a14c4da4d33ddf1c263747910d19aa7e40e085"} Jul 17 21:04:37.076472 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:37.076448 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-jww4g" event={"ID":"804719d7-515b-43b2-b9c3-06ca4f9108c0","Type":"ContainerStarted","Data":"873c34e5ae65b5a6005e98f218a7fb55b7fa50a903638f98d76d3b88f5f06245"} Jul 17 21:04:37.077913 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:37.077896 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bk9fq_c7148bac-9a70-453b-a952-2a7a5e4a0ea6/console-operator/0.log" Jul 17 21:04:37.077987 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:37.077930 2580 generic.go:356] "Generic (PLEG): container finished" podID="c7148bac-9a70-453b-a952-2a7a5e4a0ea6" containerID="886e2fa7a7658d897c55279a42d82536e8d69cbca14dca94c425248b02affe8d" exitCode=255 Jul 17 21:04:37.077987 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:37.077957 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-bk9fq" event={"ID":"c7148bac-9a70-453b-a952-2a7a5e4a0ea6","Type":"ContainerDied","Data":"886e2fa7a7658d897c55279a42d82536e8d69cbca14dca94c425248b02affe8d"} Jul 17 21:04:37.078165 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:37.078145 2580 scope.go:117] "RemoveContainer" containerID="886e2fa7a7658d897c55279a42d82536e8d69cbca14dca94c425248b02affe8d" Jul 17 21:04:37.079129 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:37.079107 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlfvd" event={"ID":"c9ee56af-87eb-42ae-bf0b-96477c5a90cb","Type":"ContainerStarted","Data":"d06964cc39065e60ed3be42a1268cc03a0f6ecbd913f06e02d9f0917edac94b8"} Jul 17 21:04:37.095776 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:37.095740 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-s6nd9" podStartSLOduration=1.883599289 podStartE2EDuration="5.095728596s" totalImagesPullingTime="3.212129307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:04:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:37.095609694 +0000 UTC m=+49.693292337" watchObservedRunningTime="2026-07-17 21:04:37.095728596 +0000 UTC m=+49.693411238" Jul 17 21:04:37.139605 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:37.139561 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-jww4g" podStartSLOduration=1.9400786650000001 podStartE2EDuration="5.139545432s" totalImagesPullingTime="3.199466767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:04:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:37.138834605 +0000 UTC m=+49.736517248" watchObservedRunningTime="2026-07-17 21:04:37.139545432 +0000 UTC m=+49.737228079" Jul 17 21:04:37.820780 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:37.820750 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-tls\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:04:37.820946 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:37.820910 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 21:04:37.820946 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:37.820931 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5879d7dbf6-6rrr8: secret "image-registry-tls" not found Jul 17 21:04:37.821024 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:37.820998 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-tls podName:bba29410-5b7f-4187-8a11-91b4185cddbb nodeName:}" failed. No retries permitted until 2026-07-17 21:04:41.820975884 +0000 UTC m=+54.418658524 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-tls") pod "image-registry-5879d7dbf6-6rrr8" (UID: "bba29410-5b7f-4187-8a11-91b4185cddbb") : secret "image-registry-tls" not found Jul 17 21:04:38.086297 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:38.086231 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bk9fq_c7148bac-9a70-453b-a952-2a7a5e4a0ea6/console-operator/1.log" Jul 17 21:04:38.086644 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:38.086595 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bk9fq_c7148bac-9a70-453b-a952-2a7a5e4a0ea6/console-operator/0.log" Jul 17 21:04:38.086644 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:38.086623 2580 generic.go:356] "Generic (PLEG): container finished" podID="c7148bac-9a70-453b-a952-2a7a5e4a0ea6" containerID="fb8b14314d7558439f120cbe6b939fe32445f0c2d9fda91fa26d461ea4d764b9" exitCode=255 Jul 17 21:04:38.086716 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:38.086653 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-bk9fq" event={"ID":"c7148bac-9a70-453b-a952-2a7a5e4a0ea6","Type":"ContainerDied","Data":"fb8b14314d7558439f120cbe6b939fe32445f0c2d9fda91fa26d461ea4d764b9"} Jul 17 21:04:38.086761 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:38.086747 2580 scope.go:117] "RemoveContainer" containerID="886e2fa7a7658d897c55279a42d82536e8d69cbca14dca94c425248b02affe8d" Jul 17 21:04:38.086907 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:38.086888 2580 scope.go:117] "RemoveContainer" containerID="fb8b14314d7558439f120cbe6b939fe32445f0c2d9fda91fa26d461ea4d764b9" Jul 17 21:04:38.087086 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:38.087066 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-bk9fq_openshift-console-operator(c7148bac-9a70-453b-a952-2a7a5e4a0ea6)\"" pod="openshift-console-operator/console-operator-565b7b569d-bk9fq" podUID="c7148bac-9a70-453b-a952-2a7a5e4a0ea6" Jul 17 21:04:38.736929 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:38.736898 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wm82f"] Jul 17 21:04:38.753774 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:38.753749 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wm82f" Jul 17 21:04:38.757362 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:38.757341 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 17 21:04:38.757658 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:38.757633 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8lg9w\"" Jul 17 21:04:38.757768 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:38.757670 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 17 21:04:38.771697 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:38.771676 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wm82f"] Jul 17 21:04:38.830584 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:38.830561 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/964ecc7c-8a78-4114-acd1-7bbe2489934f-data-volume\") pod \"insights-runtime-extractor-wm82f\" (UID: \"964ecc7c-8a78-4114-acd1-7bbe2489934f\") " pod="openshift-insights/insights-runtime-extractor-wm82f" Jul 17 21:04:38.830726 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:38.830628 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/964ecc7c-8a78-4114-acd1-7bbe2489934f-crio-socket\") pod \"insights-runtime-extractor-wm82f\" (UID: \"964ecc7c-8a78-4114-acd1-7bbe2489934f\") " pod="openshift-insights/insights-runtime-extractor-wm82f" Jul 17 21:04:38.830726 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:38.830689 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/964ecc7c-8a78-4114-acd1-7bbe2489934f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wm82f\" (UID: \"964ecc7c-8a78-4114-acd1-7bbe2489934f\") " pod="openshift-insights/insights-runtime-extractor-wm82f" Jul 17 21:04:38.830726 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:38.830716 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7hqh\" (UniqueName: \"kubernetes.io/projected/964ecc7c-8a78-4114-acd1-7bbe2489934f-kube-api-access-s7hqh\") pod \"insights-runtime-extractor-wm82f\" (UID: \"964ecc7c-8a78-4114-acd1-7bbe2489934f\") " pod="openshift-insights/insights-runtime-extractor-wm82f" Jul 17 21:04:38.830869 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:38.830741 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/964ecc7c-8a78-4114-acd1-7bbe2489934f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wm82f\" (UID: \"964ecc7c-8a78-4114-acd1-7bbe2489934f\") " pod="openshift-insights/insights-runtime-extractor-wm82f" Jul 17 21:04:38.931167 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:38.931141 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/964ecc7c-8a78-4114-acd1-7bbe2489934f-data-volume\") pod \"insights-runtime-extractor-wm82f\" (UID: \"964ecc7c-8a78-4114-acd1-7bbe2489934f\") " pod="openshift-insights/insights-runtime-extractor-wm82f" Jul 17 21:04:38.931317 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:38.931209 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/964ecc7c-8a78-4114-acd1-7bbe2489934f-crio-socket\") pod \"insights-runtime-extractor-wm82f\" (UID: \"964ecc7c-8a78-4114-acd1-7bbe2489934f\") " pod="openshift-insights/insights-runtime-extractor-wm82f" Jul 17 21:04:38.931317 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:38.931254 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/964ecc7c-8a78-4114-acd1-7bbe2489934f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wm82f\" (UID: \"964ecc7c-8a78-4114-acd1-7bbe2489934f\") " pod="openshift-insights/insights-runtime-extractor-wm82f" Jul 17 21:04:38.931317 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:38.931293 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7hqh\" (UniqueName: \"kubernetes.io/projected/964ecc7c-8a78-4114-acd1-7bbe2489934f-kube-api-access-s7hqh\") pod \"insights-runtime-extractor-wm82f\" (UID: \"964ecc7c-8a78-4114-acd1-7bbe2489934f\") " pod="openshift-insights/insights-runtime-extractor-wm82f" Jul 17 21:04:38.931481 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:38.931342 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/964ecc7c-8a78-4114-acd1-7bbe2489934f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wm82f\" (UID: \"964ecc7c-8a78-4114-acd1-7bbe2489934f\") " pod="openshift-insights/insights-runtime-extractor-wm82f" Jul 17 21:04:38.931481 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:38.931407 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 21:04:38.931481 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:38.931425 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/964ecc7c-8a78-4114-acd1-7bbe2489934f-crio-socket\") pod \"insights-runtime-extractor-wm82f\" (UID: \"964ecc7c-8a78-4114-acd1-7bbe2489934f\") " pod="openshift-insights/insights-runtime-extractor-wm82f" Jul 17 21:04:38.931481 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:38.931433 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 21:04:38.931647 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:38.931489 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/964ecc7c-8a78-4114-acd1-7bbe2489934f-insights-runtime-extractor-tls podName:964ecc7c-8a78-4114-acd1-7bbe2489934f nodeName:}" failed. No retries permitted until 2026-07-17 21:04:39.431472072 +0000 UTC m=+52.029154698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/964ecc7c-8a78-4114-acd1-7bbe2489934f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wm82f" (UID: "964ecc7c-8a78-4114-acd1-7bbe2489934f") : secret "insights-runtime-extractor-tls" not found Jul 17 21:04:38.931647 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:38.931539 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/964ecc7c-8a78-4114-acd1-7bbe2489934f-kube-rbac-proxy-cm podName:964ecc7c-8a78-4114-acd1-7bbe2489934f nodeName:}" failed. No retries permitted until 2026-07-17 21:04:39.431521987 +0000 UTC m=+52.029204617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/964ecc7c-8a78-4114-acd1-7bbe2489934f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wm82f" (UID: "964ecc7c-8a78-4114-acd1-7bbe2489934f") : configmap "kube-rbac-proxy" not found Jul 17 21:04:38.931647 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:38.931534 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/964ecc7c-8a78-4114-acd1-7bbe2489934f-data-volume\") pod \"insights-runtime-extractor-wm82f\" (UID: \"964ecc7c-8a78-4114-acd1-7bbe2489934f\") " pod="openshift-insights/insights-runtime-extractor-wm82f" Jul 17 21:04:38.942445 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:38.942423 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7hqh\" (UniqueName: \"kubernetes.io/projected/964ecc7c-8a78-4114-acd1-7bbe2489934f-kube-api-access-s7hqh\") pod \"insights-runtime-extractor-wm82f\" (UID: \"964ecc7c-8a78-4114-acd1-7bbe2489934f\") " pod="openshift-insights/insights-runtime-extractor-wm82f" Jul 17 21:04:39.089956 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:39.089931 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bk9fq_c7148bac-9a70-453b-a952-2a7a5e4a0ea6/console-operator/1.log" Jul 17 21:04:39.090306 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:39.090267 2580 scope.go:117] "RemoveContainer" containerID="fb8b14314d7558439f120cbe6b939fe32445f0c2d9fda91fa26d461ea4d764b9" Jul 17 21:04:39.090432 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:39.090413 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-bk9fq_openshift-console-operator(c7148bac-9a70-453b-a952-2a7a5e4a0ea6)\"" pod="openshift-console-operator/console-operator-565b7b569d-bk9fq" podUID="c7148bac-9a70-453b-a952-2a7a5e4a0ea6" Jul 17 21:04:39.289022 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:39.288991 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ndbdn"] Jul 17 21:04:39.305108 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:39.305085 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ndbdn" Jul 17 21:04:39.305331 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:39.305086 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ndbdn"] Jul 17 21:04:39.308479 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:39.308418 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-sktr6\"" Jul 17 21:04:39.308479 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:39.308438 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 17 21:04:39.308479 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:39.308460 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 17 21:04:39.308682 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:39.308460 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 17 21:04:39.308983 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:39.308963 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 17 21:04:39.434969 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:39.434893 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62b9113d-1916-45a9-ae59-1b11ee2ced61-serving-cert\") pod \"service-ca-operator-5bcbc94c78-ndbdn\" (UID: \"62b9113d-1916-45a9-ae59-1b11ee2ced61\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ndbdn" Jul 17 21:04:39.435104 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:39.434968 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/964ecc7c-8a78-4114-acd1-7bbe2489934f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wm82f\" (UID: \"964ecc7c-8a78-4114-acd1-7bbe2489934f\") " pod="openshift-insights/insights-runtime-extractor-wm82f" Jul 17 21:04:39.435104 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:39.435008 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62b9113d-1916-45a9-ae59-1b11ee2ced61-config\") pod \"service-ca-operator-5bcbc94c78-ndbdn\" (UID: \"62b9113d-1916-45a9-ae59-1b11ee2ced61\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ndbdn" Jul 17 21:04:39.435104 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:39.435035 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/964ecc7c-8a78-4114-acd1-7bbe2489934f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wm82f\" (UID: \"964ecc7c-8a78-4114-acd1-7bbe2489934f\") " pod="openshift-insights/insights-runtime-extractor-wm82f" Jul 17 21:04:39.435104 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:39.435079 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2chnn\" (UniqueName: \"kubernetes.io/projected/62b9113d-1916-45a9-ae59-1b11ee2ced61-kube-api-access-2chnn\") pod \"service-ca-operator-5bcbc94c78-ndbdn\" (UID: \"62b9113d-1916-45a9-ae59-1b11ee2ced61\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ndbdn" Jul 17 21:04:39.435320 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:39.435122 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 21:04:39.435320 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:39.435150 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 21:04:39.435320 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:39.435181 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/964ecc7c-8a78-4114-acd1-7bbe2489934f-insights-runtime-extractor-tls podName:964ecc7c-8a78-4114-acd1-7bbe2489934f nodeName:}" failed. No retries permitted until 2026-07-17 21:04:40.435167271 +0000 UTC m=+53.032849892 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/964ecc7c-8a78-4114-acd1-7bbe2489934f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wm82f" (UID: "964ecc7c-8a78-4114-acd1-7bbe2489934f") : secret "insights-runtime-extractor-tls" not found Jul 17 21:04:39.435320 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:39.435227 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/964ecc7c-8a78-4114-acd1-7bbe2489934f-kube-rbac-proxy-cm podName:964ecc7c-8a78-4114-acd1-7bbe2489934f nodeName:}" failed. No retries permitted until 2026-07-17 21:04:40.435207656 +0000 UTC m=+53.032890292 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/964ecc7c-8a78-4114-acd1-7bbe2489934f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wm82f" (UID: "964ecc7c-8a78-4114-acd1-7bbe2489934f") : configmap "kube-rbac-proxy" not found Jul 17 21:04:39.536216 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:39.536163 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62b9113d-1916-45a9-ae59-1b11ee2ced61-serving-cert\") pod \"service-ca-operator-5bcbc94c78-ndbdn\" (UID: \"62b9113d-1916-45a9-ae59-1b11ee2ced61\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ndbdn" Jul 17 21:04:39.536384 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:39.536284 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62b9113d-1916-45a9-ae59-1b11ee2ced61-config\") pod \"service-ca-operator-5bcbc94c78-ndbdn\" (UID: \"62b9113d-1916-45a9-ae59-1b11ee2ced61\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ndbdn" Jul 17 21:04:39.536384 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:39.536349 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2chnn\" (UniqueName: \"kubernetes.io/projected/62b9113d-1916-45a9-ae59-1b11ee2ced61-kube-api-access-2chnn\") pod \"service-ca-operator-5bcbc94c78-ndbdn\" (UID: \"62b9113d-1916-45a9-ae59-1b11ee2ced61\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ndbdn" Jul 17 21:04:39.536893 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:39.536867 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62b9113d-1916-45a9-ae59-1b11ee2ced61-config\") pod \"service-ca-operator-5bcbc94c78-ndbdn\" (UID: \"62b9113d-1916-45a9-ae59-1b11ee2ced61\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ndbdn" Jul 17 21:04:39.538643 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:39.538611 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62b9113d-1916-45a9-ae59-1b11ee2ced61-serving-cert\") pod \"service-ca-operator-5bcbc94c78-ndbdn\" (UID: \"62b9113d-1916-45a9-ae59-1b11ee2ced61\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ndbdn" Jul 17 21:04:39.547326 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:39.547298 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2chnn\" (UniqueName: \"kubernetes.io/projected/62b9113d-1916-45a9-ae59-1b11ee2ced61-kube-api-access-2chnn\") pod \"service-ca-operator-5bcbc94c78-ndbdn\" (UID: \"62b9113d-1916-45a9-ae59-1b11ee2ced61\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ndbdn" Jul 17 21:04:39.615888 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:39.615863 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ndbdn" Jul 17 21:04:39.909051 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:39.909023 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ndbdn"] Jul 17 21:04:39.936158 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:04:39.936130 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62b9113d_1916_45a9_ae59_1b11ee2ced61.slice/crio-08ea70714d16a0f07dd15ae28efa161f4d3eb31bb29b1f36453983d12fe4c4b8 WatchSource:0}: Error finding container 08ea70714d16a0f07dd15ae28efa161f4d3eb31bb29b1f36453983d12fe4c4b8: Status 404 returned error can't find the container with id 08ea70714d16a0f07dd15ae28efa161f4d3eb31bb29b1f36453983d12fe4c4b8 Jul 17 21:04:40.040495 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:40.040468 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/caf45719-aa88-4cd5-be7b-59181000ebc4-metrics-tls\") pod \"dns-default-975kn\" (UID: \"caf45719-aa88-4cd5-be7b-59181000ebc4\") " pod="openshift-dns/dns-default-975kn" Jul 17 21:04:40.040616 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:40.040601 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 21:04:40.040694 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:40.040680 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf45719-aa88-4cd5-be7b-59181000ebc4-metrics-tls podName:caf45719-aa88-4cd5-be7b-59181000ebc4 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:56.040646426 +0000 UTC m=+68.638329071 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/caf45719-aa88-4cd5-be7b-59181000ebc4-metrics-tls") pod "dns-default-975kn" (UID: "caf45719-aa88-4cd5-be7b-59181000ebc4") : secret "dns-default-metrics-tls" not found Jul 17 21:04:40.100401 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:40.100369 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ndbdn" event={"ID":"62b9113d-1916-45a9-ae59-1b11ee2ced61","Type":"ContainerStarted","Data":"08ea70714d16a0f07dd15ae28efa161f4d3eb31bb29b1f36453983d12fe4c4b8"} Jul 17 21:04:40.101939 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:40.101914 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlfvd" event={"ID":"c9ee56af-87eb-42ae-bf0b-96477c5a90cb","Type":"ContainerStarted","Data":"b1d4553f6f5eda59a2d9a597ee1a62bcea00381b87735cf570964baf191e85c7"} Jul 17 21:04:40.128914 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:40.128876 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlfvd" podStartSLOduration=0.952067042 podStartE2EDuration="4.128861961s" totalImagesPullingTime="3.176794919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:04:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:40.128830591 +0000 UTC m=+52.726513234" watchObservedRunningTime="2026-07-17 21:04:40.128861961 +0000 UTC m=+52.726544601" Jul 17 21:04:40.444310 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:40.444277 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/964ecc7c-8a78-4114-acd1-7bbe2489934f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wm82f\" (UID: \"964ecc7c-8a78-4114-acd1-7bbe2489934f\") " pod="openshift-insights/insights-runtime-extractor-wm82f" Jul 17 21:04:40.444560 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:40.444416 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 21:04:40.444560 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:40.444417 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/964ecc7c-8a78-4114-acd1-7bbe2489934f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wm82f\" (UID: \"964ecc7c-8a78-4114-acd1-7bbe2489934f\") " pod="openshift-insights/insights-runtime-extractor-wm82f" Jul 17 21:04:40.444560 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:40.444498 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/964ecc7c-8a78-4114-acd1-7bbe2489934f-kube-rbac-proxy-cm podName:964ecc7c-8a78-4114-acd1-7bbe2489934f nodeName:}" failed. No retries permitted until 2026-07-17 21:04:42.444479643 +0000 UTC m=+55.042162269 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/964ecc7c-8a78-4114-acd1-7bbe2489934f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wm82f" (UID: "964ecc7c-8a78-4114-acd1-7bbe2489934f") : configmap "kube-rbac-proxy" not found Jul 17 21:04:40.444560 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:40.444513 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 21:04:40.444760 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:40.444578 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/964ecc7c-8a78-4114-acd1-7bbe2489934f-insights-runtime-extractor-tls podName:964ecc7c-8a78-4114-acd1-7bbe2489934f nodeName:}" failed. No retries permitted until 2026-07-17 21:04:42.444562419 +0000 UTC m=+55.042245040 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/964ecc7c-8a78-4114-acd1-7bbe2489934f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wm82f" (UID: "964ecc7c-8a78-4114-acd1-7bbe2489934f") : secret "insights-runtime-extractor-tls" not found Jul 17 21:04:40.626747 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:40.626714 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jkpqn_ebc23e94-e431-4530-a0d3-4ecd7f6e81f1/dns-node-resolver/0.log" Jul 17 21:04:41.626710 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:41.626676 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cxh8j_243ec811-8044-4a40-94a4-12034fff80c7/node-ca/0.log" Jul 17 21:04:41.858088 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:41.858060 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-tls\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:04:41.858240 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:41.858212 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 21:04:41.858240 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:41.858227 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5879d7dbf6-6rrr8: secret "image-registry-tls" not found Jul 17 21:04:41.858312 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:41.858285 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-tls podName:bba29410-5b7f-4187-8a11-91b4185cddbb nodeName:}" failed. No retries permitted until 2026-07-17 21:04:49.85827033 +0000 UTC m=+62.455952951 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-tls") pod "image-registry-5879d7dbf6-6rrr8" (UID: "bba29410-5b7f-4187-8a11-91b4185cddbb") : secret "image-registry-tls" not found Jul 17 21:04:42.427079 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:42.426981 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-82mmq_27b81838-ea05-4402-8c37-3538241228db/serve-healthcheck-canary/0.log" Jul 17 21:04:42.462248 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:42.462220 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/964ecc7c-8a78-4114-acd1-7bbe2489934f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wm82f\" (UID: \"964ecc7c-8a78-4114-acd1-7bbe2489934f\") " pod="openshift-insights/insights-runtime-extractor-wm82f" Jul 17 21:04:42.462369 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:42.462273 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/964ecc7c-8a78-4114-acd1-7bbe2489934f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wm82f\" (UID: \"964ecc7c-8a78-4114-acd1-7bbe2489934f\") " pod="openshift-insights/insights-runtime-extractor-wm82f" Jul 17 21:04:42.462369 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:42.462342 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 21:04:42.462441 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:42.462390 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/964ecc7c-8a78-4114-acd1-7bbe2489934f-kube-rbac-proxy-cm podName:964ecc7c-8a78-4114-acd1-7bbe2489934f nodeName:}" failed. No retries permitted until 2026-07-17 21:04:46.462373714 +0000 UTC m=+59.060056335 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/964ecc7c-8a78-4114-acd1-7bbe2489934f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wm82f" (UID: "964ecc7c-8a78-4114-acd1-7bbe2489934f") : configmap "kube-rbac-proxy" not found Jul 17 21:04:42.462441 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:42.462394 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 21:04:42.462512 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:42.462454 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/964ecc7c-8a78-4114-acd1-7bbe2489934f-insights-runtime-extractor-tls podName:964ecc7c-8a78-4114-acd1-7bbe2489934f nodeName:}" failed. No retries permitted until 2026-07-17 21:04:46.462435806 +0000 UTC m=+59.060118433 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/964ecc7c-8a78-4114-acd1-7bbe2489934f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wm82f" (UID: "964ecc7c-8a78-4114-acd1-7bbe2489934f") : secret "insights-runtime-extractor-tls" not found Jul 17 21:04:42.664134 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:42.664095 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-bk9fq" Jul 17 21:04:42.664609 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:42.664155 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-bk9fq" Jul 17 21:04:42.664609 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:42.664507 2580 scope.go:117] "RemoveContainer" containerID="fb8b14314d7558439f120cbe6b939fe32445f0c2d9fda91fa26d461ea4d764b9" Jul 17 21:04:42.664714 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:42.664644 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-bk9fq_openshift-console-operator(c7148bac-9a70-453b-a952-2a7a5e4a0ea6)\"" pod="openshift-console-operator/console-operator-565b7b569d-bk9fq" podUID="c7148bac-9a70-453b-a952-2a7a5e4a0ea6" Jul 17 21:04:43.111752 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:43.111711 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ndbdn" event={"ID":"62b9113d-1916-45a9-ae59-1b11ee2ced61","Type":"ContainerStarted","Data":"885486aa18a617c86347a04d0635ae71dd2bcd0cd5f0872af7260f6f5962b147"} Jul 17 21:04:46.501467 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:46.501423 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/964ecc7c-8a78-4114-acd1-7bbe2489934f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wm82f\" (UID: \"964ecc7c-8a78-4114-acd1-7bbe2489934f\") " pod="openshift-insights/insights-runtime-extractor-wm82f" Jul 17 21:04:46.501990 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:46.501563 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 21:04:46.501990 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:46.501610 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/964ecc7c-8a78-4114-acd1-7bbe2489934f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wm82f\" (UID: \"964ecc7c-8a78-4114-acd1-7bbe2489934f\") " pod="openshift-insights/insights-runtime-extractor-wm82f" Jul 17 21:04:46.501990 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:46.501647 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/964ecc7c-8a78-4114-acd1-7bbe2489934f-kube-rbac-proxy-cm podName:964ecc7c-8a78-4114-acd1-7bbe2489934f nodeName:}" failed. No retries permitted until 2026-07-17 21:04:54.501624494 +0000 UTC m=+67.099307135 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/964ecc7c-8a78-4114-acd1-7bbe2489934f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wm82f" (UID: "964ecc7c-8a78-4114-acd1-7bbe2489934f") : configmap "kube-rbac-proxy" not found Jul 17 21:04:46.501990 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:46.501694 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 21:04:46.501990 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:46.501749 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/964ecc7c-8a78-4114-acd1-7bbe2489934f-insights-runtime-extractor-tls podName:964ecc7c-8a78-4114-acd1-7bbe2489934f nodeName:}" failed. No retries permitted until 2026-07-17 21:04:54.501735243 +0000 UTC m=+67.099417864 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/964ecc7c-8a78-4114-acd1-7bbe2489934f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wm82f" (UID: "964ecc7c-8a78-4114-acd1-7bbe2489934f") : secret "insights-runtime-extractor-tls" not found Jul 17 21:04:47.289633 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:47.289574 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ndbdn" podStartSLOduration=6.098425267 podStartE2EDuration="8.289557719s" totalImagesPullingTime="2.191132452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:43.130126674 +0000 UTC m=+55.727809319" watchObservedRunningTime="2026-07-17 21:04:47.289557719 +0000 UTC m=+59.887240362" Jul 17 21:04:47.289823 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:47.289808 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cfc57b64d-mrnnw"] Jul 17 21:04:47.294263 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:47.294241 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cfc57b64d-mrnnw" Jul 17 21:04:47.296975 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:47.296951 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 17 21:04:47.297771 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:47.297754 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 17 21:04:47.298276 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:47.298261 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 17 21:04:47.299116 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:47.299104 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-mhrjk\"" Jul 17 21:04:47.299237 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:47.299213 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 17 21:04:47.312332 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:47.312310 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cfc57b64d-mrnnw"] Jul 17 21:04:47.409364 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:47.409334 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/11087e3a-5ed3-4d16-898c-808cb097c9ae-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cfc57b64d-mrnnw\" (UID: \"11087e3a-5ed3-4d16-898c-808cb097c9ae\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cfc57b64d-mrnnw" Jul 17 21:04:47.409509 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:47.409382 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2hnf\" (UniqueName: \"kubernetes.io/projected/11087e3a-5ed3-4d16-898c-808cb097c9ae-kube-api-access-q2hnf\") pod \"managed-serviceaccount-addon-agent-7cfc57b64d-mrnnw\" (UID: \"11087e3a-5ed3-4d16-898c-808cb097c9ae\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cfc57b64d-mrnnw" Jul 17 21:04:47.510753 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:47.510722 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/11087e3a-5ed3-4d16-898c-808cb097c9ae-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cfc57b64d-mrnnw\" (UID: \"11087e3a-5ed3-4d16-898c-808cb097c9ae\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cfc57b64d-mrnnw" Jul 17 21:04:47.511082 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:47.510767 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2hnf\" (UniqueName: \"kubernetes.io/projected/11087e3a-5ed3-4d16-898c-808cb097c9ae-kube-api-access-q2hnf\") pod \"managed-serviceaccount-addon-agent-7cfc57b64d-mrnnw\" (UID: \"11087e3a-5ed3-4d16-898c-808cb097c9ae\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cfc57b64d-mrnnw" Jul 17 21:04:47.513223 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:47.513203 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/11087e3a-5ed3-4d16-898c-808cb097c9ae-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cfc57b64d-mrnnw\" (UID: \"11087e3a-5ed3-4d16-898c-808cb097c9ae\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cfc57b64d-mrnnw" Jul 17 21:04:47.521103 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:47.521077 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2hnf\" (UniqueName: \"kubernetes.io/projected/11087e3a-5ed3-4d16-898c-808cb097c9ae-kube-api-access-q2hnf\") pod \"managed-serviceaccount-addon-agent-7cfc57b64d-mrnnw\" (UID: \"11087e3a-5ed3-4d16-898c-808cb097c9ae\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cfc57b64d-mrnnw" Jul 17 21:04:47.613830 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:47.613802 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cfc57b64d-mrnnw" Jul 17 21:04:47.744623 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:47.744588 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cfc57b64d-mrnnw"] Jul 17 21:04:47.748699 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:04:47.748664 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11087e3a_5ed3_4d16_898c_808cb097c9ae.slice/crio-a42c15a8d0c8410ecdbbddc6465871fcd334c937798f558e619842c842ed49b3 WatchSource:0}: Error finding container a42c15a8d0c8410ecdbbddc6465871fcd334c937798f558e619842c842ed49b3: Status 404 returned error can't find the container with id a42c15a8d0c8410ecdbbddc6465871fcd334c937798f558e619842c842ed49b3 Jul 17 21:04:48.127926 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:48.127889 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cfc57b64d-mrnnw" event={"ID":"11087e3a-5ed3-4d16-898c-808cb097c9ae","Type":"ContainerStarted","Data":"a42c15a8d0c8410ecdbbddc6465871fcd334c937798f558e619842c842ed49b3"} Jul 17 21:04:49.933932 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:49.933886 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-tls\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:04:49.934428 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:49.934052 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 21:04:49.934428 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:49.934067 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5879d7dbf6-6rrr8: secret "image-registry-tls" not found Jul 17 21:04:49.934428 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:49.934139 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-tls podName:bba29410-5b7f-4187-8a11-91b4185cddbb nodeName:}" failed. No retries permitted until 2026-07-17 21:05:05.934118278 +0000 UTC m=+78.531800930 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-tls") pod "image-registry-5879d7dbf6-6rrr8" (UID: "bba29410-5b7f-4187-8a11-91b4185cddbb") : secret "image-registry-tls" not found Jul 17 21:04:50.029520 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:50.029492 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lj5lm" Jul 17 21:04:51.139326 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:51.139287 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cfc57b64d-mrnnw" event={"ID":"11087e3a-5ed3-4d16-898c-808cb097c9ae","Type":"ContainerStarted","Data":"606bd0cc139303a96c79865d0d36f4a0b76a7354f462aa9ef2ff89bf7eff5471"} Jul 17 21:04:51.158767 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:51.158717 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cfc57b64d-mrnnw" podStartSLOduration=0.892848606 podStartE2EDuration="4.158702064s" totalImagesPullingTime="3.265853458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:04:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:51.158124729 +0000 UTC m=+63.755807376" watchObservedRunningTime="2026-07-17 21:04:51.158702064 +0000 UTC m=+63.756384707" Jul 17 21:04:53.667499 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:53.667445 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c55f0556-d46b-468c-922b-364681e608cc-metrics-certs\") pod \"network-metrics-daemon-7z4zp\" (UID: \"c55f0556-d46b-468c-922b-364681e608cc\") " pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:04:53.667952 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:53.667546 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4e45558-98a1-423e-8184-3cd1848415f3-original-pull-secret\") pod \"global-pull-secret-syncer-rwxkq\" (UID: \"a4e45558-98a1-423e-8184-3cd1848415f3\") " pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:04:53.667952 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:53.667604 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb4kk\" (UniqueName: \"kubernetes.io/projected/d6024dec-941f-41a6-9986-808ce67207cb-kube-api-access-fb4kk\") pod \"network-check-target-rwnns\" (UID: \"d6024dec-941f-41a6-9986-808ce67207cb\") " pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:04:53.672420 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:53.672397 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 21:04:53.672420 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:53.672414 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 17 21:04:53.672552 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:53.672432 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 21:04:53.677806 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:53.677788 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 17 21:04:53.677868 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:53.677856 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c55f0556-d46b-468c-922b-364681e608cc-metrics-certs podName:c55f0556-d46b-468c-922b-364681e608cc nodeName:}" failed. No retries permitted until 2026-07-17 21:05:57.677834926 +0000 UTC m=+130.275517555 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c55f0556-d46b-468c-922b-364681e608cc-metrics-certs") pod "network-metrics-daemon-7z4zp" (UID: "c55f0556-d46b-468c-922b-364681e608cc") : secret "metrics-daemon-secret" not found Jul 17 21:04:53.679978 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:53.679952 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4e45558-98a1-423e-8184-3cd1848415f3-original-pull-secret\") pod \"global-pull-secret-syncer-rwxkq\" (UID: \"a4e45558-98a1-423e-8184-3cd1848415f3\") " pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:04:53.680306 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:53.680291 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 17 21:04:53.690009 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:53.689983 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb4kk\" (UniqueName: \"kubernetes.io/projected/d6024dec-941f-41a6-9986-808ce67207cb-kube-api-access-fb4kk\") pod \"network-check-target-rwnns\" (UID: \"d6024dec-941f-41a6-9986-808ce67207cb\") " pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:04:53.977286 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:53.977181 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwxkq" Jul 17 21:04:53.977865 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:53.977847 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5j5fp\"" Jul 17 21:04:53.983612 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:53.983594 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:04:54.113361 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:54.113331 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rwxkq"] Jul 17 21:04:54.116268 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:04:54.116230 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4e45558_98a1_423e_8184_3cd1848415f3.slice/crio-1552d381f88ccfe239383a3600e924690e2f12cd4e4617f4195e7db620bab7cc WatchSource:0}: Error finding container 1552d381f88ccfe239383a3600e924690e2f12cd4e4617f4195e7db620bab7cc: Status 404 returned error can't find the container with id 1552d381f88ccfe239383a3600e924690e2f12cd4e4617f4195e7db620bab7cc Jul 17 21:04:54.131145 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:54.131120 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rwnns"] Jul 17 21:04:54.134153 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:04:54.134129 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6024dec_941f_41a6_9986_808ce67207cb.slice/crio-0ac273c7a56504edcee5a20a9bbee99855a89ad513e52e8d9532035cd5e2cdc8 WatchSource:0}: Error finding container 0ac273c7a56504edcee5a20a9bbee99855a89ad513e52e8d9532035cd5e2cdc8: Status 404 returned error can't find the container with id 0ac273c7a56504edcee5a20a9bbee99855a89ad513e52e8d9532035cd5e2cdc8 Jul 17 21:04:54.150813 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:54.150783 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rwxkq" event={"ID":"a4e45558-98a1-423e-8184-3cd1848415f3","Type":"ContainerStarted","Data":"1552d381f88ccfe239383a3600e924690e2f12cd4e4617f4195e7db620bab7cc"} Jul 17 21:04:54.151913 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:54.151892 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rwnns" event={"ID":"d6024dec-941f-41a6-9986-808ce67207cb","Type":"ContainerStarted","Data":"0ac273c7a56504edcee5a20a9bbee99855a89ad513e52e8d9532035cd5e2cdc8"} Jul 17 21:04:54.575758 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:54.575718 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/964ecc7c-8a78-4114-acd1-7bbe2489934f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wm82f\" (UID: \"964ecc7c-8a78-4114-acd1-7bbe2489934f\") " pod="openshift-insights/insights-runtime-extractor-wm82f" Jul 17 21:04:54.575936 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:54.575767 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/964ecc7c-8a78-4114-acd1-7bbe2489934f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wm82f\" (UID: \"964ecc7c-8a78-4114-acd1-7bbe2489934f\") " pod="openshift-insights/insights-runtime-extractor-wm82f" Jul 17 21:04:54.575995 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:54.575964 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 21:04:54.576059 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:04:54.576045 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/964ecc7c-8a78-4114-acd1-7bbe2489934f-insights-runtime-extractor-tls podName:964ecc7c-8a78-4114-acd1-7bbe2489934f nodeName:}" failed. No retries permitted until 2026-07-17 21:05:10.57602127 +0000 UTC m=+83.173703892 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/964ecc7c-8a78-4114-acd1-7bbe2489934f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wm82f" (UID: "964ecc7c-8a78-4114-acd1-7bbe2489934f") : secret "insights-runtime-extractor-tls" not found Jul 17 21:04:54.576442 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:54.576415 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/964ecc7c-8a78-4114-acd1-7bbe2489934f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wm82f\" (UID: \"964ecc7c-8a78-4114-acd1-7bbe2489934f\") " pod="openshift-insights/insights-runtime-extractor-wm82f" Jul 17 21:04:56.089666 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:56.089627 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/caf45719-aa88-4cd5-be7b-59181000ebc4-metrics-tls\") pod \"dns-default-975kn\" (UID: \"caf45719-aa88-4cd5-be7b-59181000ebc4\") " pod="openshift-dns/dns-default-975kn" Jul 17 21:04:56.092506 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:56.092480 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/caf45719-aa88-4cd5-be7b-59181000ebc4-metrics-tls\") pod \"dns-default-975kn\" (UID: \"caf45719-aa88-4cd5-be7b-59181000ebc4\") " pod="openshift-dns/dns-default-975kn" Jul 17 21:04:56.382688 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:56.382608 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nzpb7\"" Jul 17 21:04:56.390350 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:56.390326 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-975kn" Jul 17 21:04:57.853288 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:57.853261 2580 scope.go:117] "RemoveContainer" containerID="fb8b14314d7558439f120cbe6b939fe32445f0c2d9fda91fa26d461ea4d764b9" Jul 17 21:04:59.170258 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:59.170219 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rwnns" event={"ID":"d6024dec-941f-41a6-9986-808ce67207cb","Type":"ContainerStarted","Data":"09640e31ab4dcf9358304934ba22a6efe7498a7ca3cbca7ff21ec532817546ee"} Jul 17 21:04:59.172538 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:59.172406 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bk9fq_c7148bac-9a70-453b-a952-2a7a5e4a0ea6/console-operator/1.log" Jul 17 21:04:59.172538 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:59.172524 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-bk9fq" event={"ID":"c7148bac-9a70-453b-a952-2a7a5e4a0ea6","Type":"ContainerStarted","Data":"9378efb805932596fcca6d1410c863716f7f9f2ed85f73089908712f50b857f4"} Jul 17 21:04:59.181081 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:04:59.181022 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-975kn"] Jul 17 21:04:59.189646 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:04:59.189571 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf45719_aa88_4cd5_be7b_59181000ebc4.slice/crio-597f059a2c85d00144ba585c4874c1259f0624b5775cb7fc92b0993690f2253c WatchSource:0}: Error finding container 597f059a2c85d00144ba585c4874c1259f0624b5775cb7fc92b0993690f2253c: Status 404 returned error can't find the container with id 597f059a2c85d00144ba585c4874c1259f0624b5775cb7fc92b0993690f2253c Jul 17 21:05:00.176914 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:00.176877 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rwxkq" event={"ID":"a4e45558-98a1-423e-8184-3cd1848415f3","Type":"ContainerStarted","Data":"a7dd6ba3a74a5e2d6fa5f8f7aafa6cd9797aab54bcac51f2e1560ddfcaeeb86d"} Jul 17 21:05:00.178200 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:00.178158 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-975kn" event={"ID":"caf45719-aa88-4cd5-be7b-59181000ebc4","Type":"ContainerStarted","Data":"597f059a2c85d00144ba585c4874c1259f0624b5775cb7fc92b0993690f2253c"} Jul 17 21:05:00.178340 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:00.178269 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:05:00.232416 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:00.232362 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rwxkq" podStartSLOduration=67.29921594 podStartE2EDuration="1m12.232343836s" totalImagesPullingTime="4.933127896s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:00.201968804 +0000 UTC m=+72.799651446" watchObservedRunningTime="2026-07-17 21:05:00.232343836 +0000 UTC m=+72.830026480" Jul 17 21:05:00.232723 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:00.232701 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-bk9fq" podStartSLOduration=24.876554141 podStartE2EDuration="28.232695106s" totalImagesPullingTime="3.356140965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:04:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:00.231655429 +0000 UTC m=+72.829338074" watchObservedRunningTime="2026-07-17 21:05:00.232695106 +0000 UTC m=+72.830377748" Jul 17 21:05:00.260141 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:00.260068 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rwnns" podStartSLOduration=67.356768956 podStartE2EDuration="1m12.26005142s" totalImagesPullingTime="4.903282464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:00.259008171 +0000 UTC m=+72.856690815" watchObservedRunningTime="2026-07-17 21:05:00.26005142 +0000 UTC m=+72.857734059" Jul 17 21:05:01.183953 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:01.183924 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-975kn" event={"ID":"caf45719-aa88-4cd5-be7b-59181000ebc4","Type":"ContainerStarted","Data":"3ddd7462f0726e45cc38f5c1c972911bfb756666515f6de3f14d95c965d5e893"} Jul 17 21:05:02.190162 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:02.189425 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-975kn" event={"ID":"caf45719-aa88-4cd5-be7b-59181000ebc4","Type":"ContainerStarted","Data":"ed9a252e6cb9645f29530c2d3b4f8c7cdab97e3fbc12b2139faaa8d96cc49b56"} Jul 17 21:05:02.190162 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:02.189699 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-975kn" Jul 17 21:05:02.209223 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:02.209160 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-975kn" podStartSLOduration=36.329703219 podStartE2EDuration="38.209146537s" totalImagesPullingTime="1.879443318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:04:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:02.208341166 +0000 UTC m=+74.806023809" watchObservedRunningTime="2026-07-17 21:05:02.209146537 +0000 UTC m=+74.806829180" Jul 17 21:05:05.966407 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:05.966372 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-tls\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:05:05.968853 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:05.968828 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-tls\") pod \"image-registry-5879d7dbf6-6rrr8\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:05:06.249088 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:06.249012 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gp6nq\"" Jul 17 21:05:06.256452 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:06.256429 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:05:06.411485 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:06.411447 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5879d7dbf6-6rrr8"] Jul 17 21:05:06.414669 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:05:06.414643 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbba29410_5b7f_4187_8a11_91b4185cddbb.slice/crio-e0d9f1f0e1dc68287c8be6773d061b9a02fbbcbe910af565776577e71fac38a8 WatchSource:0}: Error finding container e0d9f1f0e1dc68287c8be6773d061b9a02fbbcbe910af565776577e71fac38a8: Status 404 returned error can't find the container with id e0d9f1f0e1dc68287c8be6773d061b9a02fbbcbe910af565776577e71fac38a8 Jul 17 21:05:07.208512 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.208472 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" event={"ID":"bba29410-5b7f-4187-8a11-91b4185cddbb","Type":"ContainerStarted","Data":"bec8add8e506050c276cbc66d01f937f163484873e63e6c68430469706c9860f"} Jul 17 21:05:07.208946 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.208533 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" event={"ID":"bba29410-5b7f-4187-8a11-91b4185cddbb","Type":"ContainerStarted","Data":"e0d9f1f0e1dc68287c8be6773d061b9a02fbbcbe910af565776577e71fac38a8"} Jul 17 21:05:07.208946 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.208646 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:05:07.209608 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.209587 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-fbbbr"] Jul 17 21:05:07.212173 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.212158 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-fbbbr" Jul 17 21:05:07.217951 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.217933 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-r4h8t\"" Jul 17 21:05:07.218056 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.217981 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 17 21:05:07.219042 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.219024 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 17 21:05:07.239738 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.239711 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-fbbbr"] Jul 17 21:05:07.260446 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.260406 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" podStartSLOduration=33.260394789 podStartE2EDuration="33.260394789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:04:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:07.259178886 +0000 UTC m=+79.856861540" watchObservedRunningTime="2026-07-17 21:05:07.260394789 +0000 UTC m=+79.858077432" Jul 17 21:05:07.294786 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.294763 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-x5bnf"] Jul 17 21:05:07.296598 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.296584 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-x5bnf" Jul 17 21:05:07.301203 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.299230 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 17 21:05:07.301590 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.301426 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5879d7dbf6-6rrr8"] Jul 17 21:05:07.306061 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.306033 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-5xqm2\"" Jul 17 21:05:07.307833 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.307816 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 17 21:05:07.312064 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.312044 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-x5bnf"] Jul 17 21:05:07.378175 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.378153 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f28acb2e-e11c-4f4d-8ce8-4f7bd26457d8-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-fbbbr\" (UID: \"f28acb2e-e11c-4f4d-8ce8-4f7bd26457d8\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-fbbbr" Jul 17 21:05:07.378287 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.378273 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f28acb2e-e11c-4f4d-8ce8-4f7bd26457d8-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-fbbbr\" (UID: \"f28acb2e-e11c-4f4d-8ce8-4f7bd26457d8\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-fbbbr" Jul 17 21:05:07.428734 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.428713 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b4d7d85db-nh59d"] Jul 17 21:05:07.430552 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.430538 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" Jul 17 21:05:07.433884 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:05:07.433860 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"image-registry-7b4d7d85db-nh59d\" is forbidden: User \"system:node:ip-10-0-132-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-132-253.ec2.internal' and this object" podUID="3d4abcde-7882-4519-a2ee-4b8f666acce1" pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" Jul 17 21:05:07.473679 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.473629 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b4d7d85db-nh59d"] Jul 17 21:05:07.478979 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.478957 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f28acb2e-e11c-4f4d-8ce8-4f7bd26457d8-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-fbbbr\" (UID: \"f28acb2e-e11c-4f4d-8ce8-4f7bd26457d8\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-fbbbr" Jul 17 21:05:07.479078 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.479028 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f28acb2e-e11c-4f4d-8ce8-4f7bd26457d8-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-fbbbr\" (UID: \"f28acb2e-e11c-4f4d-8ce8-4f7bd26457d8\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-fbbbr" Jul 17 21:05:07.479139 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.479083 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksvlz\" (UniqueName: \"kubernetes.io/projected/0b7d88bd-9c02-4c36-94a2-365b49da41c8-kube-api-access-ksvlz\") pod \"downloads-5bc67dcd46-x5bnf\" (UID: \"0b7d88bd-9c02-4c36-94a2-365b49da41c8\") " pod="openshift-console/downloads-5bc67dcd46-x5bnf" Jul 17 21:05:07.479562 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.479535 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f28acb2e-e11c-4f4d-8ce8-4f7bd26457d8-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-fbbbr\" (UID: \"f28acb2e-e11c-4f4d-8ce8-4f7bd26457d8\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-fbbbr" Jul 17 21:05:07.481614 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.481594 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f28acb2e-e11c-4f4d-8ce8-4f7bd26457d8-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-fbbbr\" (UID: \"f28acb2e-e11c-4f4d-8ce8-4f7bd26457d8\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-fbbbr" Jul 17 21:05:07.521063 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.521040 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-fbbbr" Jul 17 21:05:07.582153 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.582071 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d4abcde-7882-4519-a2ee-4b8f666acce1-bound-sa-token\") pod \"image-registry-7b4d7d85db-nh59d\" (UID: \"3d4abcde-7882-4519-a2ee-4b8f666acce1\") " pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" Jul 17 21:05:07.582153 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.582103 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwfvq\" (UniqueName: \"kubernetes.io/projected/3d4abcde-7882-4519-a2ee-4b8f666acce1-kube-api-access-hwfvq\") pod \"image-registry-7b4d7d85db-nh59d\" (UID: \"3d4abcde-7882-4519-a2ee-4b8f666acce1\") " pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" Jul 17 21:05:07.582153 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.582130 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d4abcde-7882-4519-a2ee-4b8f666acce1-ca-trust-extracted\") pod \"image-registry-7b4d7d85db-nh59d\" (UID: \"3d4abcde-7882-4519-a2ee-4b8f666acce1\") " pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" Jul 17 21:05:07.582408 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.582212 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d4abcde-7882-4519-a2ee-4b8f666acce1-installation-pull-secrets\") pod \"image-registry-7b4d7d85db-nh59d\" (UID: \"3d4abcde-7882-4519-a2ee-4b8f666acce1\") " pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" Jul 17 21:05:07.582408 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.582260 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d4abcde-7882-4519-a2ee-4b8f666acce1-trusted-ca\") pod \"image-registry-7b4d7d85db-nh59d\" (UID: \"3d4abcde-7882-4519-a2ee-4b8f666acce1\") " pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" Jul 17 21:05:07.582408 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.582339 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d4abcde-7882-4519-a2ee-4b8f666acce1-image-registry-private-configuration\") pod \"image-registry-7b4d7d85db-nh59d\" (UID: \"3d4abcde-7882-4519-a2ee-4b8f666acce1\") " pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" Jul 17 21:05:07.582408 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.582372 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d4abcde-7882-4519-a2ee-4b8f666acce1-registry-certificates\") pod \"image-registry-7b4d7d85db-nh59d\" (UID: \"3d4abcde-7882-4519-a2ee-4b8f666acce1\") " pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" Jul 17 21:05:07.582598 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.582419 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d4abcde-7882-4519-a2ee-4b8f666acce1-registry-tls\") pod \"image-registry-7b4d7d85db-nh59d\" (UID: \"3d4abcde-7882-4519-a2ee-4b8f666acce1\") " pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" Jul 17 21:05:07.582598 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.582459 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksvlz\" (UniqueName: \"kubernetes.io/projected/0b7d88bd-9c02-4c36-94a2-365b49da41c8-kube-api-access-ksvlz\") pod \"downloads-5bc67dcd46-x5bnf\" (UID: \"0b7d88bd-9c02-4c36-94a2-365b49da41c8\") " pod="openshift-console/downloads-5bc67dcd46-x5bnf" Jul 17 21:05:07.604253 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.604180 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksvlz\" (UniqueName: \"kubernetes.io/projected/0b7d88bd-9c02-4c36-94a2-365b49da41c8-kube-api-access-ksvlz\") pod \"downloads-5bc67dcd46-x5bnf\" (UID: \"0b7d88bd-9c02-4c36-94a2-365b49da41c8\") " pod="openshift-console/downloads-5bc67dcd46-x5bnf" Jul 17 21:05:07.611026 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.611003 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-x5bnf" Jul 17 21:05:07.682949 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.682912 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d4abcde-7882-4519-a2ee-4b8f666acce1-registry-tls\") pod \"image-registry-7b4d7d85db-nh59d\" (UID: \"3d4abcde-7882-4519-a2ee-4b8f666acce1\") " pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" Jul 17 21:05:07.683047 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.682994 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d4abcde-7882-4519-a2ee-4b8f666acce1-bound-sa-token\") pod \"image-registry-7b4d7d85db-nh59d\" (UID: \"3d4abcde-7882-4519-a2ee-4b8f666acce1\") " pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" Jul 17 21:05:07.683047 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.683024 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwfvq\" (UniqueName: \"kubernetes.io/projected/3d4abcde-7882-4519-a2ee-4b8f666acce1-kube-api-access-hwfvq\") pod \"image-registry-7b4d7d85db-nh59d\" (UID: \"3d4abcde-7882-4519-a2ee-4b8f666acce1\") " pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" Jul 17 21:05:07.683128 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.683056 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d4abcde-7882-4519-a2ee-4b8f666acce1-ca-trust-extracted\") pod \"image-registry-7b4d7d85db-nh59d\" (UID: \"3d4abcde-7882-4519-a2ee-4b8f666acce1\") " pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" Jul 17 21:05:07.683128 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.683087 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d4abcde-7882-4519-a2ee-4b8f666acce1-installation-pull-secrets\") pod \"image-registry-7b4d7d85db-nh59d\" (UID: \"3d4abcde-7882-4519-a2ee-4b8f666acce1\") " pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" Jul 17 21:05:07.683246 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.683128 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d4abcde-7882-4519-a2ee-4b8f666acce1-trusted-ca\") pod \"image-registry-7b4d7d85db-nh59d\" (UID: \"3d4abcde-7882-4519-a2ee-4b8f666acce1\") " pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" Jul 17 21:05:07.683330 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.683305 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d4abcde-7882-4519-a2ee-4b8f666acce1-image-registry-private-configuration\") pod \"image-registry-7b4d7d85db-nh59d\" (UID: \"3d4abcde-7882-4519-a2ee-4b8f666acce1\") " pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" Jul 17 21:05:07.683388 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.683348 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d4abcde-7882-4519-a2ee-4b8f666acce1-registry-certificates\") pod \"image-registry-7b4d7d85db-nh59d\" (UID: \"3d4abcde-7882-4519-a2ee-4b8f666acce1\") " pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" Jul 17 21:05:07.683550 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.683525 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d4abcde-7882-4519-a2ee-4b8f666acce1-ca-trust-extracted\") pod \"image-registry-7b4d7d85db-nh59d\" (UID: \"3d4abcde-7882-4519-a2ee-4b8f666acce1\") " pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" Jul 17 21:05:07.684160 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.684136 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d4abcde-7882-4519-a2ee-4b8f666acce1-registry-certificates\") pod \"image-registry-7b4d7d85db-nh59d\" (UID: \"3d4abcde-7882-4519-a2ee-4b8f666acce1\") " pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" Jul 17 21:05:07.684266 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.684156 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d4abcde-7882-4519-a2ee-4b8f666acce1-trusted-ca\") pod \"image-registry-7b4d7d85db-nh59d\" (UID: \"3d4abcde-7882-4519-a2ee-4b8f666acce1\") " pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" Jul 17 21:05:07.685845 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.685821 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d4abcde-7882-4519-a2ee-4b8f666acce1-installation-pull-secrets\") pod \"image-registry-7b4d7d85db-nh59d\" (UID: \"3d4abcde-7882-4519-a2ee-4b8f666acce1\") " pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" Jul 17 21:05:07.686170 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.686148 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d4abcde-7882-4519-a2ee-4b8f666acce1-image-registry-private-configuration\") pod \"image-registry-7b4d7d85db-nh59d\" (UID: \"3d4abcde-7882-4519-a2ee-4b8f666acce1\") " pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" Jul 17 21:05:07.686315 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.686298 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d4abcde-7882-4519-a2ee-4b8f666acce1-registry-tls\") pod \"image-registry-7b4d7d85db-nh59d\" (UID: \"3d4abcde-7882-4519-a2ee-4b8f666acce1\") " pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" Jul 17 21:05:07.697933 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.697912 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-fbbbr"] Jul 17 21:05:07.705342 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:05:07.705321 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf28acb2e_e11c_4f4d_8ce8_4f7bd26457d8.slice/crio-2435ca4ae18dce30677d22647fbb5e5459ba59e74ab25a1e2fa82746dd909e9d WatchSource:0}: Error finding container 2435ca4ae18dce30677d22647fbb5e5459ba59e74ab25a1e2fa82746dd909e9d: Status 404 returned error can't find the container with id 2435ca4ae18dce30677d22647fbb5e5459ba59e74ab25a1e2fa82746dd909e9d Jul 17 21:05:07.709400 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.708997 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwfvq\" (UniqueName: \"kubernetes.io/projected/3d4abcde-7882-4519-a2ee-4b8f666acce1-kube-api-access-hwfvq\") pod \"image-registry-7b4d7d85db-nh59d\" (UID: \"3d4abcde-7882-4519-a2ee-4b8f666acce1\") " pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" Jul 17 21:05:07.721153 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.721135 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d4abcde-7882-4519-a2ee-4b8f666acce1-bound-sa-token\") pod \"image-registry-7b4d7d85db-nh59d\" (UID: \"3d4abcde-7882-4519-a2ee-4b8f666acce1\") " pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" Jul 17 21:05:07.739142 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.739092 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" Jul 17 21:05:07.789552 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:05:07.789508 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b7d88bd_9c02_4c36_94a2_365b49da41c8.slice/crio-3ed48796c823880a9edbd14516a3de80b1ad687d7e0684c73c4f40b710073e73 WatchSource:0}: Error finding container 3ed48796c823880a9edbd14516a3de80b1ad687d7e0684c73c4f40b710073e73: Status 404 returned error can't find the container with id 3ed48796c823880a9edbd14516a3de80b1ad687d7e0684c73c4f40b710073e73 Jul 17 21:05:07.789701 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.789674 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-x5bnf"] Jul 17 21:05:07.878420 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:07.878392 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b4d7d85db-nh59d"] Jul 17 21:05:07.882092 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:05:07.882064 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d4abcde_7882_4519_a2ee_4b8f666acce1.slice/crio-fbed2fa47fd24f1ccd195e2fc138b95ae5be1e539931f7799de57ba08fac7952 WatchSource:0}: Error finding container fbed2fa47fd24f1ccd195e2fc138b95ae5be1e539931f7799de57ba08fac7952: Status 404 returned error can't find the container with id fbed2fa47fd24f1ccd195e2fc138b95ae5be1e539931f7799de57ba08fac7952 Jul 17 21:05:08.214212 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:08.214166 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-x5bnf" event={"ID":"0b7d88bd-9c02-4c36-94a2-365b49da41c8","Type":"ContainerStarted","Data":"3ed48796c823880a9edbd14516a3de80b1ad687d7e0684c73c4f40b710073e73"} Jul 17 21:05:08.215633 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:08.215602 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-fbbbr" event={"ID":"f28acb2e-e11c-4f4d-8ce8-4f7bd26457d8","Type":"ContainerStarted","Data":"2435ca4ae18dce30677d22647fbb5e5459ba59e74ab25a1e2fa82746dd909e9d"} Jul 17 21:05:08.217178 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:08.217150 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" event={"ID":"3d4abcde-7882-4519-a2ee-4b8f666acce1","Type":"ContainerStarted","Data":"434e55e11412ba297a95561434f87628a637df85633484a9e2d76dfa5ad7063c"} Jul 17 21:05:08.217309 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:08.217218 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" event={"ID":"3d4abcde-7882-4519-a2ee-4b8f666acce1","Type":"ContainerStarted","Data":"fbed2fa47fd24f1ccd195e2fc138b95ae5be1e539931f7799de57ba08fac7952"} Jul 17 21:05:08.217426 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:08.217405 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" Jul 17 21:05:08.242720 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:08.242672 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" podStartSLOduration=1.242654601 podStartE2EDuration="1.242654601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:05:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:08.241865359 +0000 UTC m=+80.839548002" watchObservedRunningTime="2026-07-17 21:05:08.242654601 +0000 UTC m=+80.840337244" Jul 17 21:05:09.222752 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:09.222676 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-fbbbr" event={"ID":"f28acb2e-e11c-4f4d-8ce8-4f7bd26457d8","Type":"ContainerStarted","Data":"2bc044fec86c14718e85758aade48edbdf86def6489ebc26fbb193ce2fdad367"} Jul 17 21:05:09.244457 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:09.244401 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-fbbbr" podStartSLOduration=0.981215193 podStartE2EDuration="2.244382164s" totalImagesPullingTime="1.263166971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:05:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:09.242027087 +0000 UTC m=+81.839709731" watchObservedRunningTime="2026-07-17 21:05:09.244382164 +0000 UTC m=+81.842064806" Jul 17 21:05:10.179215 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:10.179168 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-bk9fq" Jul 17 21:05:10.182804 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:10.182780 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-bk9fq" Jul 17 21:05:10.606802 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:10.606768 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/964ecc7c-8a78-4114-acd1-7bbe2489934f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wm82f\" (UID: \"964ecc7c-8a78-4114-acd1-7bbe2489934f\") " pod="openshift-insights/insights-runtime-extractor-wm82f" Jul 17 21:05:10.609258 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:10.609232 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/964ecc7c-8a78-4114-acd1-7bbe2489934f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wm82f\" (UID: \"964ecc7c-8a78-4114-acd1-7bbe2489934f\") " pod="openshift-insights/insights-runtime-extractor-wm82f" Jul 17 21:05:10.867911 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:10.867838 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8lg9w\"" Jul 17 21:05:10.876266 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:10.876240 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wm82f" Jul 17 21:05:11.021104 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:11.021074 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wm82f"] Jul 17 21:05:11.024985 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:05:11.024954 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod964ecc7c_8a78_4114_acd1_7bbe2489934f.slice/crio-98ce67caf1519bbfcc31047faf43fa02c497ddda6bbc739cd287828b170ebb8a WatchSource:0}: Error finding container 98ce67caf1519bbfcc31047faf43fa02c497ddda6bbc739cd287828b170ebb8a: Status 404 returned error can't find the container with id 98ce67caf1519bbfcc31047faf43fa02c497ddda6bbc739cd287828b170ebb8a Jul 17 21:05:11.231952 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:11.231881 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wm82f" event={"ID":"964ecc7c-8a78-4114-acd1-7bbe2489934f","Type":"ContainerStarted","Data":"98ce67caf1519bbfcc31047faf43fa02c497ddda6bbc739cd287828b170ebb8a"} Jul 17 21:05:12.195221 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:12.195085 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-975kn" Jul 17 21:05:16.140952 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:16.140920 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fth8c"] Jul 17 21:05:16.144837 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:16.144811 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:16.149477 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:05:16.149442 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-132-253.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 17 21:05:16.149600 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:05:16.149521 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"metrics-client-ca\" is forbidden: User \"system:node:ip-10-0-132-253.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" type="*v1.ConfigMap" Jul 17 21:05:16.150048 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:05:16.150002 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-kube-rbac-proxy-config\" is forbidden: User \"system:node:ip-10-0-132-253.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret" Jul 17 21:05:16.150308 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:05:16.150208 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-tls\" is forbidden: User \"system:node:ip-10-0-132-253.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret" Jul 17 21:05:16.150308 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:05:16.150239 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-132-253.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 17 21:05:16.150308 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:05:16.150285 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"node-exporter-accelerators-collector-config\" is forbidden: User \"system:node:ip-10-0-132-253.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap" Jul 17 21:05:16.151884 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:05:16.151850 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-dockercfg-qhtzp\" is forbidden: User \"system:node:ip-10-0-132-253.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qhtzp\"" type="*v1.Secret" Jul 17 21:05:16.155709 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:05:16.155675 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"node-exporter-fth8c\" is forbidden: User \"system:node:ip-10-0-132-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-253.ec2.internal' and this object" podUID="d6bc6797-d295-4113-8218-46191bff08cf" pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:16.254775 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:16.254745 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d6bc6797-d295-4113-8218-46191bff08cf-node-exporter-tls\") pod \"node-exporter-fth8c\" (UID: \"d6bc6797-d295-4113-8218-46191bff08cf\") " pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:16.254914 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:16.254783 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6bc6797-d295-4113-8218-46191bff08cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fth8c\" (UID: \"d6bc6797-d295-4113-8218-46191bff08cf\") " pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:16.254914 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:16.254809 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d6bc6797-d295-4113-8218-46191bff08cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-fth8c\" (UID: \"d6bc6797-d295-4113-8218-46191bff08cf\") " pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:16.254914 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:16.254901 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d6bc6797-d295-4113-8218-46191bff08cf-node-exporter-textfile\") pod \"node-exporter-fth8c\" (UID: \"d6bc6797-d295-4113-8218-46191bff08cf\") " pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:16.255090 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:16.254936 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwl5w\" (UniqueName: \"kubernetes.io/projected/d6bc6797-d295-4113-8218-46191bff08cf-kube-api-access-hwl5w\") pod \"node-exporter-fth8c\" (UID: \"d6bc6797-d295-4113-8218-46191bff08cf\") " pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:16.255090 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:16.255053 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d6bc6797-d295-4113-8218-46191bff08cf-root\") pod \"node-exporter-fth8c\" (UID: \"d6bc6797-d295-4113-8218-46191bff08cf\") " pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:16.255090 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:16.255085 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d6bc6797-d295-4113-8218-46191bff08cf-node-exporter-wtmp\") pod \"node-exporter-fth8c\" (UID: \"d6bc6797-d295-4113-8218-46191bff08cf\") " pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:16.255245 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:16.255125 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6bc6797-d295-4113-8218-46191bff08cf-metrics-client-ca\") pod \"node-exporter-fth8c\" (UID: \"d6bc6797-d295-4113-8218-46191bff08cf\") " pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:16.255245 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:16.255162 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6bc6797-d295-4113-8218-46191bff08cf-sys\") pod \"node-exporter-fth8c\" (UID: \"d6bc6797-d295-4113-8218-46191bff08cf\") " pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:16.356626 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:16.356537 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6bc6797-d295-4113-8218-46191bff08cf-metrics-client-ca\") pod \"node-exporter-fth8c\" (UID: \"d6bc6797-d295-4113-8218-46191bff08cf\") " pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:16.356626 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:16.356578 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6bc6797-d295-4113-8218-46191bff08cf-sys\") pod \"node-exporter-fth8c\" (UID: \"d6bc6797-d295-4113-8218-46191bff08cf\") " pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:16.356626 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:16.356627 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d6bc6797-d295-4113-8218-46191bff08cf-node-exporter-tls\") pod \"node-exporter-fth8c\" (UID: \"d6bc6797-d295-4113-8218-46191bff08cf\") " pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:16.356846 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:16.356652 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6bc6797-d295-4113-8218-46191bff08cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fth8c\" (UID: \"d6bc6797-d295-4113-8218-46191bff08cf\") " pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:16.356846 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:16.356681 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d6bc6797-d295-4113-8218-46191bff08cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-fth8c\" (UID: \"d6bc6797-d295-4113-8218-46191bff08cf\") " pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:16.356846 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:16.356721 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d6bc6797-d295-4113-8218-46191bff08cf-node-exporter-textfile\") pod \"node-exporter-fth8c\" (UID: \"d6bc6797-d295-4113-8218-46191bff08cf\") " pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:16.356846 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:16.356747 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwl5w\" (UniqueName: \"kubernetes.io/projected/d6bc6797-d295-4113-8218-46191bff08cf-kube-api-access-hwl5w\") pod \"node-exporter-fth8c\" (UID: \"d6bc6797-d295-4113-8218-46191bff08cf\") " pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:16.356846 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:16.356797 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6bc6797-d295-4113-8218-46191bff08cf-sys\") pod \"node-exporter-fth8c\" (UID: \"d6bc6797-d295-4113-8218-46191bff08cf\") " pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:16.356846 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:16.356828 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d6bc6797-d295-4113-8218-46191bff08cf-root\") pod \"node-exporter-fth8c\" (UID: \"d6bc6797-d295-4113-8218-46191bff08cf\") " pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:16.357143 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:16.356851 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d6bc6797-d295-4113-8218-46191bff08cf-node-exporter-wtmp\") pod \"node-exporter-fth8c\" (UID: \"d6bc6797-d295-4113-8218-46191bff08cf\") " pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:16.357143 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:16.356993 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d6bc6797-d295-4113-8218-46191bff08cf-node-exporter-wtmp\") pod \"node-exporter-fth8c\" (UID: \"d6bc6797-d295-4113-8218-46191bff08cf\") " pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:16.357143 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:16.357035 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d6bc6797-d295-4113-8218-46191bff08cf-root\") pod \"node-exporter-fth8c\" (UID: \"d6bc6797-d295-4113-8218-46191bff08cf\") " pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:16.357325 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:16.357212 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d6bc6797-d295-4113-8218-46191bff08cf-node-exporter-textfile\") pod \"node-exporter-fth8c\" (UID: \"d6bc6797-d295-4113-8218-46191bff08cf\") " pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:17.053427 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.053397 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 17 21:05:17.059991 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.059966 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d6bc6797-d295-4113-8218-46191bff08cf-node-exporter-tls\") pod \"node-exporter-fth8c\" (UID: \"d6bc6797-d295-4113-8218-46191bff08cf\") " pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:17.184029 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.184000 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 17 21:05:17.187961 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.187910 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d6bc6797-d295-4113-8218-46191bff08cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-fth8c\" (UID: \"d6bc6797-d295-4113-8218-46191bff08cf\") " pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:17.214943 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.214916 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 17 21:05:17.246116 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.246092 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qhtzp\"" Jul 17 21:05:17.259837 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.259760 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wm82f" event={"ID":"964ecc7c-8a78-4114-acd1-7bbe2489934f","Type":"ContainerStarted","Data":"eb89ef65685e2eb1a3f2d2110a836f4a2d06f389d8b881d455a7b7f2474964e9"} Jul 17 21:05:17.283332 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.283297 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 21:05:17.287745 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.287698 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.290330 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.290308 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 17 21:05:17.291301 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.291030 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 17 21:05:17.291709 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.291471 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 17 21:05:17.291709 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.291494 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 17 21:05:17.291709 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.291639 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 17 21:05:17.291891 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.291879 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 17 21:05:17.293284 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.292011 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 17 21:05:17.293284 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.292078 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9nx84\"" Jul 17 21:05:17.293284 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.292333 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 17 21:05:17.293284 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.292324 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 17 21:05:17.303724 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.303675 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 21:05:17.327279 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.327252 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 17 21:05:17.340687 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.340638 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6bc6797-d295-4113-8218-46191bff08cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fth8c\" (UID: \"d6bc6797-d295-4113-8218-46191bff08cf\") " pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:17.357204 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:05:17.357112 2580 configmap.go:193] Couldn't get configMap openshift-monitoring/metrics-client-ca: failed to sync configmap cache: timed out waiting for the condition Jul 17 21:05:17.357297 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:05:17.357219 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6bc6797-d295-4113-8218-46191bff08cf-metrics-client-ca podName:d6bc6797-d295-4113-8218-46191bff08cf nodeName:}" failed. No retries permitted until 2026-07-17 21:05:17.857200057 +0000 UTC m=+90.454882704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-client-ca" (UniqueName: "kubernetes.io/configmap/d6bc6797-d295-4113-8218-46191bff08cf-metrics-client-ca") pod "node-exporter-fth8c" (UID: "d6bc6797-d295-4113-8218-46191bff08cf") : failed to sync configmap cache: timed out waiting for the condition Jul 17 21:05:17.365201 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:05:17.365151 2580 projected.go:291] Couldn't get configMap openshift-monitoring/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jul 17 21:05:17.365301 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:05:17.365206 2580 projected.go:196] Error preparing data for projected volume kube-api-access-hwl5w for pod openshift-monitoring/node-exporter-fth8c: failed to sync configmap cache: timed out waiting for the condition Jul 17 21:05:17.365301 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:05:17.365266 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6bc6797-d295-4113-8218-46191bff08cf-kube-api-access-hwl5w podName:d6bc6797-d295-4113-8218-46191bff08cf nodeName:}" failed. No retries permitted until 2026-07-17 21:05:17.865249785 +0000 UTC m=+90.462932411 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hwl5w" (UniqueName: "kubernetes.io/projected/d6bc6797-d295-4113-8218-46191bff08cf-kube-api-access-hwl5w") pod "node-exporter-fth8c" (UID: "d6bc6797-d295-4113-8218-46191bff08cf") : failed to sync configmap cache: timed out waiting for the condition Jul 17 21:05:17.365478 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.365456 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4876b2d3-54ab-4c6f-b498-c0edd19768f2-config-out\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.365543 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.365491 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.365543 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.365516 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.365650 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.365543 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4876b2d3-54ab-4c6f-b498-c0edd19768f2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.365650 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.365576 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2lp5\" (UniqueName: \"kubernetes.io/projected/4876b2d3-54ab-4c6f-b498-c0edd19768f2-kube-api-access-j2lp5\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.365650 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.365640 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4876b2d3-54ab-4c6f-b498-c0edd19768f2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.365799 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.365679 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.365799 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.365706 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.365799 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.365730 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4876b2d3-54ab-4c6f-b498-c0edd19768f2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.365799 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.365767 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-config-volume\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.365799 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.365791 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-web-config\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.366037 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.365856 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.366037 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.365886 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4876b2d3-54ab-4c6f-b498-c0edd19768f2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.437118 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.437094 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 17 21:05:17.467036 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.467012 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4876b2d3-54ab-4c6f-b498-c0edd19768f2-config-out\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.467145 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.467050 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.467145 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.467077 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.467145 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.467104 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4876b2d3-54ab-4c6f-b498-c0edd19768f2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.467145 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.467133 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2lp5\" (UniqueName: \"kubernetes.io/projected/4876b2d3-54ab-4c6f-b498-c0edd19768f2-kube-api-access-j2lp5\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.467384 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.467211 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4876b2d3-54ab-4c6f-b498-c0edd19768f2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.467384 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.467254 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.467384 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.467279 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.467384 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.467304 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4876b2d3-54ab-4c6f-b498-c0edd19768f2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.467384 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.467345 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-config-volume\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.467384 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.467368 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-web-config\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.467677 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.467420 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.467677 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.467449 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4876b2d3-54ab-4c6f-b498-c0edd19768f2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.467806 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.467782 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4876b2d3-54ab-4c6f-b498-c0edd19768f2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.469070 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.469044 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4876b2d3-54ab-4c6f-b498-c0edd19768f2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.469419 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:05:17.469398 2580 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 17 21:05:17.469502 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:05:17.469459 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-secret-alertmanager-main-tls podName:4876b2d3-54ab-4c6f-b498-c0edd19768f2 nodeName:}" failed. No retries permitted until 2026-07-17 21:05:17.969442645 +0000 UTC m=+90.567125271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "4876b2d3-54ab-4c6f-b498-c0edd19768f2") : secret "alertmanager-main-tls" not found Jul 17 21:05:17.471464 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.471439 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-web-config\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.471856 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.471813 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4876b2d3-54ab-4c6f-b498-c0edd19768f2-config-out\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.471980 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.471955 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.472798 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.472770 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4876b2d3-54ab-4c6f-b498-c0edd19768f2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.473685 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.473658 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.473856 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.473833 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-config-volume\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.475075 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.475033 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.475359 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.475338 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.478824 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.478797 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2lp5\" (UniqueName: \"kubernetes.io/projected/4876b2d3-54ab-4c6f-b498-c0edd19768f2-kube-api-access-j2lp5\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.496450 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.496273 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 17 21:05:17.498245 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.498202 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4876b2d3-54ab-4c6f-b498-c0edd19768f2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.871219 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.871169 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwl5w\" (UniqueName: \"kubernetes.io/projected/d6bc6797-d295-4113-8218-46191bff08cf-kube-api-access-hwl5w\") pod \"node-exporter-fth8c\" (UID: \"d6bc6797-d295-4113-8218-46191bff08cf\") " pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:17.871403 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.871292 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6bc6797-d295-4113-8218-46191bff08cf-metrics-client-ca\") pod \"node-exporter-fth8c\" (UID: \"d6bc6797-d295-4113-8218-46191bff08cf\") " pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:17.871916 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.871890 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6bc6797-d295-4113-8218-46191bff08cf-metrics-client-ca\") pod \"node-exporter-fth8c\" (UID: \"d6bc6797-d295-4113-8218-46191bff08cf\") " pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:17.874887 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.874865 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwl5w\" (UniqueName: \"kubernetes.io/projected/d6bc6797-d295-4113-8218-46191bff08cf-kube-api-access-hwl5w\") pod \"node-exporter-fth8c\" (UID: \"d6bc6797-d295-4113-8218-46191bff08cf\") " pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:17.957008 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.956960 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fth8c" Jul 17 21:05:17.970033 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:05:17.970005 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6bc6797_d295_4113_8218_46191bff08cf.slice/crio-e36d7146c7a8a75acc00220d27588d5a920205c9fbb484fd365a700d4ae97533 WatchSource:0}: Error finding container e36d7146c7a8a75acc00220d27588d5a920205c9fbb484fd365a700d4ae97533: Status 404 returned error can't find the container with id e36d7146c7a8a75acc00220d27588d5a920205c9fbb484fd365a700d4ae97533 Jul 17 21:05:17.971894 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.971836 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:17.974866 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:17.974773 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:18.201750 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.201675 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:05:18.207581 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.207554 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6556dd96cc-xgdz8"] Jul 17 21:05:18.211364 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.211344 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" Jul 17 21:05:18.213839 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.213776 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 17 21:05:18.214498 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.214468 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-b5hmm\"" Jul 17 21:05:18.215022 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.214922 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 17 21:05:18.215319 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.215303 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 17 21:05:18.215408 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.215393 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ei7rj3p5059od\"" Jul 17 21:05:18.215625 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.215546 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 17 21:05:18.215724 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.215628 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 17 21:05:18.227365 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.227274 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6556dd96cc-xgdz8"] Jul 17 21:05:18.266055 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.266022 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fth8c" event={"ID":"d6bc6797-d295-4113-8218-46191bff08cf","Type":"ContainerStarted","Data":"e36d7146c7a8a75acc00220d27588d5a920205c9fbb484fd365a700d4ae97533"} Jul 17 21:05:18.273649 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.273511 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b3ec31d-83c0-4764-8594-b219aa21a06d-metrics-client-ca\") pod \"thanos-querier-6556dd96cc-xgdz8\" (UID: \"5b3ec31d-83c0-4764-8594-b219aa21a06d\") " pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" Jul 17 21:05:18.273649 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.273539 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5b3ec31d-83c0-4764-8594-b219aa21a06d-secret-grpc-tls\") pod \"thanos-querier-6556dd96cc-xgdz8\" (UID: \"5b3ec31d-83c0-4764-8594-b219aa21a06d\") " pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" Jul 17 21:05:18.273649 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.273555 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65zz8\" (UniqueName: \"kubernetes.io/projected/5b3ec31d-83c0-4764-8594-b219aa21a06d-kube-api-access-65zz8\") pod \"thanos-querier-6556dd96cc-xgdz8\" (UID: \"5b3ec31d-83c0-4764-8594-b219aa21a06d\") " pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" Jul 17 21:05:18.273649 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.273589 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5b3ec31d-83c0-4764-8594-b219aa21a06d-secret-thanos-querier-tls\") pod \"thanos-querier-6556dd96cc-xgdz8\" (UID: \"5b3ec31d-83c0-4764-8594-b219aa21a06d\") " pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" Jul 17 21:05:18.273649 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.273624 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b3ec31d-83c0-4764-8594-b219aa21a06d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6556dd96cc-xgdz8\" (UID: \"5b3ec31d-83c0-4764-8594-b219aa21a06d\") " pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" Jul 17 21:05:18.273961 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.273700 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5b3ec31d-83c0-4764-8594-b219aa21a06d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6556dd96cc-xgdz8\" (UID: \"5b3ec31d-83c0-4764-8594-b219aa21a06d\") " pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" Jul 17 21:05:18.273961 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.273730 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5b3ec31d-83c0-4764-8594-b219aa21a06d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6556dd96cc-xgdz8\" (UID: \"5b3ec31d-83c0-4764-8594-b219aa21a06d\") " pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" Jul 17 21:05:18.273961 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.273761 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b3ec31d-83c0-4764-8594-b219aa21a06d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6556dd96cc-xgdz8\" (UID: \"5b3ec31d-83c0-4764-8594-b219aa21a06d\") " pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" Jul 17 21:05:18.374448 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.374411 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b3ec31d-83c0-4764-8594-b219aa21a06d-metrics-client-ca\") pod \"thanos-querier-6556dd96cc-xgdz8\" (UID: \"5b3ec31d-83c0-4764-8594-b219aa21a06d\") " pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" Jul 17 21:05:18.374448 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.374448 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5b3ec31d-83c0-4764-8594-b219aa21a06d-secret-grpc-tls\") pod \"thanos-querier-6556dd96cc-xgdz8\" (UID: \"5b3ec31d-83c0-4764-8594-b219aa21a06d\") " pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" Jul 17 21:05:18.374652 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.374469 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65zz8\" (UniqueName: \"kubernetes.io/projected/5b3ec31d-83c0-4764-8594-b219aa21a06d-kube-api-access-65zz8\") pod \"thanos-querier-6556dd96cc-xgdz8\" (UID: \"5b3ec31d-83c0-4764-8594-b219aa21a06d\") " pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" Jul 17 21:05:18.374652 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.374519 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5b3ec31d-83c0-4764-8594-b219aa21a06d-secret-thanos-querier-tls\") pod \"thanos-querier-6556dd96cc-xgdz8\" (UID: \"5b3ec31d-83c0-4764-8594-b219aa21a06d\") " pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" Jul 17 21:05:18.374652 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.374554 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b3ec31d-83c0-4764-8594-b219aa21a06d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6556dd96cc-xgdz8\" (UID: \"5b3ec31d-83c0-4764-8594-b219aa21a06d\") " pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" Jul 17 21:05:18.374652 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.374610 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5b3ec31d-83c0-4764-8594-b219aa21a06d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6556dd96cc-xgdz8\" (UID: \"5b3ec31d-83c0-4764-8594-b219aa21a06d\") " pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" Jul 17 21:05:18.374652 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.374642 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5b3ec31d-83c0-4764-8594-b219aa21a06d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6556dd96cc-xgdz8\" (UID: \"5b3ec31d-83c0-4764-8594-b219aa21a06d\") " pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" Jul 17 21:05:18.374883 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.374675 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b3ec31d-83c0-4764-8594-b219aa21a06d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6556dd96cc-xgdz8\" (UID: \"5b3ec31d-83c0-4764-8594-b219aa21a06d\") " pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" Jul 17 21:05:18.375287 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.375236 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b3ec31d-83c0-4764-8594-b219aa21a06d-metrics-client-ca\") pod \"thanos-querier-6556dd96cc-xgdz8\" (UID: \"5b3ec31d-83c0-4764-8594-b219aa21a06d\") " pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" Jul 17 21:05:18.377912 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.377864 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b3ec31d-83c0-4764-8594-b219aa21a06d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6556dd96cc-xgdz8\" (UID: \"5b3ec31d-83c0-4764-8594-b219aa21a06d\") " pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" Jul 17 21:05:18.378110 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.378086 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5b3ec31d-83c0-4764-8594-b219aa21a06d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6556dd96cc-xgdz8\" (UID: \"5b3ec31d-83c0-4764-8594-b219aa21a06d\") " pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" Jul 17 21:05:18.378217 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.378156 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5b3ec31d-83c0-4764-8594-b219aa21a06d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6556dd96cc-xgdz8\" (UID: \"5b3ec31d-83c0-4764-8594-b219aa21a06d\") " pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" Jul 17 21:05:18.378483 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.378458 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5b3ec31d-83c0-4764-8594-b219aa21a06d-secret-thanos-querier-tls\") pod \"thanos-querier-6556dd96cc-xgdz8\" (UID: \"5b3ec31d-83c0-4764-8594-b219aa21a06d\") " pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" Jul 17 21:05:18.378941 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.378920 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5b3ec31d-83c0-4764-8594-b219aa21a06d-secret-grpc-tls\") pod \"thanos-querier-6556dd96cc-xgdz8\" (UID: \"5b3ec31d-83c0-4764-8594-b219aa21a06d\") " pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" Jul 17 21:05:18.379698 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.379678 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b3ec31d-83c0-4764-8594-b219aa21a06d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6556dd96cc-xgdz8\" (UID: \"5b3ec31d-83c0-4764-8594-b219aa21a06d\") " pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" Jul 17 21:05:18.389887 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.389854 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65zz8\" (UniqueName: \"kubernetes.io/projected/5b3ec31d-83c0-4764-8594-b219aa21a06d-kube-api-access-65zz8\") pod \"thanos-querier-6556dd96cc-xgdz8\" (UID: \"5b3ec31d-83c0-4764-8594-b219aa21a06d\") " pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" Jul 17 21:05:18.529902 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:18.529820 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" Jul 17 21:05:21.371399 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.371365 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6b4d5bb96f-l987w"] Jul 17 21:05:21.375360 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.375338 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" Jul 17 21:05:21.378657 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.378629 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 17 21:05:21.379225 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.379202 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 17 21:05:21.379341 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.379278 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 17 21:05:21.379341 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.379297 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 17 21:05:21.379664 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.379648 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-4zvpq\"" Jul 17 21:05:21.380394 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.380369 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 17 21:05:21.385740 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.385720 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 17 21:05:21.396666 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.396641 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6b4d5bb96f-l987w"] Jul 17 21:05:21.504035 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.504004 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40396164-92a4-4c00-a566-36e39d60a3fa-metrics-client-ca\") pod \"telemeter-client-6b4d5bb96f-l987w\" (UID: \"40396164-92a4-4c00-a566-36e39d60a3fa\") " pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" Jul 17 21:05:21.504220 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.504082 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/40396164-92a4-4c00-a566-36e39d60a3fa-federate-client-tls\") pod \"telemeter-client-6b4d5bb96f-l987w\" (UID: \"40396164-92a4-4c00-a566-36e39d60a3fa\") " pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" Jul 17 21:05:21.504220 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.504121 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/40396164-92a4-4c00-a566-36e39d60a3fa-secret-telemeter-client\") pod \"telemeter-client-6b4d5bb96f-l987w\" (UID: \"40396164-92a4-4c00-a566-36e39d60a3fa\") " pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" Jul 17 21:05:21.504220 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.504142 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/40396164-92a4-4c00-a566-36e39d60a3fa-telemeter-client-tls\") pod \"telemeter-client-6b4d5bb96f-l987w\" (UID: \"40396164-92a4-4c00-a566-36e39d60a3fa\") " pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" Jul 17 21:05:21.504220 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.504173 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt68r\" (UniqueName: \"kubernetes.io/projected/40396164-92a4-4c00-a566-36e39d60a3fa-kube-api-access-mt68r\") pod \"telemeter-client-6b4d5bb96f-l987w\" (UID: \"40396164-92a4-4c00-a566-36e39d60a3fa\") " pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" Jul 17 21:05:21.504449 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.504246 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40396164-92a4-4c00-a566-36e39d60a3fa-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b4d5bb96f-l987w\" (UID: \"40396164-92a4-4c00-a566-36e39d60a3fa\") " pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" Jul 17 21:05:21.504449 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.504267 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40396164-92a4-4c00-a566-36e39d60a3fa-serving-certs-ca-bundle\") pod \"telemeter-client-6b4d5bb96f-l987w\" (UID: \"40396164-92a4-4c00-a566-36e39d60a3fa\") " pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" Jul 17 21:05:21.504449 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.504292 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40396164-92a4-4c00-a566-36e39d60a3fa-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b4d5bb96f-l987w\" (UID: \"40396164-92a4-4c00-a566-36e39d60a3fa\") " pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" Jul 17 21:05:21.605494 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.605464 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40396164-92a4-4c00-a566-36e39d60a3fa-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b4d5bb96f-l987w\" (UID: \"40396164-92a4-4c00-a566-36e39d60a3fa\") " pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" Jul 17 21:05:21.605646 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.605507 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40396164-92a4-4c00-a566-36e39d60a3fa-serving-certs-ca-bundle\") pod \"telemeter-client-6b4d5bb96f-l987w\" (UID: \"40396164-92a4-4c00-a566-36e39d60a3fa\") " pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" Jul 17 21:05:21.605646 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.605537 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40396164-92a4-4c00-a566-36e39d60a3fa-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b4d5bb96f-l987w\" (UID: \"40396164-92a4-4c00-a566-36e39d60a3fa\") " pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" Jul 17 21:05:21.605646 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.605576 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40396164-92a4-4c00-a566-36e39d60a3fa-metrics-client-ca\") pod \"telemeter-client-6b4d5bb96f-l987w\" (UID: \"40396164-92a4-4c00-a566-36e39d60a3fa\") " pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" Jul 17 21:05:21.605788 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.605651 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/40396164-92a4-4c00-a566-36e39d60a3fa-federate-client-tls\") pod \"telemeter-client-6b4d5bb96f-l987w\" (UID: \"40396164-92a4-4c00-a566-36e39d60a3fa\") " pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" Jul 17 21:05:21.605788 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.605684 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/40396164-92a4-4c00-a566-36e39d60a3fa-secret-telemeter-client\") pod \"telemeter-client-6b4d5bb96f-l987w\" (UID: \"40396164-92a4-4c00-a566-36e39d60a3fa\") " pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" Jul 17 21:05:21.605788 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.605700 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/40396164-92a4-4c00-a566-36e39d60a3fa-telemeter-client-tls\") pod \"telemeter-client-6b4d5bb96f-l987w\" (UID: \"40396164-92a4-4c00-a566-36e39d60a3fa\") " pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" Jul 17 21:05:21.605788 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.605725 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt68r\" (UniqueName: \"kubernetes.io/projected/40396164-92a4-4c00-a566-36e39d60a3fa-kube-api-access-mt68r\") pod \"telemeter-client-6b4d5bb96f-l987w\" (UID: \"40396164-92a4-4c00-a566-36e39d60a3fa\") " pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" Jul 17 21:05:21.606286 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.606171 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40396164-92a4-4c00-a566-36e39d60a3fa-serving-certs-ca-bundle\") pod \"telemeter-client-6b4d5bb96f-l987w\" (UID: \"40396164-92a4-4c00-a566-36e39d60a3fa\") " pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" Jul 17 21:05:21.606447 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.606416 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40396164-92a4-4c00-a566-36e39d60a3fa-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b4d5bb96f-l987w\" (UID: \"40396164-92a4-4c00-a566-36e39d60a3fa\") " pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" Jul 17 21:05:21.606816 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.606787 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40396164-92a4-4c00-a566-36e39d60a3fa-metrics-client-ca\") pod \"telemeter-client-6b4d5bb96f-l987w\" (UID: \"40396164-92a4-4c00-a566-36e39d60a3fa\") " pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" Jul 17 21:05:21.608709 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.608688 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/40396164-92a4-4c00-a566-36e39d60a3fa-secret-telemeter-client\") pod \"telemeter-client-6b4d5bb96f-l987w\" (UID: \"40396164-92a4-4c00-a566-36e39d60a3fa\") " pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" Jul 17 21:05:21.608904 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.608875 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40396164-92a4-4c00-a566-36e39d60a3fa-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b4d5bb96f-l987w\" (UID: \"40396164-92a4-4c00-a566-36e39d60a3fa\") " pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" Jul 17 21:05:21.608976 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.608887 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/40396164-92a4-4c00-a566-36e39d60a3fa-telemeter-client-tls\") pod \"telemeter-client-6b4d5bb96f-l987w\" (UID: \"40396164-92a4-4c00-a566-36e39d60a3fa\") " pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" Jul 17 21:05:21.608976 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.608916 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/40396164-92a4-4c00-a566-36e39d60a3fa-federate-client-tls\") pod \"telemeter-client-6b4d5bb96f-l987w\" (UID: \"40396164-92a4-4c00-a566-36e39d60a3fa\") " pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" Jul 17 21:05:21.615586 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.615567 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt68r\" (UniqueName: \"kubernetes.io/projected/40396164-92a4-4c00-a566-36e39d60a3fa-kube-api-access-mt68r\") pod \"telemeter-client-6b4d5bb96f-l987w\" (UID: \"40396164-92a4-4c00-a566-36e39d60a3fa\") " pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" Jul 17 21:05:21.688674 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:21.688611 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" Jul 17 21:05:27.790139 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:27.789952 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6556dd96cc-xgdz8"] Jul 17 21:05:27.959077 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:05:27.958993 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b3ec31d_83c0_4764_8594_b219aa21a06d.slice/crio-9db605f5203c7be68a98f882715f52f8b7466d7dd5c6f77bf2ec39a9b9d44349 WatchSource:0}: Error finding container 9db605f5203c7be68a98f882715f52f8b7466d7dd5c6f77bf2ec39a9b9d44349: Status 404 returned error can't find the container with id 9db605f5203c7be68a98f882715f52f8b7466d7dd5c6f77bf2ec39a9b9d44349 Jul 17 21:05:28.014384 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:28.014309 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6b4d5bb96f-l987w"] Jul 17 21:05:28.018329 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:05:28.018251 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40396164_92a4_4c00_a566_36e39d60a3fa.slice/crio-c8fb797c156c47c1ad61193110b087b862475b02156d81576bf1039ec582d1d9 WatchSource:0}: Error finding container c8fb797c156c47c1ad61193110b087b862475b02156d81576bf1039ec582d1d9: Status 404 returned error can't find the container with id c8fb797c156c47c1ad61193110b087b862475b02156d81576bf1039ec582d1d9 Jul 17 21:05:28.023508 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:28.023418 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 21:05:28.028453 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:05:28.028427 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4876b2d3_54ab_4c6f_b498_c0edd19768f2.slice/crio-a65c29e0545cdee07e8c6fd941ee0039a8b30bbb2c7990b3ecdf53931eaff526 WatchSource:0}: Error finding container a65c29e0545cdee07e8c6fd941ee0039a8b30bbb2c7990b3ecdf53931eaff526: Status 404 returned error can't find the container with id a65c29e0545cdee07e8c6fd941ee0039a8b30bbb2c7990b3ecdf53931eaff526 Jul 17 21:05:28.305509 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:28.305465 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" event={"ID":"40396164-92a4-4c00-a566-36e39d60a3fa","Type":"ContainerStarted","Data":"c8fb797c156c47c1ad61193110b087b862475b02156d81576bf1039ec582d1d9"} Jul 17 21:05:28.306950 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:28.306875 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" event={"ID":"5b3ec31d-83c0-4764-8594-b219aa21a06d","Type":"ContainerStarted","Data":"9db605f5203c7be68a98f882715f52f8b7466d7dd5c6f77bf2ec39a9b9d44349"} Jul 17 21:05:28.309164 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:28.309136 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wm82f" event={"ID":"964ecc7c-8a78-4114-acd1-7bbe2489934f","Type":"ContainerStarted","Data":"7cf515db65746f7680be375e3b0f83d1b7b4a99398327e937c1b1cdd4ae694e3"} Jul 17 21:05:28.310529 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:28.310500 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4876b2d3-54ab-4c6f-b498-c0edd19768f2","Type":"ContainerStarted","Data":"a65c29e0545cdee07e8c6fd941ee0039a8b30bbb2c7990b3ecdf53931eaff526"} Jul 17 21:05:28.312247 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:28.312219 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-x5bnf" event={"ID":"0b7d88bd-9c02-4c36-94a2-365b49da41c8","Type":"ContainerStarted","Data":"098f8562be89c6f69b1c76bc13ff4963896b289e4867015c57bccad1d0bffb00"} Jul 17 21:05:28.312462 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:28.312436 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-x5bnf" Jul 17 21:05:28.314979 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:28.314957 2580 generic.go:356] "Generic (PLEG): container finished" podID="d6bc6797-d295-4113-8218-46191bff08cf" containerID="44daa84e77bdeca89b2f3481f818e951cdd289d9ee3218007e05d41a674ea790" exitCode=0 Jul 17 21:05:28.315068 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:28.315017 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fth8c" event={"ID":"d6bc6797-d295-4113-8218-46191bff08cf","Type":"ContainerDied","Data":"44daa84e77bdeca89b2f3481f818e951cdd289d9ee3218007e05d41a674ea790"} Jul 17 21:05:28.330098 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:28.330058 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-x5bnf" Jul 17 21:05:28.355342 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:28.355294 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-x5bnf" podStartSLOduration=1.445466628 podStartE2EDuration="21.35527712s" totalImagesPullingTime="19.909810492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:05:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:28.333097826 +0000 UTC m=+100.930780468" watchObservedRunningTime="2026-07-17 21:05:28.35527712 +0000 UTC m=+100.952959763" Jul 17 21:05:29.232657 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:29.232431 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:05:29.237377 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:29.237345 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7b4d7d85db-nh59d" Jul 17 21:05:29.343883 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:29.343843 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fth8c" event={"ID":"d6bc6797-d295-4113-8218-46191bff08cf","Type":"ContainerStarted","Data":"d03f07cd86e4cc1578983a70560fc1bf74667cff7e8f227a7b2ec44108111728"} Jul 17 21:05:29.344047 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:29.343942 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fth8c" event={"ID":"d6bc6797-d295-4113-8218-46191bff08cf","Type":"ContainerStarted","Data":"4477b34b0a875e1dbacf9eca420b25941ac6aa4aeb6a8e92f4fa44a025fdf7a8"} Jul 17 21:05:29.364917 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:29.364865 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fth8c" podStartSLOduration=3.249011684 podStartE2EDuration="13.36484621s" totalImagesPullingTime="10.045330461s" totalInitContainerRuntime="70.504065ms" isStatefulPod=true podCreationTimestamp="2026-07-17 21:05:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:29.364102255 +0000 UTC m=+101.961784900" watchObservedRunningTime="2026-07-17 21:05:29.36484621 +0000 UTC m=+101.962528856" Jul 17 21:05:31.187021 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:31.186981 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rwnns" Jul 17 21:05:34.247351 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:34.247278 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" podUID="bba29410-5b7f-4187-8a11-91b4185cddbb" containerName="registry" containerID="cri-o://bec8add8e506050c276cbc66d01f937f163484873e63e6c68430469706c9860f" gracePeriod=30 Jul 17 21:05:34.790818 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:34.790590 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:05:34.939070 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:34.939048 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bba29410-5b7f-4187-8a11-91b4185cddbb-installation-pull-secrets\") pod \"bba29410-5b7f-4187-8a11-91b4185cddbb\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " Jul 17 21:05:34.939170 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:34.939085 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-tls\") pod \"bba29410-5b7f-4187-8a11-91b4185cddbb\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " Jul 17 21:05:34.939170 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:34.939146 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bba29410-5b7f-4187-8a11-91b4185cddbb-trusted-ca\") pod \"bba29410-5b7f-4187-8a11-91b4185cddbb\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " Jul 17 21:05:34.939312 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:34.939172 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bba29410-5b7f-4187-8a11-91b4185cddbb-ca-trust-extracted\") pod \"bba29410-5b7f-4187-8a11-91b4185cddbb\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " Jul 17 21:05:34.939312 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:34.939226 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-certificates\") pod \"bba29410-5b7f-4187-8a11-91b4185cddbb\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " Jul 17 21:05:34.939312 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:34.939272 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bba29410-5b7f-4187-8a11-91b4185cddbb-image-registry-private-configuration\") pod \"bba29410-5b7f-4187-8a11-91b4185cddbb\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " Jul 17 21:05:34.939539 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:34.939322 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-bound-sa-token\") pod \"bba29410-5b7f-4187-8a11-91b4185cddbb\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " Jul 17 21:05:34.939539 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:34.939369 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tc7b\" (UniqueName: \"kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-kube-api-access-9tc7b\") pod \"bba29410-5b7f-4187-8a11-91b4185cddbb\" (UID: \"bba29410-5b7f-4187-8a11-91b4185cddbb\") " Jul 17 21:05:34.939653 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:34.939588 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bba29410-5b7f-4187-8a11-91b4185cddbb-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "bba29410-5b7f-4187-8a11-91b4185cddbb" (UID: "bba29410-5b7f-4187-8a11-91b4185cddbb"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:05:34.939824 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:34.939722 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "bba29410-5b7f-4187-8a11-91b4185cddbb" (UID: "bba29410-5b7f-4187-8a11-91b4185cddbb"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:05:34.942322 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:34.942209 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bba29410-5b7f-4187-8a11-91b4185cddbb-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "bba29410-5b7f-4187-8a11-91b4185cddbb" (UID: "bba29410-5b7f-4187-8a11-91b4185cddbb"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:05:34.944471 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:34.943049 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "bba29410-5b7f-4187-8a11-91b4185cddbb" (UID: "bba29410-5b7f-4187-8a11-91b4185cddbb"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:05:34.944471 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:34.943120 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "bba29410-5b7f-4187-8a11-91b4185cddbb" (UID: "bba29410-5b7f-4187-8a11-91b4185cddbb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:05:34.944471 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:34.943141 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bba29410-5b7f-4187-8a11-91b4185cddbb-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "bba29410-5b7f-4187-8a11-91b4185cddbb" (UID: "bba29410-5b7f-4187-8a11-91b4185cddbb"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:05:34.947047 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:34.944735 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-kube-api-access-9tc7b" (OuterVolumeSpecName: "kube-api-access-9tc7b") pod "bba29410-5b7f-4187-8a11-91b4185cddbb" (UID: "bba29410-5b7f-4187-8a11-91b4185cddbb"). InnerVolumeSpecName "kube-api-access-9tc7b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:05:34.951348 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:34.951322 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bba29410-5b7f-4187-8a11-91b4185cddbb-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "bba29410-5b7f-4187-8a11-91b4185cddbb" (UID: "bba29410-5b7f-4187-8a11-91b4185cddbb"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:05:35.040359 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:35.040329 2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-bound-sa-token\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:05:35.040359 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:35.040355 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tc7b\" (UniqueName: \"kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-kube-api-access-9tc7b\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:05:35.040536 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:35.040370 2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bba29410-5b7f-4187-8a11-91b4185cddbb-installation-pull-secrets\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:05:35.040536 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:35.040384 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-tls\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:05:35.040536 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:35.040399 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bba29410-5b7f-4187-8a11-91b4185cddbb-trusted-ca\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:05:35.040536 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:35.040411 2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bba29410-5b7f-4187-8a11-91b4185cddbb-ca-trust-extracted\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:05:35.040536 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:35.040425 2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bba29410-5b7f-4187-8a11-91b4185cddbb-registry-certificates\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:05:35.040536 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:35.040438 2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bba29410-5b7f-4187-8a11-91b4185cddbb-image-registry-private-configuration\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:05:35.375361 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:35.375317 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" event={"ID":"40396164-92a4-4c00-a566-36e39d60a3fa","Type":"ContainerStarted","Data":"075076239f6166cdb00e62b94c8bf5ae5546b2827bf88de5fcbae8ba26d6f1ec"} Jul 17 21:05:35.375899 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:35.375397 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" event={"ID":"40396164-92a4-4c00-a566-36e39d60a3fa","Type":"ContainerStarted","Data":"44cd1ca2ca653095e852e8dea2dc9372ad3d189e98809c62f4968d779a1339e4"} Jul 17 21:05:35.375899 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:35.375426 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" event={"ID":"40396164-92a4-4c00-a566-36e39d60a3fa","Type":"ContainerStarted","Data":"7d4d03f82a57bbbd36be74ba1a08209f408f03911120d18bd4b72283c0020eca"} Jul 17 21:05:35.377944 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:35.377906 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" event={"ID":"5b3ec31d-83c0-4764-8594-b219aa21a06d","Type":"ContainerStarted","Data":"1bd39df3708efc6c7ace7cf30e36c657e8a3d8de3e63d8b1f1a8a79cc2b969f3"} Jul 17 21:05:35.378131 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:35.378104 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" event={"ID":"5b3ec31d-83c0-4764-8594-b219aa21a06d","Type":"ContainerStarted","Data":"7f6aafcefdcf122a127c075e3a732a9fb1dac47d5d48afb7c68e3957a831dce4"} Jul 17 21:05:35.378237 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:35.378156 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" event={"ID":"5b3ec31d-83c0-4764-8594-b219aa21a06d","Type":"ContainerStarted","Data":"4c6509a6d88f8151faaaf106077feb820ee353a96619659a6e726e6ad107092a"} Jul 17 21:05:35.380418 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:35.380384 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wm82f" event={"ID":"964ecc7c-8a78-4114-acd1-7bbe2489934f","Type":"ContainerStarted","Data":"491b3ede50a90aab174ec2a7c661d9e1d75216d28a81a7091e213d9bb2e9aafa"} Jul 17 21:05:35.382083 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:35.382060 2580 generic.go:356] "Generic (PLEG): container finished" podID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerID="404fe25a25434f572f28bbcc19aeb92fdad0c895f270d64c157f70fa489d28e8" exitCode=0 Jul 17 21:05:35.382210 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:35.382144 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4876b2d3-54ab-4c6f-b498-c0edd19768f2","Type":"ContainerDied","Data":"404fe25a25434f572f28bbcc19aeb92fdad0c895f270d64c157f70fa489d28e8"} Jul 17 21:05:35.383494 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:35.383469 2580 generic.go:356] "Generic (PLEG): container finished" podID="bba29410-5b7f-4187-8a11-91b4185cddbb" containerID="bec8add8e506050c276cbc66d01f937f163484873e63e6c68430469706c9860f" exitCode=0 Jul 17 21:05:35.383581 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:35.383514 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" Jul 17 21:05:35.383581 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:35.383526 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" event={"ID":"bba29410-5b7f-4187-8a11-91b4185cddbb","Type":"ContainerDied","Data":"bec8add8e506050c276cbc66d01f937f163484873e63e6c68430469706c9860f"} Jul 17 21:05:35.383581 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:35.383569 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5879d7dbf6-6rrr8" event={"ID":"bba29410-5b7f-4187-8a11-91b4185cddbb","Type":"ContainerDied","Data":"e0d9f1f0e1dc68287c8be6773d061b9a02fbbcbe910af565776577e71fac38a8"} Jul 17 21:05:35.383726 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:35.383594 2580 scope.go:117] "RemoveContainer" containerID="bec8add8e506050c276cbc66d01f937f163484873e63e6c68430469706c9860f" Jul 17 21:05:35.394233 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:35.394212 2580 scope.go:117] "RemoveContainer" containerID="bec8add8e506050c276cbc66d01f937f163484873e63e6c68430469706c9860f" Jul 17 21:05:35.394592 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:05:35.394568 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bec8add8e506050c276cbc66d01f937f163484873e63e6c68430469706c9860f\": container with ID starting with bec8add8e506050c276cbc66d01f937f163484873e63e6c68430469706c9860f not found: ID does not exist" containerID="bec8add8e506050c276cbc66d01f937f163484873e63e6c68430469706c9860f" Jul 17 21:05:35.394676 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:35.394597 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bec8add8e506050c276cbc66d01f937f163484873e63e6c68430469706c9860f"} err="failed to get container status \"bec8add8e506050c276cbc66d01f937f163484873e63e6c68430469706c9860f\": rpc error: code = NotFound desc = could not find container \"bec8add8e506050c276cbc66d01f937f163484873e63e6c68430469706c9860f\": container with ID starting with bec8add8e506050c276cbc66d01f937f163484873e63e6c68430469706c9860f not found: ID does not exist" Jul 17 21:05:35.401543 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:35.401498 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6b4d5bb96f-l987w" podStartSLOduration=7.794622459 podStartE2EDuration="14.401480752s" totalImagesPullingTime="6.606858293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:05:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:35.39946849 +0000 UTC m=+107.997151134" watchObservedRunningTime="2026-07-17 21:05:35.401480752 +0000 UTC m=+107.999163396" Jul 17 21:05:35.420722 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:35.420701 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5879d7dbf6-6rrr8"] Jul 17 21:05:35.430641 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:35.430602 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5879d7dbf6-6rrr8"] Jul 17 21:05:35.481475 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:35.481427 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wm82f" podStartSLOduration=33.98546699 podStartE2EDuration="57.481410823s" totalImagesPullingTime="23.495943833s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:04:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:35.479795264 +0000 UTC m=+108.077477925" watchObservedRunningTime="2026-07-17 21:05:35.481410823 +0000 UTC m=+108.079093469" Jul 17 21:05:35.857292 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:35.857254 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bba29410-5b7f-4187-8a11-91b4185cddbb" path="/var/lib/kubelet/pods/bba29410-5b7f-4187-8a11-91b4185cddbb/volumes" Jul 17 21:05:37.396236 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:37.396201 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" event={"ID":"5b3ec31d-83c0-4764-8594-b219aa21a06d","Type":"ContainerStarted","Data":"6b5240b6c577081fca67c39b3bee5c155a3874d4997f7d44bbebcb65f0b3e07d"} Jul 17 21:05:37.396784 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:37.396280 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" event={"ID":"5b3ec31d-83c0-4764-8594-b219aa21a06d","Type":"ContainerStarted","Data":"a7f871435271cd3a83ba1636ca228ae3a6fb57d6e24d4b8552e4e50b1f64937f"} Jul 17 21:05:37.396784 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:37.396326 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" event={"ID":"5b3ec31d-83c0-4764-8594-b219aa21a06d","Type":"ContainerStarted","Data":"b3a319bb4caa58d69edc0f3f9d8b4ca1c49c52bea4643df6f91aeca4ff663a5c"} Jul 17 21:05:37.396784 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:37.396374 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" Jul 17 21:05:37.427576 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:37.423795 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" podStartSLOduration=11.303338077 podStartE2EDuration="19.423774922s" totalImagesPullingTime="8.120436845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:05:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:37.419642183 +0000 UTC m=+110.017324827" watchObservedRunningTime="2026-07-17 21:05:37.423774922 +0000 UTC m=+110.021457566" Jul 17 21:05:39.425625 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:39.425590 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4876b2d3-54ab-4c6f-b498-c0edd19768f2","Type":"ContainerStarted","Data":"284b1e3769d60b7ca0ea39db06f770df700b2a9eacd32654647a1a7c09161afd"} Jul 17 21:05:39.426070 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:39.425655 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4876b2d3-54ab-4c6f-b498-c0edd19768f2","Type":"ContainerStarted","Data":"8f3e75201934ab996d2b6109f9a0f513f25d9cd2a067c4278ba7e6d382eff50f"} Jul 17 21:05:39.426070 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:39.425681 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4876b2d3-54ab-4c6f-b498-c0edd19768f2","Type":"ContainerStarted","Data":"26f1c7565e6a826407812171827dca5eb8fad2836349ad80484975e0c9acb413"} Jul 17 21:05:39.426070 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:39.425707 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4876b2d3-54ab-4c6f-b498-c0edd19768f2","Type":"ContainerStarted","Data":"b8ac3a3393f48307222f3cb572f84cdadd5386fabb5121d5ed796f557154b55a"} Jul 17 21:05:39.426070 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:39.425729 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4876b2d3-54ab-4c6f-b498-c0edd19768f2","Type":"ContainerStarted","Data":"ba755a432866e46f0c00416952f28e8bf546616ea35dfdce20ad29e8ca0252da"} Jul 17 21:05:39.426070 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:39.425767 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4876b2d3-54ab-4c6f-b498-c0edd19768f2","Type":"ContainerStarted","Data":"8b1f0076f33ed3f6ddeb7a315db8f4c81da3da03bd0b685cd74b049ae8de2f76"} Jul 17 21:05:39.457541 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:39.457495 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=12.837997877 podStartE2EDuration="22.45747855s" totalImagesPullingTime="9.58151108s" totalInitContainerRuntime="37.969593ms" isStatefulPod=false podCreationTimestamp="2026-07-17 21:05:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:39.455713435 +0000 UTC m=+112.053396078" watchObservedRunningTime="2026-07-17 21:05:39.45747855 +0000 UTC m=+112.055161193" Jul 17 21:05:42.439514 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:42.439479 2580 generic.go:356] "Generic (PLEG): container finished" podID="804719d7-515b-43b2-b9c3-06ca4f9108c0" containerID="873c34e5ae65b5a6005e98f218a7fb55b7fa50a903638f98d76d3b88f5f06245" exitCode=0 Jul 17 21:05:42.439912 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:42.439553 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-jww4g" event={"ID":"804719d7-515b-43b2-b9c3-06ca4f9108c0","Type":"ContainerDied","Data":"873c34e5ae65b5a6005e98f218a7fb55b7fa50a903638f98d76d3b88f5f06245"} Jul 17 21:05:42.439912 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:42.439880 2580 scope.go:117] "RemoveContainer" containerID="873c34e5ae65b5a6005e98f218a7fb55b7fa50a903638f98d76d3b88f5f06245" Jul 17 21:05:42.774851 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:42.774763 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-82mmq_27b81838-ea05-4402-8c37-3538241228db/serve-healthcheck-canary/0.log" Jul 17 21:05:43.424367 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:43.424336 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6556dd96cc-xgdz8" Jul 17 21:05:43.444767 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:43.444741 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-jww4g" event={"ID":"804719d7-515b-43b2-b9c3-06ca4f9108c0","Type":"ContainerStarted","Data":"41eaac7c0287d958a8fee2f5bedf1bdd27ce7b25cbce61694c80dbea1d5ec43f"} Jul 17 21:05:56.497356 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:56.497301 2580 generic.go:356] "Generic (PLEG): container finished" podID="c9ee56af-87eb-42ae-bf0b-96477c5a90cb" containerID="b1d4553f6f5eda59a2d9a597ee1a62bcea00381b87735cf570964baf191e85c7" exitCode=0 Jul 17 21:05:56.497871 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:56.497376 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlfvd" event={"ID":"c9ee56af-87eb-42ae-bf0b-96477c5a90cb","Type":"ContainerDied","Data":"b1d4553f6f5eda59a2d9a597ee1a62bcea00381b87735cf570964baf191e85c7"} Jul 17 21:05:56.498156 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:56.498136 2580 scope.go:117] "RemoveContainer" containerID="b1d4553f6f5eda59a2d9a597ee1a62bcea00381b87735cf570964baf191e85c7" Jul 17 21:05:57.503247 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:57.503212 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-tlfvd" event={"ID":"c9ee56af-87eb-42ae-bf0b-96477c5a90cb","Type":"ContainerStarted","Data":"07355eafcc9d39d4785f0d750600034d02015a3bba116971697ede9f6840d5d4"} Jul 17 21:05:57.727609 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:57.727581 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c55f0556-d46b-468c-922b-364681e608cc-metrics-certs\") pod \"network-metrics-daemon-7z4zp\" (UID: \"c55f0556-d46b-468c-922b-364681e608cc\") " pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:05:57.729586 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:57.729563 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c55f0556-d46b-468c-922b-364681e608cc-metrics-certs\") pod \"network-metrics-daemon-7z4zp\" (UID: \"c55f0556-d46b-468c-922b-364681e608cc\") " pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:05:57.865892 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:57.865872 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pkggp\"" Jul 17 21:05:57.873758 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:57.873742 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7z4zp" Jul 17 21:05:58.012562 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:58.012530 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7z4zp"] Jul 17 21:05:58.017645 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:05:58.017615 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc55f0556_d46b_468c_922b_364681e608cc.slice/crio-07fa354f36cb692bbf0b247b13763c095108ae76ff15ac8adbfee5135fdecf21 WatchSource:0}: Error finding container 07fa354f36cb692bbf0b247b13763c095108ae76ff15ac8adbfee5135fdecf21: Status 404 returned error can't find the container with id 07fa354f36cb692bbf0b247b13763c095108ae76ff15ac8adbfee5135fdecf21 Jul 17 21:05:58.508179 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:58.508145 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7z4zp" event={"ID":"c55f0556-d46b-468c-922b-364681e608cc","Type":"ContainerStarted","Data":"07fa354f36cb692bbf0b247b13763c095108ae76ff15ac8adbfee5135fdecf21"} Jul 17 21:05:58.509484 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:58.509461 2580 generic.go:356] "Generic (PLEG): container finished" podID="62b9113d-1916-45a9-ae59-1b11ee2ced61" containerID="885486aa18a617c86347a04d0635ae71dd2bcd0cd5f0872af7260f6f5962b147" exitCode=0 Jul 17 21:05:58.509581 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:58.509501 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ndbdn" event={"ID":"62b9113d-1916-45a9-ae59-1b11ee2ced61","Type":"ContainerDied","Data":"885486aa18a617c86347a04d0635ae71dd2bcd0cd5f0872af7260f6f5962b147"} Jul 17 21:05:58.509758 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:58.509745 2580 scope.go:117] "RemoveContainer" containerID="885486aa18a617c86347a04d0635ae71dd2bcd0cd5f0872af7260f6f5962b147" Jul 17 21:05:59.516956 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:05:59.516921 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ndbdn" event={"ID":"62b9113d-1916-45a9-ae59-1b11ee2ced61","Type":"ContainerStarted","Data":"199fa018a6fe4f6834ff1122715221f1b0e8a6caac4eb75749968f2a94189d59"} Jul 17 21:06:00.522168 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:00.522139 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7z4zp" event={"ID":"c55f0556-d46b-468c-922b-364681e608cc","Type":"ContainerStarted","Data":"ff54c6afba2f0f036efcc10f07cfd2fadedfb3f27d3cb75b812297ece824ae06"} Jul 17 21:06:00.522485 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:00.522213 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7z4zp" event={"ID":"c55f0556-d46b-468c-922b-364681e608cc","Type":"ContainerStarted","Data":"1501052fe9b4354234b48c739a6b12c191333f4c0830293a071411b6eb85f52e"} Jul 17 21:06:00.543877 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:00.543836 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7z4zp" podStartSLOduration=130.501734835 podStartE2EDuration="2m12.543824907s" totalImagesPullingTime="2.042090072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:06:00.542768911 +0000 UTC m=+133.140451588" watchObservedRunningTime="2026-07-17 21:06:00.543824907 +0000 UTC m=+133.141507548" Jul 17 21:06:36.504673 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:36.504637 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 21:06:36.505165 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:36.504914 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerName="alertmanager" containerID="cri-o://8b1f0076f33ed3f6ddeb7a315db8f4c81da3da03bd0b685cd74b049ae8de2f76" gracePeriod=120 Jul 17 21:06:36.505165 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:36.504930 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerName="kube-rbac-proxy-metric" containerID="cri-o://8f3e75201934ab996d2b6109f9a0f513f25d9cd2a067c4278ba7e6d382eff50f" gracePeriod=120 Jul 17 21:06:36.505165 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:36.504976 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerName="prom-label-proxy" containerID="cri-o://284b1e3769d60b7ca0ea39db06f770df700b2a9eacd32654647a1a7c09161afd" gracePeriod=120 Jul 17 21:06:36.505165 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:36.504996 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerName="kube-rbac-proxy" containerID="cri-o://26f1c7565e6a826407812171827dca5eb8fad2836349ad80484975e0c9acb413" gracePeriod=120 Jul 17 21:06:36.505165 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:36.505012 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerName="config-reloader" containerID="cri-o://ba755a432866e46f0c00416952f28e8bf546616ea35dfdce20ad29e8ca0252da" gracePeriod=120 Jul 17 21:06:36.505165 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:36.504941 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerName="kube-rbac-proxy-web" containerID="cri-o://b8ac3a3393f48307222f3cb572f84cdadd5386fabb5121d5ed796f557154b55a" gracePeriod=120 Jul 17 21:06:36.656532 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:36.656505 2580 generic.go:356] "Generic (PLEG): container finished" podID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerID="284b1e3769d60b7ca0ea39db06f770df700b2a9eacd32654647a1a7c09161afd" exitCode=0 Jul 17 21:06:36.656532 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:36.656528 2580 generic.go:356] "Generic (PLEG): container finished" podID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerID="26f1c7565e6a826407812171827dca5eb8fad2836349ad80484975e0c9acb413" exitCode=0 Jul 17 21:06:36.656657 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:36.656538 2580 generic.go:356] "Generic (PLEG): container finished" podID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerID="ba755a432866e46f0c00416952f28e8bf546616ea35dfdce20ad29e8ca0252da" exitCode=0 Jul 17 21:06:36.656657 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:36.656546 2580 generic.go:356] "Generic (PLEG): container finished" podID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerID="8b1f0076f33ed3f6ddeb7a315db8f4c81da3da03bd0b685cd74b049ae8de2f76" exitCode=0 Jul 17 21:06:36.656657 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:36.656575 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4876b2d3-54ab-4c6f-b498-c0edd19768f2","Type":"ContainerDied","Data":"284b1e3769d60b7ca0ea39db06f770df700b2a9eacd32654647a1a7c09161afd"} Jul 17 21:06:36.656657 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:36.656637 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4876b2d3-54ab-4c6f-b498-c0edd19768f2","Type":"ContainerDied","Data":"26f1c7565e6a826407812171827dca5eb8fad2836349ad80484975e0c9acb413"} Jul 17 21:06:36.656773 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:36.656688 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4876b2d3-54ab-4c6f-b498-c0edd19768f2","Type":"ContainerDied","Data":"ba755a432866e46f0c00416952f28e8bf546616ea35dfdce20ad29e8ca0252da"} Jul 17 21:06:36.656773 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:36.656713 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4876b2d3-54ab-4c6f-b498-c0edd19768f2","Type":"ContainerDied","Data":"8b1f0076f33ed3f6ddeb7a315db8f4c81da3da03bd0b685cd74b049ae8de2f76"} Jul 17 21:06:37.664035 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.663999 2580 generic.go:356] "Generic (PLEG): container finished" podID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerID="8f3e75201934ab996d2b6109f9a0f513f25d9cd2a067c4278ba7e6d382eff50f" exitCode=0 Jul 17 21:06:37.664035 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.664035 2580 generic.go:356] "Generic (PLEG): container finished" podID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerID="b8ac3a3393f48307222f3cb572f84cdadd5386fabb5121d5ed796f557154b55a" exitCode=0 Jul 17 21:06:37.664389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.664060 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4876b2d3-54ab-4c6f-b498-c0edd19768f2","Type":"ContainerDied","Data":"8f3e75201934ab996d2b6109f9a0f513f25d9cd2a067c4278ba7e6d382eff50f"} Jul 17 21:06:37.664389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.664121 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4876b2d3-54ab-4c6f-b498-c0edd19768f2","Type":"ContainerDied","Data":"b8ac3a3393f48307222f3cb572f84cdadd5386fabb5121d5ed796f557154b55a"} Jul 17 21:06:37.740905 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.740878 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:37.814304 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.814281 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4876b2d3-54ab-4c6f-b498-c0edd19768f2-alertmanager-main-db\") pod \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " Jul 17 21:06:37.814435 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.814320 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-cluster-tls-config\") pod \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " Jul 17 21:06:37.814435 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.814347 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-secret-alertmanager-kube-rbac-proxy\") pod \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " Jul 17 21:06:37.814435 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.814400 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-secret-alertmanager-main-tls\") pod \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " Jul 17 21:06:37.814435 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.814427 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4876b2d3-54ab-4c6f-b498-c0edd19768f2-alertmanager-trusted-ca-bundle\") pod \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " Jul 17 21:06:37.814949 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.814452 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4876b2d3-54ab-4c6f-b498-c0edd19768f2-tls-assets\") pod \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " Jul 17 21:06:37.814949 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.814482 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4876b2d3-54ab-4c6f-b498-c0edd19768f2-config-out\") pod \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " Jul 17 21:06:37.814949 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.814514 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4876b2d3-54ab-4c6f-b498-c0edd19768f2-metrics-client-ca\") pod \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " Jul 17 21:06:37.814949 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.814561 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " Jul 17 21:06:37.814949 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.814601 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-secret-alertmanager-kube-rbac-proxy-web\") pod \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " Jul 17 21:06:37.814949 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.814625 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-config-volume\") pod \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " Jul 17 21:06:37.814949 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.814657 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-web-config\") pod \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " Jul 17 21:06:37.814949 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.814639 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4876b2d3-54ab-4c6f-b498-c0edd19768f2-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "4876b2d3-54ab-4c6f-b498-c0edd19768f2" (UID: "4876b2d3-54ab-4c6f-b498-c0edd19768f2"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:06:37.814949 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.814837 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4876b2d3-54ab-4c6f-b498-c0edd19768f2-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "4876b2d3-54ab-4c6f-b498-c0edd19768f2" (UID: "4876b2d3-54ab-4c6f-b498-c0edd19768f2"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:06:37.815499 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.814999 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4876b2d3-54ab-4c6f-b498-c0edd19768f2-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "4876b2d3-54ab-4c6f-b498-c0edd19768f2" (UID: "4876b2d3-54ab-4c6f-b498-c0edd19768f2"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:06:37.817916 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.817673 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "4876b2d3-54ab-4c6f-b498-c0edd19768f2" (UID: "4876b2d3-54ab-4c6f-b498-c0edd19768f2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:06:37.817916 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.817715 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-config-volume" (OuterVolumeSpecName: "config-volume") pod "4876b2d3-54ab-4c6f-b498-c0edd19768f2" (UID: "4876b2d3-54ab-4c6f-b498-c0edd19768f2"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:06:37.817916 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.817734 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "4876b2d3-54ab-4c6f-b498-c0edd19768f2" (UID: "4876b2d3-54ab-4c6f-b498-c0edd19768f2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:06:37.817916 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.817766 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2lp5\" (UniqueName: \"kubernetes.io/projected/4876b2d3-54ab-4c6f-b498-c0edd19768f2-kube-api-access-j2lp5\") pod \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\" (UID: \"4876b2d3-54ab-4c6f-b498-c0edd19768f2\") " Jul 17 21:06:37.818208 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.817931 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "4876b2d3-54ab-4c6f-b498-c0edd19768f2" (UID: "4876b2d3-54ab-4c6f-b498-c0edd19768f2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:06:37.818208 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.818052 2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4876b2d3-54ab-4c6f-b498-c0edd19768f2-alertmanager-main-db\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:06:37.818208 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.818070 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:06:37.818208 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.818085 2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4876b2d3-54ab-4c6f-b498-c0edd19768f2-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:06:37.818208 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.818099 2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4876b2d3-54ab-4c6f-b498-c0edd19768f2-metrics-client-ca\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:06:37.818208 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.818113 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:06:37.818208 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.818129 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:06:37.818208 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.818143 2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-config-volume\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:06:37.818208 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.818196 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "4876b2d3-54ab-4c6f-b498-c0edd19768f2" (UID: "4876b2d3-54ab-4c6f-b498-c0edd19768f2"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:06:37.818888 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.818854 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4876b2d3-54ab-4c6f-b498-c0edd19768f2-config-out" (OuterVolumeSpecName: "config-out") pod "4876b2d3-54ab-4c6f-b498-c0edd19768f2" (UID: "4876b2d3-54ab-4c6f-b498-c0edd19768f2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:06:37.820080 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.820054 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4876b2d3-54ab-4c6f-b498-c0edd19768f2-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4876b2d3-54ab-4c6f-b498-c0edd19768f2" (UID: "4876b2d3-54ab-4c6f-b498-c0edd19768f2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:06:37.820267 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.820243 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4876b2d3-54ab-4c6f-b498-c0edd19768f2-kube-api-access-j2lp5" (OuterVolumeSpecName: "kube-api-access-j2lp5") pod "4876b2d3-54ab-4c6f-b498-c0edd19768f2" (UID: "4876b2d3-54ab-4c6f-b498-c0edd19768f2"). InnerVolumeSpecName "kube-api-access-j2lp5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:06:37.822175 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.822043 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "4876b2d3-54ab-4c6f-b498-c0edd19768f2" (UID: "4876b2d3-54ab-4c6f-b498-c0edd19768f2"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:06:37.828491 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.828442 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-web-config" (OuterVolumeSpecName: "web-config") pod "4876b2d3-54ab-4c6f-b498-c0edd19768f2" (UID: "4876b2d3-54ab-4c6f-b498-c0edd19768f2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 21:06:37.918797 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.918771 2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-cluster-tls-config\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:06:37.918797 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.918797 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-secret-alertmanager-main-tls\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:06:37.918918 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.918810 2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4876b2d3-54ab-4c6f-b498-c0edd19768f2-tls-assets\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:06:37.918918 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.918821 2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4876b2d3-54ab-4c6f-b498-c0edd19768f2-config-out\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:06:37.918918 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.918832 2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4876b2d3-54ab-4c6f-b498-c0edd19768f2-web-config\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:06:37.918918 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:37.918843 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2lp5\" (UniqueName: \"kubernetes.io/projected/4876b2d3-54ab-4c6f-b498-c0edd19768f2-kube-api-access-j2lp5\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:06:38.670436 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.670398 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4876b2d3-54ab-4c6f-b498-c0edd19768f2","Type":"ContainerDied","Data":"a65c29e0545cdee07e8c6fd941ee0039a8b30bbb2c7990b3ecdf53931eaff526"} Jul 17 21:06:38.670789 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.670457 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.670789 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.670524 2580 scope.go:117] "RemoveContainer" containerID="284b1e3769d60b7ca0ea39db06f770df700b2a9eacd32654647a1a7c09161afd" Jul 17 21:06:38.678034 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.678014 2580 scope.go:117] "RemoveContainer" containerID="8f3e75201934ab996d2b6109f9a0f513f25d9cd2a067c4278ba7e6d382eff50f" Jul 17 21:06:38.684951 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.684932 2580 scope.go:117] "RemoveContainer" containerID="26f1c7565e6a826407812171827dca5eb8fad2836349ad80484975e0c9acb413" Jul 17 21:06:38.691198 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.691171 2580 scope.go:117] "RemoveContainer" containerID="b8ac3a3393f48307222f3cb572f84cdadd5386fabb5121d5ed796f557154b55a" Jul 17 21:06:38.695540 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.695519 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 21:06:38.698055 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.698039 2580 scope.go:117] "RemoveContainer" containerID="ba755a432866e46f0c00416952f28e8bf546616ea35dfdce20ad29e8ca0252da" Jul 17 21:06:38.704438 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.704421 2580 scope.go:117] "RemoveContainer" containerID="8b1f0076f33ed3f6ddeb7a315db8f4c81da3da03bd0b685cd74b049ae8de2f76" Jul 17 21:06:38.709815 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.709792 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 21:06:38.711742 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.711729 2580 scope.go:117] "RemoveContainer" containerID="404fe25a25434f572f28bbcc19aeb92fdad0c895f270d64c157f70fa489d28e8" Jul 17 21:06:38.745354 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.745330 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 21:06:38.745596 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.745584 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bba29410-5b7f-4187-8a11-91b4185cddbb" containerName="registry" Jul 17 21:06:38.745634 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.745598 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bba29410-5b7f-4187-8a11-91b4185cddbb" containerName="registry" Jul 17 21:06:38.745634 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.745606 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerName="config-reloader" Jul 17 21:06:38.745634 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.745611 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerName="config-reloader" Jul 17 21:06:38.745634 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.745618 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerName="kube-rbac-proxy-web" Jul 17 21:06:38.745634 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.745624 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerName="kube-rbac-proxy-web" Jul 17 21:06:38.745634 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.745631 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerName="kube-rbac-proxy" Jul 17 21:06:38.745808 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.745637 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerName="kube-rbac-proxy" Jul 17 21:06:38.745808 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.745645 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerName="init-config-reloader" Jul 17 21:06:38.745808 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.745650 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerName="init-config-reloader" Jul 17 21:06:38.745808 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.745658 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerName="alertmanager" Jul 17 21:06:38.745808 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.745662 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerName="alertmanager" Jul 17 21:06:38.745808 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.745670 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerName="kube-rbac-proxy-metric" Jul 17 21:06:38.745808 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.745675 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerName="kube-rbac-proxy-metric" Jul 17 21:06:38.745808 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.745688 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerName="prom-label-proxy" Jul 17 21:06:38.745808 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.745693 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerName="prom-label-proxy" Jul 17 21:06:38.745808 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.745757 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerName="alertmanager" Jul 17 21:06:38.745808 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.745766 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerName="config-reloader" Jul 17 21:06:38.745808 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.745772 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerName="kube-rbac-proxy-metric" Jul 17 21:06:38.745808 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.745777 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bba29410-5b7f-4187-8a11-91b4185cddbb" containerName="registry" Jul 17 21:06:38.745808 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.745782 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerName="prom-label-proxy" Jul 17 21:06:38.745808 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.745788 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerName="kube-rbac-proxy" Jul 17 21:06:38.745808 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.745793 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" containerName="kube-rbac-proxy-web" Jul 17 21:06:38.750336 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.750322 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.753576 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.753553 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 17 21:06:38.753868 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.753851 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 17 21:06:38.753912 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.753877 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 17 21:06:38.754325 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.754311 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 17 21:06:38.754368 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.754322 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 17 21:06:38.754607 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.754594 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 17 21:06:38.754682 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.754664 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 17 21:06:38.754727 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.754698 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 17 21:06:38.754937 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.754923 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9nx84\"" Jul 17 21:06:38.759430 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.759409 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 17 21:06:38.772770 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.772750 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 21:06:38.824029 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.824001 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07b44646-f5a4-40a4-a793-1d3775cdef0a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.824029 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.824033 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/07b44646-f5a4-40a4-a793-1d3775cdef0a-config-volume\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.824238 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.824051 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/07b44646-f5a4-40a4-a793-1d3775cdef0a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.824238 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.824069 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/07b44646-f5a4-40a4-a793-1d3775cdef0a-config-out\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.824238 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.824137 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b44646-f5a4-40a4-a793-1d3775cdef0a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.824238 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.824160 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/07b44646-f5a4-40a4-a793-1d3775cdef0a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.824238 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.824181 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07b44646-f5a4-40a4-a793-1d3775cdef0a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.824392 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.824244 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/07b44646-f5a4-40a4-a793-1d3775cdef0a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.824392 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.824269 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/07b44646-f5a4-40a4-a793-1d3775cdef0a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.824392 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.824283 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn2rt\" (UniqueName: \"kubernetes.io/projected/07b44646-f5a4-40a4-a793-1d3775cdef0a-kube-api-access-gn2rt\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.824392 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.824374 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07b44646-f5a4-40a4-a793-1d3775cdef0a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.824392 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.824389 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/07b44646-f5a4-40a4-a793-1d3775cdef0a-web-config\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.824535 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.824409 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/07b44646-f5a4-40a4-a793-1d3775cdef0a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.925303 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.925239 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07b44646-f5a4-40a4-a793-1d3775cdef0a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.925303 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.925264 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/07b44646-f5a4-40a4-a793-1d3775cdef0a-web-config\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.925303 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.925285 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/07b44646-f5a4-40a4-a793-1d3775cdef0a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.925510 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.925328 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07b44646-f5a4-40a4-a793-1d3775cdef0a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.925510 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.925351 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/07b44646-f5a4-40a4-a793-1d3775cdef0a-config-volume\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.925510 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.925368 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/07b44646-f5a4-40a4-a793-1d3775cdef0a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.925510 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.925387 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/07b44646-f5a4-40a4-a793-1d3775cdef0a-config-out\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.925510 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.925425 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b44646-f5a4-40a4-a793-1d3775cdef0a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.925510 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.925464 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/07b44646-f5a4-40a4-a793-1d3775cdef0a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.925510 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.925485 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07b44646-f5a4-40a4-a793-1d3775cdef0a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.925832 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.925530 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/07b44646-f5a4-40a4-a793-1d3775cdef0a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.925832 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.925561 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/07b44646-f5a4-40a4-a793-1d3775cdef0a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.925832 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.925582 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn2rt\" (UniqueName: \"kubernetes.io/projected/07b44646-f5a4-40a4-a793-1d3775cdef0a-kube-api-access-gn2rt\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.926985 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.926960 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07b44646-f5a4-40a4-a793-1d3775cdef0a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.928475 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.928450 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/07b44646-f5a4-40a4-a793-1d3775cdef0a-config-volume\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.928582 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.928520 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07b44646-f5a4-40a4-a793-1d3775cdef0a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.928582 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.928546 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/07b44646-f5a4-40a4-a793-1d3775cdef0a-config-out\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.928582 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.928546 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07b44646-f5a4-40a4-a793-1d3775cdef0a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.928748 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.928620 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/07b44646-f5a4-40a4-a793-1d3775cdef0a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.928748 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.928634 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/07b44646-f5a4-40a4-a793-1d3775cdef0a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.928852 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.928772 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/07b44646-f5a4-40a4-a793-1d3775cdef0a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.929017 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.928997 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07b44646-f5a4-40a4-a793-1d3775cdef0a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.929315 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.929292 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/07b44646-f5a4-40a4-a793-1d3775cdef0a-web-config\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.929909 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.929888 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/07b44646-f5a4-40a4-a793-1d3775cdef0a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.930524 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.930503 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/07b44646-f5a4-40a4-a793-1d3775cdef0a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:38.934829 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:38.934807 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn2rt\" (UniqueName: \"kubernetes.io/projected/07b44646-f5a4-40a4-a793-1d3775cdef0a-kube-api-access-gn2rt\") pod \"alertmanager-main-0\" (UID: \"07b44646-f5a4-40a4-a793-1d3775cdef0a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:39.059613 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:39.059586 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 21:06:39.199058 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:39.199033 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 21:06:39.200843 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:06:39.200815 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07b44646_f5a4_40a4_a793_1d3775cdef0a.slice/crio-4cb95616c75f6c2f41dd5eab9c3af370b3a12b85c8de961b146d0b7adb02b1a2 WatchSource:0}: Error finding container 4cb95616c75f6c2f41dd5eab9c3af370b3a12b85c8de961b146d0b7adb02b1a2: Status 404 returned error can't find the container with id 4cb95616c75f6c2f41dd5eab9c3af370b3a12b85c8de961b146d0b7adb02b1a2 Jul 17 21:06:39.676036 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:39.676002 2580 generic.go:356] "Generic (PLEG): container finished" podID="07b44646-f5a4-40a4-a793-1d3775cdef0a" containerID="6a508f96c803ddc218b91a8f192792f9c725207524a9b4616d3c975792c302b8" exitCode=0 Jul 17 21:06:39.676459 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:39.676083 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07b44646-f5a4-40a4-a793-1d3775cdef0a","Type":"ContainerDied","Data":"6a508f96c803ddc218b91a8f192792f9c725207524a9b4616d3c975792c302b8"} Jul 17 21:06:39.676459 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:39.676153 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07b44646-f5a4-40a4-a793-1d3775cdef0a","Type":"ContainerStarted","Data":"4cb95616c75f6c2f41dd5eab9c3af370b3a12b85c8de961b146d0b7adb02b1a2"} Jul 17 21:06:39.856950 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:39.856923 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4876b2d3-54ab-4c6f-b498-c0edd19768f2" path="/var/lib/kubelet/pods/4876b2d3-54ab-4c6f-b498-c0edd19768f2/volumes" Jul 17 21:06:40.684060 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:40.684027 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07b44646-f5a4-40a4-a793-1d3775cdef0a","Type":"ContainerStarted","Data":"6b5f48cd186a52ca5f7907462bf450076f5761cf4268d6ac00a0b630d29601f3"} Jul 17 21:06:40.684487 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:40.684136 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07b44646-f5a4-40a4-a793-1d3775cdef0a","Type":"ContainerStarted","Data":"665693427ff39c3815581da8ec1d008d6aed5d02b85ebadd99730642f8cfcda1"} Jul 17 21:06:40.684487 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:40.684205 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07b44646-f5a4-40a4-a793-1d3775cdef0a","Type":"ContainerStarted","Data":"943db81bdb20703042b896836846503a5510935ffc8312b482f1c491c7f2a6e5"} Jul 17 21:06:40.684487 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:40.684248 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07b44646-f5a4-40a4-a793-1d3775cdef0a","Type":"ContainerStarted","Data":"aa8a2d774b212aa145ae6610c2b523fc7ec9930d0f59ae2deed819b50b91be9b"} Jul 17 21:06:40.684487 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:40.684290 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07b44646-f5a4-40a4-a793-1d3775cdef0a","Type":"ContainerStarted","Data":"c2bee0e3a2f7d61aab8dcc4ee6fac91e2834cb384843141ed6a7742def3550ca"} Jul 17 21:06:40.684487 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:40.684328 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"07b44646-f5a4-40a4-a793-1d3775cdef0a","Type":"ContainerStarted","Data":"47b3f71b0c891ffc700e45038b65011d67c005672651d7fba3ebd714786760ed"} Jul 17 21:06:40.713412 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:06:40.713366 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.693712232 podStartE2EDuration="2.713351077s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.638845ms" isStatefulPod=false podCreationTimestamp="2026-07-17 21:06:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:06:40.7110145 +0000 UTC m=+173.308697143" watchObservedRunningTime="2026-07-17 21:06:40.713351077 +0000 UTC m=+173.311033719" Jul 17 21:07:15.999177 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:15.999142 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd"] Jul 17 21:07:16.002478 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:16.002461 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd" Jul 17 21:07:16.004975 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:16.004953 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 17 21:07:16.005094 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:16.004974 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r7mvp\"" Jul 17 21:07:16.005817 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:16.005801 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 17 21:07:16.013396 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:16.013375 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd"] Jul 17 21:07:16.086105 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:16.086080 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f9a4971-6228-4223-a4b0-219859419bb3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd\" (UID: \"3f9a4971-6228-4223-a4b0-219859419bb3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd" Jul 17 21:07:16.086231 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:16.086130 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f9a4971-6228-4223-a4b0-219859419bb3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd\" (UID: \"3f9a4971-6228-4223-a4b0-219859419bb3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd" Jul 17 21:07:16.086231 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:16.086155 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9hdl\" (UniqueName: \"kubernetes.io/projected/3f9a4971-6228-4223-a4b0-219859419bb3-kube-api-access-x9hdl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd\" (UID: \"3f9a4971-6228-4223-a4b0-219859419bb3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd" Jul 17 21:07:16.187016 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:16.186996 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f9a4971-6228-4223-a4b0-219859419bb3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd\" (UID: \"3f9a4971-6228-4223-a4b0-219859419bb3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd" Jul 17 21:07:16.187102 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:16.187026 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9hdl\" (UniqueName: \"kubernetes.io/projected/3f9a4971-6228-4223-a4b0-219859419bb3-kube-api-access-x9hdl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd\" (UID: \"3f9a4971-6228-4223-a4b0-219859419bb3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd" Jul 17 21:07:16.187102 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:16.187059 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f9a4971-6228-4223-a4b0-219859419bb3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd\" (UID: \"3f9a4971-6228-4223-a4b0-219859419bb3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd" Jul 17 21:07:16.187349 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:16.187334 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f9a4971-6228-4223-a4b0-219859419bb3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd\" (UID: \"3f9a4971-6228-4223-a4b0-219859419bb3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd" Jul 17 21:07:16.187387 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:16.187363 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f9a4971-6228-4223-a4b0-219859419bb3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd\" (UID: \"3f9a4971-6228-4223-a4b0-219859419bb3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd" Jul 17 21:07:16.198478 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:16.198453 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9hdl\" (UniqueName: \"kubernetes.io/projected/3f9a4971-6228-4223-a4b0-219859419bb3-kube-api-access-x9hdl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd\" (UID: \"3f9a4971-6228-4223-a4b0-219859419bb3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd" Jul 17 21:07:16.311892 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:16.311872 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd" Jul 17 21:07:16.436423 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:16.436307 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd"] Jul 17 21:07:16.438977 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:07:16.438950 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f9a4971_6228_4223_a4b0_219859419bb3.slice/crio-a69bd5907705589eff1e7d7cae7295a418b873dd996d2f58cb89d04f67cb4aee WatchSource:0}: Error finding container a69bd5907705589eff1e7d7cae7295a418b873dd996d2f58cb89d04f67cb4aee: Status 404 returned error can't find the container with id a69bd5907705589eff1e7d7cae7295a418b873dd996d2f58cb89d04f67cb4aee Jul 17 21:07:16.823606 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:16.823570 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd" event={"ID":"3f9a4971-6228-4223-a4b0-219859419bb3","Type":"ContainerStarted","Data":"a69bd5907705589eff1e7d7cae7295a418b873dd996d2f58cb89d04f67cb4aee"} Jul 17 21:07:23.855338 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:23.855301 2580 generic.go:356] "Generic (PLEG): container finished" podID="3f9a4971-6228-4223-a4b0-219859419bb3" containerID="8ce3aa7448c9295bcf851b7f3ca54bdc8cf7f6ae2cbf03acb2129e0ed6e04571" exitCode=0 Jul 17 21:07:23.856320 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:23.856289 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd" event={"ID":"3f9a4971-6228-4223-a4b0-219859419bb3","Type":"ContainerDied","Data":"8ce3aa7448c9295bcf851b7f3ca54bdc8cf7f6ae2cbf03acb2129e0ed6e04571"} Jul 17 21:07:25.865030 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:25.865003 2580 generic.go:356] "Generic (PLEG): container finished" podID="3f9a4971-6228-4223-a4b0-219859419bb3" containerID="d4d078bbdf9422be6515ab1cd56ef9f570ad466e7758691e93dee4b8d74806a4" exitCode=0 Jul 17 21:07:25.865330 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:25.865072 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd" event={"ID":"3f9a4971-6228-4223-a4b0-219859419bb3","Type":"ContainerDied","Data":"d4d078bbdf9422be6515ab1cd56ef9f570ad466e7758691e93dee4b8d74806a4"} Jul 17 21:07:32.896684 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:32.896651 2580 generic.go:356] "Generic (PLEG): container finished" podID="3f9a4971-6228-4223-a4b0-219859419bb3" containerID="4954b40411ef41a1bfecaef60ecf43369fd5c9c35bd0e8175a097f4ded9c0006" exitCode=0 Jul 17 21:07:32.897098 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:32.896737 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd" event={"ID":"3f9a4971-6228-4223-a4b0-219859419bb3","Type":"ContainerDied","Data":"4954b40411ef41a1bfecaef60ecf43369fd5c9c35bd0e8175a097f4ded9c0006"} Jul 17 21:07:34.022724 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:34.022699 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd" Jul 17 21:07:34.132368 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:34.132340 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f9a4971-6228-4223-a4b0-219859419bb3-bundle\") pod \"3f9a4971-6228-4223-a4b0-219859419bb3\" (UID: \"3f9a4971-6228-4223-a4b0-219859419bb3\") " Jul 17 21:07:34.132478 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:34.132373 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9hdl\" (UniqueName: \"kubernetes.io/projected/3f9a4971-6228-4223-a4b0-219859419bb3-kube-api-access-x9hdl\") pod \"3f9a4971-6228-4223-a4b0-219859419bb3\" (UID: \"3f9a4971-6228-4223-a4b0-219859419bb3\") " Jul 17 21:07:34.132478 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:34.132425 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f9a4971-6228-4223-a4b0-219859419bb3-util\") pod \"3f9a4971-6228-4223-a4b0-219859419bb3\" (UID: \"3f9a4971-6228-4223-a4b0-219859419bb3\") " Jul 17 21:07:34.132974 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:34.132949 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f9a4971-6228-4223-a4b0-219859419bb3-bundle" (OuterVolumeSpecName: "bundle") pod "3f9a4971-6228-4223-a4b0-219859419bb3" (UID: "3f9a4971-6228-4223-a4b0-219859419bb3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:07:34.134673 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:34.134650 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f9a4971-6228-4223-a4b0-219859419bb3-kube-api-access-x9hdl" (OuterVolumeSpecName: "kube-api-access-x9hdl") pod "3f9a4971-6228-4223-a4b0-219859419bb3" (UID: "3f9a4971-6228-4223-a4b0-219859419bb3"). InnerVolumeSpecName "kube-api-access-x9hdl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:07:34.138214 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:34.138175 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f9a4971-6228-4223-a4b0-219859419bb3-util" (OuterVolumeSpecName: "util") pod "3f9a4971-6228-4223-a4b0-219859419bb3" (UID: "3f9a4971-6228-4223-a4b0-219859419bb3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:07:34.233465 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:34.233408 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f9a4971-6228-4223-a4b0-219859419bb3-util\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:07:34.233465 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:34.233438 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f9a4971-6228-4223-a4b0-219859419bb3-bundle\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:07:34.233465 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:34.233447 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9hdl\" (UniqueName: \"kubernetes.io/projected/3f9a4971-6228-4223-a4b0-219859419bb3-kube-api-access-x9hdl\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:07:34.906659 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:34.906633 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd" Jul 17 21:07:34.906770 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:34.906633 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6fd" event={"ID":"3f9a4971-6228-4223-a4b0-219859419bb3","Type":"ContainerDied","Data":"a69bd5907705589eff1e7d7cae7295a418b873dd996d2f58cb89d04f67cb4aee"} Jul 17 21:07:34.906770 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:34.906760 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a69bd5907705589eff1e7d7cae7295a418b873dd996d2f58cb89d04f67cb4aee" Jul 17 21:07:39.019866 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:39.019831 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q2l8m"] Jul 17 21:07:39.020261 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:39.020172 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f9a4971-6228-4223-a4b0-219859419bb3" containerName="extract" Jul 17 21:07:39.020261 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:39.020198 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f9a4971-6228-4223-a4b0-219859419bb3" containerName="extract" Jul 17 21:07:39.020261 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:39.020219 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f9a4971-6228-4223-a4b0-219859419bb3" containerName="pull" Jul 17 21:07:39.020261 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:39.020226 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f9a4971-6228-4223-a4b0-219859419bb3" containerName="pull" Jul 17 21:07:39.020261 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:39.020233 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f9a4971-6228-4223-a4b0-219859419bb3" containerName="util" Jul 17 21:07:39.020261 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:39.020238 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f9a4971-6228-4223-a4b0-219859419bb3" containerName="util" Jul 17 21:07:39.020485 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:39.020290 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f9a4971-6228-4223-a4b0-219859419bb3" containerName="extract" Jul 17 21:07:39.023467 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:39.023450 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q2l8m" Jul 17 21:07:39.026180 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:39.026144 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 17 21:07:39.026379 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:39.026358 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-6cxvm\"" Jul 17 21:07:39.026443 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:39.026398 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 17 21:07:39.039622 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:39.039597 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q2l8m"] Jul 17 21:07:39.067078 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:39.067058 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d428a6d3-9f26-495e-a249-f90d3a14a769-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-q2l8m\" (UID: \"d428a6d3-9f26-495e-a249-f90d3a14a769\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q2l8m" Jul 17 21:07:39.067172 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:39.067100 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnvxm\" (UniqueName: \"kubernetes.io/projected/d428a6d3-9f26-495e-a249-f90d3a14a769-kube-api-access-xnvxm\") pod \"cert-manager-operator-controller-manager-55c444bf86-q2l8m\" (UID: \"d428a6d3-9f26-495e-a249-f90d3a14a769\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q2l8m" Jul 17 21:07:39.167682 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:39.167659 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnvxm\" (UniqueName: \"kubernetes.io/projected/d428a6d3-9f26-495e-a249-f90d3a14a769-kube-api-access-xnvxm\") pod \"cert-manager-operator-controller-manager-55c444bf86-q2l8m\" (UID: \"d428a6d3-9f26-495e-a249-f90d3a14a769\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q2l8m" Jul 17 21:07:39.167762 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:39.167729 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d428a6d3-9f26-495e-a249-f90d3a14a769-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-q2l8m\" (UID: \"d428a6d3-9f26-495e-a249-f90d3a14a769\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q2l8m" Jul 17 21:07:39.168102 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:39.168086 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d428a6d3-9f26-495e-a249-f90d3a14a769-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-q2l8m\" (UID: \"d428a6d3-9f26-495e-a249-f90d3a14a769\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q2l8m" Jul 17 21:07:39.188120 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:39.188100 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnvxm\" (UniqueName: \"kubernetes.io/projected/d428a6d3-9f26-495e-a249-f90d3a14a769-kube-api-access-xnvxm\") pod \"cert-manager-operator-controller-manager-55c444bf86-q2l8m\" (UID: \"d428a6d3-9f26-495e-a249-f90d3a14a769\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q2l8m" Jul 17 21:07:39.331973 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:39.331952 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q2l8m" Jul 17 21:07:39.462204 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:39.462153 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q2l8m"] Jul 17 21:07:39.465920 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:07:39.465892 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd428a6d3_9f26_495e_a249_f90d3a14a769.slice/crio-47f3152fd080d2ed3f84b5e70ee1313af625528101b00c161418815e2fc81ef5 WatchSource:0}: Error finding container 47f3152fd080d2ed3f84b5e70ee1313af625528101b00c161418815e2fc81ef5: Status 404 returned error can't find the container with id 47f3152fd080d2ed3f84b5e70ee1313af625528101b00c161418815e2fc81ef5 Jul 17 21:07:39.927001 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:39.926962 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q2l8m" event={"ID":"d428a6d3-9f26-495e-a249-f90d3a14a769","Type":"ContainerStarted","Data":"47f3152fd080d2ed3f84b5e70ee1313af625528101b00c161418815e2fc81ef5"} Jul 17 21:07:41.940161 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:41.940116 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q2l8m" event={"ID":"d428a6d3-9f26-495e-a249-f90d3a14a769","Type":"ContainerStarted","Data":"0a102f0e41044b4243d5c53187120c3f0c20202f5477c7aae71a456a7e9161a8"} Jul 17 21:07:41.964396 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:41.964346 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-q2l8m" podStartSLOduration=2.420453784 podStartE2EDuration="3.964331344s" totalImagesPullingTime="1.54387756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:07:41.962132226 +0000 UTC m=+234.559814886" watchObservedRunningTime="2026-07-17 21:07:41.964331344 +0000 UTC m=+234.562013985" Jul 17 21:07:42.802795 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:42.802762 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb"] Jul 17 21:07:42.806174 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:42.806155 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb" Jul 17 21:07:42.809763 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:42.809735 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r7mvp\"" Jul 17 21:07:42.809874 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:42.809737 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 17 21:07:42.809874 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:42.809786 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 17 21:07:42.817153 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:42.817132 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb"] Jul 17 21:07:42.898326 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:42.898296 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a38de886-052f-4914-af8f-e2285ea947a1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb\" (UID: \"a38de886-052f-4914-af8f-e2285ea947a1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb" Jul 17 21:07:42.898440 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:42.898357 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a38de886-052f-4914-af8f-e2285ea947a1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb\" (UID: \"a38de886-052f-4914-af8f-e2285ea947a1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb" Jul 17 21:07:42.898440 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:42.898375 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2kpj\" (UniqueName: \"kubernetes.io/projected/a38de886-052f-4914-af8f-e2285ea947a1-kube-api-access-p2kpj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb\" (UID: \"a38de886-052f-4914-af8f-e2285ea947a1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb" Jul 17 21:07:42.999230 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:42.999201 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a38de886-052f-4914-af8f-e2285ea947a1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb\" (UID: \"a38de886-052f-4914-af8f-e2285ea947a1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb" Jul 17 21:07:42.999626 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:42.999332 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2kpj\" (UniqueName: \"kubernetes.io/projected/a38de886-052f-4914-af8f-e2285ea947a1-kube-api-access-p2kpj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb\" (UID: \"a38de886-052f-4914-af8f-e2285ea947a1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb" Jul 17 21:07:42.999626 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:42.999405 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a38de886-052f-4914-af8f-e2285ea947a1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb\" (UID: \"a38de886-052f-4914-af8f-e2285ea947a1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb" Jul 17 21:07:42.999626 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:42.999553 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a38de886-052f-4914-af8f-e2285ea947a1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb\" (UID: \"a38de886-052f-4914-af8f-e2285ea947a1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb" Jul 17 21:07:42.999789 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:42.999736 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a38de886-052f-4914-af8f-e2285ea947a1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb\" (UID: \"a38de886-052f-4914-af8f-e2285ea947a1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb" Jul 17 21:07:43.009241 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:43.009221 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2kpj\" (UniqueName: \"kubernetes.io/projected/a38de886-052f-4914-af8f-e2285ea947a1-kube-api-access-p2kpj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb\" (UID: \"a38de886-052f-4914-af8f-e2285ea947a1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb" Jul 17 21:07:43.110647 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:43.110587 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-j6w6t"] Jul 17 21:07:43.113780 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:43.113765 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-j6w6t" Jul 17 21:07:43.115833 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:43.115809 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb" Jul 17 21:07:43.116302 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:43.116285 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 17 21:07:43.116620 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:43.116605 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-jrrhs\"" Jul 17 21:07:43.116716 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:43.116642 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 17 21:07:43.125335 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:43.125314 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-j6w6t"] Jul 17 21:07:43.201928 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:43.201894 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm5fr\" (UniqueName: \"kubernetes.io/projected/3e020763-34a5-42e6-ad61-7193ef0b7e2b-kube-api-access-gm5fr\") pod \"cert-manager-webhook-6486ffd997-j6w6t\" (UID: \"3e020763-34a5-42e6-ad61-7193ef0b7e2b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j6w6t" Jul 17 21:07:43.202049 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:43.202001 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e020763-34a5-42e6-ad61-7193ef0b7e2b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-j6w6t\" (UID: \"3e020763-34a5-42e6-ad61-7193ef0b7e2b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j6w6t" Jul 17 21:07:43.240867 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:43.240842 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb"] Jul 17 21:07:43.243319 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:07:43.243282 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda38de886_052f_4914_af8f_e2285ea947a1.slice/crio-01267608947ffa6dcb6c8e08da2b6462c7e580e36d8354e2ed27992c9063d710 WatchSource:0}: Error finding container 01267608947ffa6dcb6c8e08da2b6462c7e580e36d8354e2ed27992c9063d710: Status 404 returned error can't find the container with id 01267608947ffa6dcb6c8e08da2b6462c7e580e36d8354e2ed27992c9063d710 Jul 17 21:07:43.302377 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:43.302355 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm5fr\" (UniqueName: \"kubernetes.io/projected/3e020763-34a5-42e6-ad61-7193ef0b7e2b-kube-api-access-gm5fr\") pod \"cert-manager-webhook-6486ffd997-j6w6t\" (UID: \"3e020763-34a5-42e6-ad61-7193ef0b7e2b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j6w6t" Jul 17 21:07:43.302457 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:43.302442 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e020763-34a5-42e6-ad61-7193ef0b7e2b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-j6w6t\" (UID: \"3e020763-34a5-42e6-ad61-7193ef0b7e2b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j6w6t" Jul 17 21:07:43.313772 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:43.313744 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm5fr\" (UniqueName: \"kubernetes.io/projected/3e020763-34a5-42e6-ad61-7193ef0b7e2b-kube-api-access-gm5fr\") pod \"cert-manager-webhook-6486ffd997-j6w6t\" (UID: \"3e020763-34a5-42e6-ad61-7193ef0b7e2b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j6w6t" Jul 17 21:07:43.313856 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:43.313846 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e020763-34a5-42e6-ad61-7193ef0b7e2b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-j6w6t\" (UID: \"3e020763-34a5-42e6-ad61-7193ef0b7e2b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j6w6t" Jul 17 21:07:43.423291 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:43.423231 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-j6w6t" Jul 17 21:07:43.546339 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:43.546314 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-j6w6t"] Jul 17 21:07:43.548484 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:07:43.548461 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e020763_34a5_42e6_ad61_7193ef0b7e2b.slice/crio-5bcaa934280a5cfda535d667bb640a16eb3041804e74e4d6cc5c8ff549d414c4 WatchSource:0}: Error finding container 5bcaa934280a5cfda535d667bb640a16eb3041804e74e4d6cc5c8ff549d414c4: Status 404 returned error can't find the container with id 5bcaa934280a5cfda535d667bb640a16eb3041804e74e4d6cc5c8ff549d414c4 Jul 17 21:07:43.949554 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:43.949524 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-j6w6t" event={"ID":"3e020763-34a5-42e6-ad61-7193ef0b7e2b","Type":"ContainerStarted","Data":"5bcaa934280a5cfda535d667bb640a16eb3041804e74e4d6cc5c8ff549d414c4"} Jul 17 21:07:43.950821 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:43.950798 2580 generic.go:356] "Generic (PLEG): container finished" podID="a38de886-052f-4914-af8f-e2285ea947a1" containerID="3f8a47a292e2e8b27998cd5be1e3e54e5d9a8d9b8cfdc679983037eca87b4ec9" exitCode=0 Jul 17 21:07:43.950912 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:43.950883 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb" event={"ID":"a38de886-052f-4914-af8f-e2285ea947a1","Type":"ContainerDied","Data":"3f8a47a292e2e8b27998cd5be1e3e54e5d9a8d9b8cfdc679983037eca87b4ec9"} Jul 17 21:07:43.950968 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:43.950931 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb" event={"ID":"a38de886-052f-4914-af8f-e2285ea947a1","Type":"ContainerStarted","Data":"01267608947ffa6dcb6c8e08da2b6462c7e580e36d8354e2ed27992c9063d710"} Jul 17 21:07:46.968159 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:46.968127 2580 generic.go:356] "Generic (PLEG): container finished" podID="a38de886-052f-4914-af8f-e2285ea947a1" containerID="7995c16d4878e66342e56a4ad816032fbb1a5b0ade1a23dae0e269b3578b351e" exitCode=0 Jul 17 21:07:46.968597 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:46.968219 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb" event={"ID":"a38de886-052f-4914-af8f-e2285ea947a1","Type":"ContainerDied","Data":"7995c16d4878e66342e56a4ad816032fbb1a5b0ade1a23dae0e269b3578b351e"} Jul 17 21:07:47.976090 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:47.976049 2580 generic.go:356] "Generic (PLEG): container finished" podID="a38de886-052f-4914-af8f-e2285ea947a1" containerID="eb9690fb96b03c781b0548e3f4595c2581942ce9b005832db99f89196b6f85f7" exitCode=0 Jul 17 21:07:47.976518 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:47.976133 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb" event={"ID":"a38de886-052f-4914-af8f-e2285ea947a1","Type":"ContainerDied","Data":"eb9690fb96b03c781b0548e3f4595c2581942ce9b005832db99f89196b6f85f7"} Jul 17 21:07:48.981900 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:48.981819 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-j6w6t" event={"ID":"3e020763-34a5-42e6-ad61-7193ef0b7e2b","Type":"ContainerStarted","Data":"6effc60b2e047cb11f1a45dcb0422391c21144428efdd818608afcd7ab8e0a98"} Jul 17 21:07:48.981900 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:48.981895 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-j6w6t" Jul 17 21:07:49.000469 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:49.000420 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-j6w6t" podStartSLOduration=0.971391038 podStartE2EDuration="6.000404638s" totalImagesPullingTime="5.0290136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:07:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:07:48.999089686 +0000 UTC m=+241.596772328" watchObservedRunningTime="2026-07-17 21:07:49.000404638 +0000 UTC m=+241.598087279" Jul 17 21:07:49.103744 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:49.103720 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb" Jul 17 21:07:49.251338 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:49.251278 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a38de886-052f-4914-af8f-e2285ea947a1-bundle\") pod \"a38de886-052f-4914-af8f-e2285ea947a1\" (UID: \"a38de886-052f-4914-af8f-e2285ea947a1\") " Jul 17 21:07:49.251338 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:49.251311 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a38de886-052f-4914-af8f-e2285ea947a1-util\") pod \"a38de886-052f-4914-af8f-e2285ea947a1\" (UID: \"a38de886-052f-4914-af8f-e2285ea947a1\") " Jul 17 21:07:49.251483 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:49.251356 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2kpj\" (UniqueName: \"kubernetes.io/projected/a38de886-052f-4914-af8f-e2285ea947a1-kube-api-access-p2kpj\") pod \"a38de886-052f-4914-af8f-e2285ea947a1\" (UID: \"a38de886-052f-4914-af8f-e2285ea947a1\") " Jul 17 21:07:49.251717 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:49.251693 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a38de886-052f-4914-af8f-e2285ea947a1-bundle" (OuterVolumeSpecName: "bundle") pod "a38de886-052f-4914-af8f-e2285ea947a1" (UID: "a38de886-052f-4914-af8f-e2285ea947a1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:07:49.253333 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:49.253307 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a38de886-052f-4914-af8f-e2285ea947a1-kube-api-access-p2kpj" (OuterVolumeSpecName: "kube-api-access-p2kpj") pod "a38de886-052f-4914-af8f-e2285ea947a1" (UID: "a38de886-052f-4914-af8f-e2285ea947a1"). InnerVolumeSpecName "kube-api-access-p2kpj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:07:49.255499 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:49.255477 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a38de886-052f-4914-af8f-e2285ea947a1-util" (OuterVolumeSpecName: "util") pod "a38de886-052f-4914-af8f-e2285ea947a1" (UID: "a38de886-052f-4914-af8f-e2285ea947a1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:07:49.352269 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:49.352250 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2kpj\" (UniqueName: \"kubernetes.io/projected/a38de886-052f-4914-af8f-e2285ea947a1-kube-api-access-p2kpj\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:07:49.352338 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:49.352272 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a38de886-052f-4914-af8f-e2285ea947a1-bundle\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:07:49.352338 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:49.352287 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a38de886-052f-4914-af8f-e2285ea947a1-util\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:07:49.987628 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:49.987603 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb" Jul 17 21:07:49.988060 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:49.987631 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frpzpb" event={"ID":"a38de886-052f-4914-af8f-e2285ea947a1","Type":"ContainerDied","Data":"01267608947ffa6dcb6c8e08da2b6462c7e580e36d8354e2ed27992c9063d710"} Jul 17 21:07:49.988060 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:49.987676 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="01267608947ffa6dcb6c8e08da2b6462c7e580e36d8354e2ed27992c9063d710" Jul 17 21:07:54.990506 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:07:54.990475 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-j6w6t" Jul 17 21:08:02.339405 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:02.339354 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm"] Jul 17 21:08:02.339768 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:02.339668 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a38de886-052f-4914-af8f-e2285ea947a1" containerName="util" Jul 17 21:08:02.339768 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:02.339679 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a38de886-052f-4914-af8f-e2285ea947a1" containerName="util" Jul 17 21:08:02.339768 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:02.339697 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a38de886-052f-4914-af8f-e2285ea947a1" containerName="pull" Jul 17 21:08:02.339768 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:02.339703 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a38de886-052f-4914-af8f-e2285ea947a1" containerName="pull" Jul 17 21:08:02.339768 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:02.339714 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a38de886-052f-4914-af8f-e2285ea947a1" containerName="extract" Jul 17 21:08:02.339768 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:02.339720 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a38de886-052f-4914-af8f-e2285ea947a1" containerName="extract" Jul 17 21:08:02.339768 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:02.339765 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a38de886-052f-4914-af8f-e2285ea947a1" containerName="extract" Jul 17 21:08:02.379599 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:02.379571 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm"] Jul 17 21:08:02.379754 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:02.379674 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm" Jul 17 21:08:02.382286 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:02.382265 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 17 21:08:02.382421 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:02.382298 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 17 21:08:02.383429 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:02.383408 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r7mvp\"" Jul 17 21:08:02.555336 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:02.555302 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d89019f-29d3-4898-93a1-a70eca2719e7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm\" (UID: \"1d89019f-29d3-4898-93a1-a70eca2719e7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm" Jul 17 21:08:02.555498 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:02.555355 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d89019f-29d3-4898-93a1-a70eca2719e7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm\" (UID: \"1d89019f-29d3-4898-93a1-a70eca2719e7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm" Jul 17 21:08:02.555498 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:02.555431 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74b5w\" (UniqueName: \"kubernetes.io/projected/1d89019f-29d3-4898-93a1-a70eca2719e7-kube-api-access-74b5w\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm\" (UID: \"1d89019f-29d3-4898-93a1-a70eca2719e7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm" Jul 17 21:08:02.656414 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:02.656333 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d89019f-29d3-4898-93a1-a70eca2719e7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm\" (UID: \"1d89019f-29d3-4898-93a1-a70eca2719e7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm" Jul 17 21:08:02.656414 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:02.656400 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74b5w\" (UniqueName: \"kubernetes.io/projected/1d89019f-29d3-4898-93a1-a70eca2719e7-kube-api-access-74b5w\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm\" (UID: \"1d89019f-29d3-4898-93a1-a70eca2719e7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm" Jul 17 21:08:02.656635 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:02.656457 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d89019f-29d3-4898-93a1-a70eca2719e7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm\" (UID: \"1d89019f-29d3-4898-93a1-a70eca2719e7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm" Jul 17 21:08:02.656711 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:02.656690 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d89019f-29d3-4898-93a1-a70eca2719e7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm\" (UID: \"1d89019f-29d3-4898-93a1-a70eca2719e7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm" Jul 17 21:08:02.656848 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:02.656827 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d89019f-29d3-4898-93a1-a70eca2719e7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm\" (UID: \"1d89019f-29d3-4898-93a1-a70eca2719e7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm" Jul 17 21:08:02.666333 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:02.666307 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74b5w\" (UniqueName: \"kubernetes.io/projected/1d89019f-29d3-4898-93a1-a70eca2719e7-kube-api-access-74b5w\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm\" (UID: \"1d89019f-29d3-4898-93a1-a70eca2719e7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm" Jul 17 21:08:02.688037 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:02.688016 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm" Jul 17 21:08:02.832483 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:02.832454 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm"] Jul 17 21:08:02.834363 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:08:02.834335 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d89019f_29d3_4898_93a1_a70eca2719e7.slice/crio-09ccfef3a8cbdf35d6f871c52e11bedb8f34107081a527f70080086f1b19d7b1 WatchSource:0}: Error finding container 09ccfef3a8cbdf35d6f871c52e11bedb8f34107081a527f70080086f1b19d7b1: Status 404 returned error can't find the container with id 09ccfef3a8cbdf35d6f871c52e11bedb8f34107081a527f70080086f1b19d7b1 Jul 17 21:08:03.043602 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:03.043578 2580 generic.go:356] "Generic (PLEG): container finished" podID="1d89019f-29d3-4898-93a1-a70eca2719e7" containerID="f410aefa4bc8bfca57c8cb10457d91c268f901356e344df3e5d6e11544a7140f" exitCode=0 Jul 17 21:08:03.043728 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:03.043664 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm" event={"ID":"1d89019f-29d3-4898-93a1-a70eca2719e7","Type":"ContainerDied","Data":"f410aefa4bc8bfca57c8cb10457d91c268f901356e344df3e5d6e11544a7140f"} Jul 17 21:08:03.043728 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:03.043714 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm" event={"ID":"1d89019f-29d3-4898-93a1-a70eca2719e7","Type":"ContainerStarted","Data":"09ccfef3a8cbdf35d6f871c52e11bedb8f34107081a527f70080086f1b19d7b1"} Jul 17 21:08:05.054146 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:05.054075 2580 generic.go:356] "Generic (PLEG): container finished" podID="1d89019f-29d3-4898-93a1-a70eca2719e7" containerID="3700b1a08d416991c7c5edc41d2d1642d14a945ee5bf9d51dc7af56edafe731a" exitCode=0 Jul 17 21:08:05.054493 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:05.054144 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm" event={"ID":"1d89019f-29d3-4898-93a1-a70eca2719e7","Type":"ContainerDied","Data":"3700b1a08d416991c7c5edc41d2d1642d14a945ee5bf9d51dc7af56edafe731a"} Jul 17 21:08:06.060751 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:06.060719 2580 generic.go:356] "Generic (PLEG): container finished" podID="1d89019f-29d3-4898-93a1-a70eca2719e7" containerID="3a3ce61befff5e91e098530930a65fc584f105f40b03fbfb9ddb299fb3ecda19" exitCode=0 Jul 17 21:08:06.061111 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:06.060762 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm" event={"ID":"1d89019f-29d3-4898-93a1-a70eca2719e7","Type":"ContainerDied","Data":"3a3ce61befff5e91e098530930a65fc584f105f40b03fbfb9ddb299fb3ecda19"} Jul 17 21:08:07.185427 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:07.185399 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm" Jul 17 21:08:07.293807 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:07.293780 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d89019f-29d3-4898-93a1-a70eca2719e7-util\") pod \"1d89019f-29d3-4898-93a1-a70eca2719e7\" (UID: \"1d89019f-29d3-4898-93a1-a70eca2719e7\") " Jul 17 21:08:07.293923 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:07.293864 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74b5w\" (UniqueName: \"kubernetes.io/projected/1d89019f-29d3-4898-93a1-a70eca2719e7-kube-api-access-74b5w\") pod \"1d89019f-29d3-4898-93a1-a70eca2719e7\" (UID: \"1d89019f-29d3-4898-93a1-a70eca2719e7\") " Jul 17 21:08:07.293923 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:07.293894 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d89019f-29d3-4898-93a1-a70eca2719e7-bundle\") pod \"1d89019f-29d3-4898-93a1-a70eca2719e7\" (UID: \"1d89019f-29d3-4898-93a1-a70eca2719e7\") " Jul 17 21:08:07.294625 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:07.294587 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d89019f-29d3-4898-93a1-a70eca2719e7-bundle" (OuterVolumeSpecName: "bundle") pod "1d89019f-29d3-4898-93a1-a70eca2719e7" (UID: "1d89019f-29d3-4898-93a1-a70eca2719e7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:08:07.295979 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:07.295951 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d89019f-29d3-4898-93a1-a70eca2719e7-kube-api-access-74b5w" (OuterVolumeSpecName: "kube-api-access-74b5w") pod "1d89019f-29d3-4898-93a1-a70eca2719e7" (UID: "1d89019f-29d3-4898-93a1-a70eca2719e7"). InnerVolumeSpecName "kube-api-access-74b5w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:08:07.299058 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:07.299025 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d89019f-29d3-4898-93a1-a70eca2719e7-util" (OuterVolumeSpecName: "util") pod "1d89019f-29d3-4898-93a1-a70eca2719e7" (UID: "1d89019f-29d3-4898-93a1-a70eca2719e7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:08:07.394875 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:07.394817 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d89019f-29d3-4898-93a1-a70eca2719e7-bundle\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:08:07.394875 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:07.394847 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d89019f-29d3-4898-93a1-a70eca2719e7-util\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:08:07.394875 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:07.394856 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74b5w\" (UniqueName: \"kubernetes.io/projected/1d89019f-29d3-4898-93a1-a70eca2719e7-kube-api-access-74b5w\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:08:08.071047 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:08.071014 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm" event={"ID":"1d89019f-29d3-4898-93a1-a70eca2719e7","Type":"ContainerDied","Data":"09ccfef3a8cbdf35d6f871c52e11bedb8f34107081a527f70080086f1b19d7b1"} Jul 17 21:08:08.071047 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:08.071046 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcm" Jul 17 21:08:08.071243 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:08.071061 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09ccfef3a8cbdf35d6f871c52e11bedb8f34107081a527f70080086f1b19d7b1" Jul 17 21:08:14.813180 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:14.813097 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-c8db86df9-c4vtt"] Jul 17 21:08:14.813620 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:14.813557 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d89019f-29d3-4898-93a1-a70eca2719e7" containerName="pull" Jul 17 21:08:14.813620 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:14.813576 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d89019f-29d3-4898-93a1-a70eca2719e7" containerName="pull" Jul 17 21:08:14.813620 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:14.813593 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d89019f-29d3-4898-93a1-a70eca2719e7" containerName="extract" Jul 17 21:08:14.813620 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:14.813601 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d89019f-29d3-4898-93a1-a70eca2719e7" containerName="extract" Jul 17 21:08:14.813620 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:14.813617 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d89019f-29d3-4898-93a1-a70eca2719e7" containerName="util" Jul 17 21:08:14.813850 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:14.813627 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d89019f-29d3-4898-93a1-a70eca2719e7" containerName="util" Jul 17 21:08:14.813850 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:14.813721 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d89019f-29d3-4898-93a1-a70eca2719e7" containerName="extract" Jul 17 21:08:14.816715 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:14.816693 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c8db86df9-c4vtt" Jul 17 21:08:14.820005 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:14.819987 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 17 21:08:14.821208 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:14.821175 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 17 21:08:14.821301 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:14.821261 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 17 21:08:14.821301 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:14.821211 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-2zkdb\"" Jul 17 21:08:14.821402 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:14.821246 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 17 21:08:14.821402 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:14.821230 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 17 21:08:14.835397 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:14.835368 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c8db86df9-c4vtt"] Jul 17 21:08:14.950971 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:14.950951 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dfd88280-ce24-4179-b885-8cd622fc0dd8-cert\") pod \"lws-controller-manager-c8db86df9-c4vtt\" (UID: \"dfd88280-ce24-4179-b885-8cd622fc0dd8\") " pod="openshift-lws-operator/lws-controller-manager-c8db86df9-c4vtt" Jul 17 21:08:14.951077 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:14.950987 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tsl2\" (UniqueName: \"kubernetes.io/projected/dfd88280-ce24-4179-b885-8cd622fc0dd8-kube-api-access-2tsl2\") pod \"lws-controller-manager-c8db86df9-c4vtt\" (UID: \"dfd88280-ce24-4179-b885-8cd622fc0dd8\") " pod="openshift-lws-operator/lws-controller-manager-c8db86df9-c4vtt" Jul 17 21:08:14.951077 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:14.951063 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dfd88280-ce24-4179-b885-8cd622fc0dd8-manager-config\") pod \"lws-controller-manager-c8db86df9-c4vtt\" (UID: \"dfd88280-ce24-4179-b885-8cd622fc0dd8\") " pod="openshift-lws-operator/lws-controller-manager-c8db86df9-c4vtt" Jul 17 21:08:14.951218 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:14.951165 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dfd88280-ce24-4179-b885-8cd622fc0dd8-metrics-cert\") pod \"lws-controller-manager-c8db86df9-c4vtt\" (UID: \"dfd88280-ce24-4179-b885-8cd622fc0dd8\") " pod="openshift-lws-operator/lws-controller-manager-c8db86df9-c4vtt" Jul 17 21:08:15.052096 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:15.052070 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tsl2\" (UniqueName: \"kubernetes.io/projected/dfd88280-ce24-4179-b885-8cd622fc0dd8-kube-api-access-2tsl2\") pod \"lws-controller-manager-c8db86df9-c4vtt\" (UID: \"dfd88280-ce24-4179-b885-8cd622fc0dd8\") " pod="openshift-lws-operator/lws-controller-manager-c8db86df9-c4vtt" Jul 17 21:08:15.052174 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:15.052104 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dfd88280-ce24-4179-b885-8cd622fc0dd8-manager-config\") pod \"lws-controller-manager-c8db86df9-c4vtt\" (UID: \"dfd88280-ce24-4179-b885-8cd622fc0dd8\") " pod="openshift-lws-operator/lws-controller-manager-c8db86df9-c4vtt" Jul 17 21:08:15.052174 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:15.052129 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dfd88280-ce24-4179-b885-8cd622fc0dd8-metrics-cert\") pod \"lws-controller-manager-c8db86df9-c4vtt\" (UID: \"dfd88280-ce24-4179-b885-8cd622fc0dd8\") " pod="openshift-lws-operator/lws-controller-manager-c8db86df9-c4vtt" Jul 17 21:08:15.052280 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:15.052213 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dfd88280-ce24-4179-b885-8cd622fc0dd8-cert\") pod \"lws-controller-manager-c8db86df9-c4vtt\" (UID: \"dfd88280-ce24-4179-b885-8cd622fc0dd8\") " pod="openshift-lws-operator/lws-controller-manager-c8db86df9-c4vtt" Jul 17 21:08:15.052804 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:15.052781 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dfd88280-ce24-4179-b885-8cd622fc0dd8-manager-config\") pod \"lws-controller-manager-c8db86df9-c4vtt\" (UID: \"dfd88280-ce24-4179-b885-8cd622fc0dd8\") " pod="openshift-lws-operator/lws-controller-manager-c8db86df9-c4vtt" Jul 17 21:08:15.054442 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:15.054416 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dfd88280-ce24-4179-b885-8cd622fc0dd8-metrics-cert\") pod \"lws-controller-manager-c8db86df9-c4vtt\" (UID: \"dfd88280-ce24-4179-b885-8cd622fc0dd8\") " pod="openshift-lws-operator/lws-controller-manager-c8db86df9-c4vtt" Jul 17 21:08:15.054679 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:15.054658 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dfd88280-ce24-4179-b885-8cd622fc0dd8-cert\") pod \"lws-controller-manager-c8db86df9-c4vtt\" (UID: \"dfd88280-ce24-4179-b885-8cd622fc0dd8\") " pod="openshift-lws-operator/lws-controller-manager-c8db86df9-c4vtt" Jul 17 21:08:15.067377 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:15.067332 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tsl2\" (UniqueName: \"kubernetes.io/projected/dfd88280-ce24-4179-b885-8cd622fc0dd8-kube-api-access-2tsl2\") pod \"lws-controller-manager-c8db86df9-c4vtt\" (UID: \"dfd88280-ce24-4179-b885-8cd622fc0dd8\") " pod="openshift-lws-operator/lws-controller-manager-c8db86df9-c4vtt" Jul 17 21:08:15.125804 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:15.125782 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c8db86df9-c4vtt" Jul 17 21:08:15.262044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:15.262021 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c8db86df9-c4vtt"] Jul 17 21:08:15.264442 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:08:15.264416 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfd88280_ce24_4179_b885_8cd622fc0dd8.slice/crio-388e440ec337ccc911ecd549fc821f0cca99dcabf8e8dfd704f361be0fd29420 WatchSource:0}: Error finding container 388e440ec337ccc911ecd549fc821f0cca99dcabf8e8dfd704f361be0fd29420: Status 404 returned error can't find the container with id 388e440ec337ccc911ecd549fc821f0cca99dcabf8e8dfd704f361be0fd29420 Jul 17 21:08:16.108658 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:16.108614 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c8db86df9-c4vtt" event={"ID":"dfd88280-ce24-4179-b885-8cd622fc0dd8","Type":"ContainerStarted","Data":"388e440ec337ccc911ecd549fc821f0cca99dcabf8e8dfd704f361be0fd29420"} Jul 17 21:08:17.114068 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:17.114024 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c8db86df9-c4vtt" event={"ID":"dfd88280-ce24-4179-b885-8cd622fc0dd8","Type":"ContainerStarted","Data":"9f3012db842497fc8208e77d01d079fa4fb2ffe87e6fd64ff031d9ec491e1d7a"} Jul 17 21:08:17.114443 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:17.114142 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-c8db86df9-c4vtt" Jul 17 21:08:17.144396 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:17.144348 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-c8db86df9-c4vtt" podStartSLOduration=1.915614296 podStartE2EDuration="3.144334009s" totalImagesPullingTime="1.228719713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:08:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:08:17.143704407 +0000 UTC m=+269.741387048" watchObservedRunningTime="2026-07-17 21:08:17.144334009 +0000 UTC m=+269.742016715" Jul 17 21:08:19.518287 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:19.518249 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6"] Jul 17 21:08:19.521809 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:19.521792 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6" Jul 17 21:08:19.526994 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:19.526972 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 17 21:08:19.527118 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:19.526973 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 17 21:08:19.527209 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:19.527124 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 17 21:08:19.527270 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:19.527232 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gc7lq\"" Jul 17 21:08:19.527504 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:19.527487 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 17 21:08:19.544673 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:19.544648 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6"] Jul 17 21:08:19.586828 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:19.586806 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4bfea361-5929-41c8-a517-c35229590b33-manifests\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6\" (UID: \"4bfea361-5929-41c8-a517-c35229590b33\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6" Jul 17 21:08:19.586902 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:19.586832 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4bfea361-5929-41c8-a517-c35229590b33-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6\" (UID: \"4bfea361-5929-41c8-a517-c35229590b33\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6" Jul 17 21:08:19.586902 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:19.586870 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkkcl\" (UniqueName: \"kubernetes.io/projected/4bfea361-5929-41c8-a517-c35229590b33-kube-api-access-vkkcl\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6\" (UID: \"4bfea361-5929-41c8-a517-c35229590b33\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6" Jul 17 21:08:19.586902 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:19.586895 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4bfea361-5929-41c8-a517-c35229590b33-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6\" (UID: \"4bfea361-5929-41c8-a517-c35229590b33\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6" Jul 17 21:08:19.587044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:19.586913 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4bfea361-5929-41c8-a517-c35229590b33-tmp\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6\" (UID: \"4bfea361-5929-41c8-a517-c35229590b33\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6" Jul 17 21:08:19.687600 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:19.687574 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkkcl\" (UniqueName: \"kubernetes.io/projected/4bfea361-5929-41c8-a517-c35229590b33-kube-api-access-vkkcl\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6\" (UID: \"4bfea361-5929-41c8-a517-c35229590b33\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6" Jul 17 21:08:19.687672 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:19.687614 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4bfea361-5929-41c8-a517-c35229590b33-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6\" (UID: \"4bfea361-5929-41c8-a517-c35229590b33\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6" Jul 17 21:08:19.687672 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:19.687640 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4bfea361-5929-41c8-a517-c35229590b33-tmp\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6\" (UID: \"4bfea361-5929-41c8-a517-c35229590b33\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6" Jul 17 21:08:19.687757 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:19.687704 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4bfea361-5929-41c8-a517-c35229590b33-manifests\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6\" (UID: \"4bfea361-5929-41c8-a517-c35229590b33\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6" Jul 17 21:08:19.687757 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:19.687729 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4bfea361-5929-41c8-a517-c35229590b33-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6\" (UID: \"4bfea361-5929-41c8-a517-c35229590b33\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6" Jul 17 21:08:19.688120 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:19.688094 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4bfea361-5929-41c8-a517-c35229590b33-manifests\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6\" (UID: \"4bfea361-5929-41c8-a517-c35229590b33\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6" Jul 17 21:08:19.689967 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:19.689946 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4bfea361-5929-41c8-a517-c35229590b33-tmp\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6\" (UID: \"4bfea361-5929-41c8-a517-c35229590b33\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6" Jul 17 21:08:19.690041 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:19.690026 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4bfea361-5929-41c8-a517-c35229590b33-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6\" (UID: \"4bfea361-5929-41c8-a517-c35229590b33\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6" Jul 17 21:08:19.690318 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:19.690299 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4bfea361-5929-41c8-a517-c35229590b33-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6\" (UID: \"4bfea361-5929-41c8-a517-c35229590b33\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6" Jul 17 21:08:19.699600 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:19.699578 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkkcl\" (UniqueName: \"kubernetes.io/projected/4bfea361-5929-41c8-a517-c35229590b33-kube-api-access-vkkcl\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6\" (UID: \"4bfea361-5929-41c8-a517-c35229590b33\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6" Jul 17 21:08:19.832595 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:19.832567 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6" Jul 17 21:08:19.986066 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:19.986000 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6"] Jul 17 21:08:19.988313 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:08:19.988270 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bfea361_5929_41c8_a517_c35229590b33.slice/crio-3765fbd6e08a4d0cde2cf2422a2bc216b02cb726d342362110ee9bc037478bfd WatchSource:0}: Error finding container 3765fbd6e08a4d0cde2cf2422a2bc216b02cb726d342362110ee9bc037478bfd: Status 404 returned error can't find the container with id 3765fbd6e08a4d0cde2cf2422a2bc216b02cb726d342362110ee9bc037478bfd Jul 17 21:08:20.128271 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:20.128165 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6" event={"ID":"4bfea361-5929-41c8-a517-c35229590b33","Type":"ContainerStarted","Data":"3765fbd6e08a4d0cde2cf2422a2bc216b02cb726d342362110ee9bc037478bfd"} Jul 17 21:08:23.146412 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:23.146378 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6" event={"ID":"4bfea361-5929-41c8-a517-c35229590b33","Type":"ContainerStarted","Data":"aa655a9850412fe6139d294faf01d4e579122fa1530d5a1c2be8755dd01f8fa2"} Jul 17 21:08:25.156478 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:25.156444 2580 generic.go:356] "Generic (PLEG): container finished" podID="4bfea361-5929-41c8-a517-c35229590b33" containerID="aa655a9850412fe6139d294faf01d4e579122fa1530d5a1c2be8755dd01f8fa2" exitCode=0 Jul 17 21:08:25.156876 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:25.156514 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6" event={"ID":"4bfea361-5929-41c8-a517-c35229590b33","Type":"ContainerDied","Data":"aa655a9850412fe6139d294faf01d4e579122fa1530d5a1c2be8755dd01f8fa2"} Jul 17 21:08:26.163401 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:26.163356 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6" event={"ID":"4bfea361-5929-41c8-a517-c35229590b33","Type":"ContainerStarted","Data":"c91a7a12e1e47c4e245e8c7e154c54ced284f581fb7089f437392cb7142d2f4f"} Jul 17 21:08:26.163979 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:26.163593 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6" Jul 17 21:08:26.187620 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:26.187575 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6" podStartSLOduration=2.467960957 podStartE2EDuration="7.187563166s" totalImagesPullingTime="3.626225915s" totalInitContainerRuntime="1.093376294s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:08:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:08:26.186162966 +0000 UTC m=+278.783845601" watchObservedRunningTime="2026-07-17 21:08:26.187563166 +0000 UTC m=+278.785245810" Jul 17 21:08:28.120517 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:28.120483 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-c8db86df9-c4vtt" Jul 17 21:08:37.170401 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:37.170365 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6" Jul 17 21:08:47.381917 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.381877 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm"] Jul 17 21:08:47.385452 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.385429 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:47.388563 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.388543 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-znx4p\"" Jul 17 21:08:47.388677 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.388635 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 17 21:08:47.388827 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.388802 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 17 21:08:47.388933 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.388918 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 17 21:08:47.406935 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.406912 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm"] Jul 17 21:08:47.504682 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.504655 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d553ae0c-64a6-4338-8003-3425c4a1acdd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wgvnm\" (UID: \"d553ae0c-64a6-4338-8003-3425c4a1acdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:47.504788 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.504687 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d553ae0c-64a6-4338-8003-3425c4a1acdd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wgvnm\" (UID: \"d553ae0c-64a6-4338-8003-3425c4a1acdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:47.504788 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.504711 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d553ae0c-64a6-4338-8003-3425c4a1acdd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wgvnm\" (UID: \"d553ae0c-64a6-4338-8003-3425c4a1acdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:47.504788 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.504778 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqjz6\" (UniqueName: \"kubernetes.io/projected/d553ae0c-64a6-4338-8003-3425c4a1acdd-kube-api-access-nqjz6\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wgvnm\" (UID: \"d553ae0c-64a6-4338-8003-3425c4a1acdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:47.504966 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.504850 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d553ae0c-64a6-4338-8003-3425c4a1acdd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wgvnm\" (UID: \"d553ae0c-64a6-4338-8003-3425c4a1acdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:47.504966 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.504891 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d553ae0c-64a6-4338-8003-3425c4a1acdd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wgvnm\" (UID: \"d553ae0c-64a6-4338-8003-3425c4a1acdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:47.504966 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.504922 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d553ae0c-64a6-4338-8003-3425c4a1acdd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wgvnm\" (UID: \"d553ae0c-64a6-4338-8003-3425c4a1acdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:47.505107 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.504968 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d553ae0c-64a6-4338-8003-3425c4a1acdd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wgvnm\" (UID: \"d553ae0c-64a6-4338-8003-3425c4a1acdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:47.505107 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.505017 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d553ae0c-64a6-4338-8003-3425c4a1acdd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wgvnm\" (UID: \"d553ae0c-64a6-4338-8003-3425c4a1acdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:47.605772 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.605751 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d553ae0c-64a6-4338-8003-3425c4a1acdd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wgvnm\" (UID: \"d553ae0c-64a6-4338-8003-3425c4a1acdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:47.605869 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.605777 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d553ae0c-64a6-4338-8003-3425c4a1acdd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wgvnm\" (UID: \"d553ae0c-64a6-4338-8003-3425c4a1acdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:47.605869 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.605801 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d553ae0c-64a6-4338-8003-3425c4a1acdd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wgvnm\" (UID: \"d553ae0c-64a6-4338-8003-3425c4a1acdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:47.605869 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.605826 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d553ae0c-64a6-4338-8003-3425c4a1acdd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wgvnm\" (UID: \"d553ae0c-64a6-4338-8003-3425c4a1acdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:47.606087 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.605873 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d553ae0c-64a6-4338-8003-3425c4a1acdd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wgvnm\" (UID: \"d553ae0c-64a6-4338-8003-3425c4a1acdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:47.606087 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.605903 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d553ae0c-64a6-4338-8003-3425c4a1acdd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wgvnm\" (UID: \"d553ae0c-64a6-4338-8003-3425c4a1acdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:47.606087 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.605927 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d553ae0c-64a6-4338-8003-3425c4a1acdd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wgvnm\" (UID: \"d553ae0c-64a6-4338-8003-3425c4a1acdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:47.606087 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.605962 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d553ae0c-64a6-4338-8003-3425c4a1acdd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wgvnm\" (UID: \"d553ae0c-64a6-4338-8003-3425c4a1acdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:47.606357 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.606126 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqjz6\" (UniqueName: \"kubernetes.io/projected/d553ae0c-64a6-4338-8003-3425c4a1acdd-kube-api-access-nqjz6\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wgvnm\" (UID: \"d553ae0c-64a6-4338-8003-3425c4a1acdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:47.606357 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.606224 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d553ae0c-64a6-4338-8003-3425c4a1acdd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wgvnm\" (UID: \"d553ae0c-64a6-4338-8003-3425c4a1acdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:47.606357 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.606260 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d553ae0c-64a6-4338-8003-3425c4a1acdd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wgvnm\" (UID: \"d553ae0c-64a6-4338-8003-3425c4a1acdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:47.606587 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.606496 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d553ae0c-64a6-4338-8003-3425c4a1acdd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wgvnm\" (UID: \"d553ae0c-64a6-4338-8003-3425c4a1acdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:47.606649 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.606635 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d553ae0c-64a6-4338-8003-3425c4a1acdd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wgvnm\" (UID: \"d553ae0c-64a6-4338-8003-3425c4a1acdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:47.606832 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.606807 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d553ae0c-64a6-4338-8003-3425c4a1acdd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wgvnm\" (UID: \"d553ae0c-64a6-4338-8003-3425c4a1acdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:47.608460 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.608436 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d553ae0c-64a6-4338-8003-3425c4a1acdd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wgvnm\" (UID: \"d553ae0c-64a6-4338-8003-3425c4a1acdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:47.608579 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.608558 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d553ae0c-64a6-4338-8003-3425c4a1acdd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wgvnm\" (UID: \"d553ae0c-64a6-4338-8003-3425c4a1acdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:47.624282 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.624260 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d553ae0c-64a6-4338-8003-3425c4a1acdd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wgvnm\" (UID: \"d553ae0c-64a6-4338-8003-3425c4a1acdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:47.626105 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.626083 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz"] Jul 17 21:08:47.630608 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.630589 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz" Jul 17 21:08:47.634358 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.634307 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 17 21:08:47.634938 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.634921 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 17 21:08:47.635014 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.635001 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 17 21:08:47.635412 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.635391 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kb86d\"" Jul 17 21:08:47.636586 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.636564 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqjz6\" (UniqueName: \"kubernetes.io/projected/d553ae0c-64a6-4338-8003-3425c4a1acdd-kube-api-access-nqjz6\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wgvnm\" (UID: \"d553ae0c-64a6-4338-8003-3425c4a1acdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:47.657726 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.657706 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz"] Jul 17 21:08:47.695326 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.695301 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:47.707066 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.707044 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34919c79-0ccb-4fcb-9fe2-8f8ce2e16571-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-jv4hz\" (UID: \"34919c79-0ccb-4fcb-9fe2-8f8ce2e16571\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz" Jul 17 21:08:47.707211 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.707089 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/34919c79-0ccb-4fcb-9fe2-8f8ce2e16571-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-jv4hz\" (UID: \"34919c79-0ccb-4fcb-9fe2-8f8ce2e16571\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz" Jul 17 21:08:47.707211 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.707156 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/34919c79-0ccb-4fcb-9fe2-8f8ce2e16571-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-jv4hz\" (UID: \"34919c79-0ccb-4fcb-9fe2-8f8ce2e16571\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz" Jul 17 21:08:47.707327 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.707221 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5znjh\" (UniqueName: \"kubernetes.io/projected/34919c79-0ccb-4fcb-9fe2-8f8ce2e16571-kube-api-access-5znjh\") pod \"istiod-openshift-gateway-94bb8fbfd-jv4hz\" (UID: \"34919c79-0ccb-4fcb-9fe2-8f8ce2e16571\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz" Jul 17 21:08:47.707327 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.707294 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/34919c79-0ccb-4fcb-9fe2-8f8ce2e16571-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-jv4hz\" (UID: \"34919c79-0ccb-4fcb-9fe2-8f8ce2e16571\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz" Jul 17 21:08:47.707412 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.707347 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/34919c79-0ccb-4fcb-9fe2-8f8ce2e16571-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-jv4hz\" (UID: \"34919c79-0ccb-4fcb-9fe2-8f8ce2e16571\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz" Jul 17 21:08:47.707412 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.707379 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/34919c79-0ccb-4fcb-9fe2-8f8ce2e16571-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-jv4hz\" (UID: \"34919c79-0ccb-4fcb-9fe2-8f8ce2e16571\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz" Jul 17 21:08:47.765464 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.765440 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bk9fq_c7148bac-9a70-453b-a952-2a7a5e4a0ea6/console-operator/1.log" Jul 17 21:08:47.769960 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.769071 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bk9fq_c7148bac-9a70-453b-a952-2a7a5e4a0ea6/console-operator/1.log" Jul 17 21:08:47.780407 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.780381 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lj5lm_6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd/ovn-acl-logging/0.log" Jul 17 21:08:47.780837 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.780817 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lj5lm_6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd/ovn-acl-logging/0.log" Jul 17 21:08:47.784893 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.784878 2580 kubelet.go:1648] "Image garbage collection succeeded" Jul 17 21:08:47.808780 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.808749 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5znjh\" (UniqueName: \"kubernetes.io/projected/34919c79-0ccb-4fcb-9fe2-8f8ce2e16571-kube-api-access-5znjh\") pod \"istiod-openshift-gateway-94bb8fbfd-jv4hz\" (UID: \"34919c79-0ccb-4fcb-9fe2-8f8ce2e16571\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz" Jul 17 21:08:47.808904 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.808820 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/34919c79-0ccb-4fcb-9fe2-8f8ce2e16571-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-jv4hz\" (UID: \"34919c79-0ccb-4fcb-9fe2-8f8ce2e16571\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz" Jul 17 21:08:47.808904 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.808867 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/34919c79-0ccb-4fcb-9fe2-8f8ce2e16571-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-jv4hz\" (UID: \"34919c79-0ccb-4fcb-9fe2-8f8ce2e16571\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz" Jul 17 21:08:47.808904 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.808894 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/34919c79-0ccb-4fcb-9fe2-8f8ce2e16571-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-jv4hz\" (UID: \"34919c79-0ccb-4fcb-9fe2-8f8ce2e16571\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz" Jul 17 21:08:47.809079 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.808944 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34919c79-0ccb-4fcb-9fe2-8f8ce2e16571-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-jv4hz\" (UID: \"34919c79-0ccb-4fcb-9fe2-8f8ce2e16571\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz" Jul 17 21:08:47.809079 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.808987 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/34919c79-0ccb-4fcb-9fe2-8f8ce2e16571-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-jv4hz\" (UID: \"34919c79-0ccb-4fcb-9fe2-8f8ce2e16571\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz" Jul 17 21:08:47.809079 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.809032 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/34919c79-0ccb-4fcb-9fe2-8f8ce2e16571-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-jv4hz\" (UID: \"34919c79-0ccb-4fcb-9fe2-8f8ce2e16571\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz" Jul 17 21:08:47.810765 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.810719 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/34919c79-0ccb-4fcb-9fe2-8f8ce2e16571-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-jv4hz\" (UID: \"34919c79-0ccb-4fcb-9fe2-8f8ce2e16571\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz" Jul 17 21:08:47.811853 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.811826 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 17 21:08:47.812087 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.811829 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 17 21:08:47.812243 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.812094 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 17 21:08:47.812637 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.812597 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/34919c79-0ccb-4fcb-9fe2-8f8ce2e16571-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-jv4hz\" (UID: \"34919c79-0ccb-4fcb-9fe2-8f8ce2e16571\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz" Jul 17 21:08:47.818674 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.818629 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5znjh\" (UniqueName: \"kubernetes.io/projected/34919c79-0ccb-4fcb-9fe2-8f8ce2e16571-kube-api-access-5znjh\") pod \"istiod-openshift-gateway-94bb8fbfd-jv4hz\" (UID: \"34919c79-0ccb-4fcb-9fe2-8f8ce2e16571\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz" Jul 17 21:08:47.818982 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.818961 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34919c79-0ccb-4fcb-9fe2-8f8ce2e16571-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-jv4hz\" (UID: \"34919c79-0ccb-4fcb-9fe2-8f8ce2e16571\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz" Jul 17 21:08:47.821690 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.821669 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/34919c79-0ccb-4fcb-9fe2-8f8ce2e16571-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-jv4hz\" (UID: \"34919c79-0ccb-4fcb-9fe2-8f8ce2e16571\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz" Jul 17 21:08:47.821843 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.821748 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/34919c79-0ccb-4fcb-9fe2-8f8ce2e16571-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-jv4hz\" (UID: \"34919c79-0ccb-4fcb-9fe2-8f8ce2e16571\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz" Jul 17 21:08:47.822419 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.822398 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/34919c79-0ccb-4fcb-9fe2-8f8ce2e16571-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-jv4hz\" (UID: \"34919c79-0ccb-4fcb-9fe2-8f8ce2e16571\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz" Jul 17 21:08:47.868581 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.868559 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm"] Jul 17 21:08:47.871079 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:08:47.871055 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd553ae0c_64a6_4338_8003_3425c4a1acdd.slice/crio-d56eacd2de3d356465048a93e63a059acc8d35dedc1add6981d165efce5b96c9 WatchSource:0}: Error finding container d56eacd2de3d356465048a93e63a059acc8d35dedc1add6981d165efce5b96c9: Status 404 returned error can't find the container with id d56eacd2de3d356465048a93e63a059acc8d35dedc1add6981d165efce5b96c9 Jul 17 21:08:47.949044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.948866 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kb86d\"" Jul 17 21:08:47.989675 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:47.957272 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz" Jul 17 21:08:48.105988 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:48.105950 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz"] Jul 17 21:08:48.109707 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:08:48.109681 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34919c79_0ccb_4fcb_9fe2_8f8ce2e16571.slice/crio-e1b592ab1b48411629a57d5f823e97d98ce6ba1a65eda43436409bd786f4a090 WatchSource:0}: Error finding container e1b592ab1b48411629a57d5f823e97d98ce6ba1a65eda43436409bd786f4a090: Status 404 returned error can't find the container with id e1b592ab1b48411629a57d5f823e97d98ce6ba1a65eda43436409bd786f4a090 Jul 17 21:08:48.262615 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:48.262549 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz" event={"ID":"34919c79-0ccb-4fcb-9fe2-8f8ce2e16571","Type":"ContainerStarted","Data":"e1b592ab1b48411629a57d5f823e97d98ce6ba1a65eda43436409bd786f4a090"} Jul 17 21:08:48.263690 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:48.263663 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" event={"ID":"d553ae0c-64a6-4338-8003-3425c4a1acdd","Type":"ContainerStarted","Data":"d56eacd2de3d356465048a93e63a059acc8d35dedc1add6981d165efce5b96c9"} Jul 17 21:08:51.559727 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:51.559685 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:08:51.560057 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:51.559770 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:08:51.560057 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:51.559799 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:08:51.561494 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:51.561471 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:08:51.561552 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:51.561519 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:08:52.290045 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:52.290003 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" event={"ID":"d553ae0c-64a6-4338-8003-3425c4a1acdd","Type":"ContainerStarted","Data":"4abec4216645be1b7adbea076862eb97e5711d3ed37f0d3926196775aecfb71b"} Jul 17 21:08:52.291835 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:52.291803 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz" event={"ID":"34919c79-0ccb-4fcb-9fe2-8f8ce2e16571","Type":"ContainerStarted","Data":"659a833959527ea88b39c4148ca22ff6ba0050ddd333206f07ffd9c8de1ff1fd"} Jul 17 21:08:52.292012 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:52.291999 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz" Jul 17 21:08:52.293493 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:52.293466 2580 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-jv4hz container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 17 21:08:52.293621 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:52.293513 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz" podUID="34919c79-0ccb-4fcb-9fe2-8f8ce2e16571" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 17 21:08:52.314249 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:52.314207 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" podStartSLOduration=1.627724661 podStartE2EDuration="5.314174155s" totalImagesPullingTime="3.686449494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:08:52.312870963 +0000 UTC m=+304.910553605" watchObservedRunningTime="2026-07-17 21:08:52.314174155 +0000 UTC m=+304.911856798" Jul 17 21:08:52.338814 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:52.338772 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz" podStartSLOduration=1.889167541 podStartE2EDuration="5.338758885s" totalImagesPullingTime="3.449591344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:08:52.337607477 +0000 UTC m=+304.935290122" watchObservedRunningTime="2026-07-17 21:08:52.338758885 +0000 UTC m=+304.936441527" Jul 17 21:08:52.695440 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:52.695410 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:52.700057 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:52.700033 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:53.297575 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:53.297535 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:08:53.298048 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:53.298017 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jv4hz" Jul 17 21:08:53.298486 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:08:53.298466 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" Jul 17 21:09:55.722140 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:55.722057 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn"] Jul 17 21:09:55.725818 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:55.725801 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn" Jul 17 21:09:55.728540 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:55.728519 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 17 21:09:55.728647 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:55.728518 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 17 21:09:55.729323 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:55.729309 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4nk2c\"" Jul 17 21:09:55.734350 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:55.734331 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn"] Jul 17 21:09:55.847662 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:55.847632 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a1a358a-046b-4ec2-8fb4-977974c2caa7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn\" (UID: \"7a1a358a-046b-4ec2-8fb4-977974c2caa7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn" Jul 17 21:09:55.847808 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:55.847667 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a1a358a-046b-4ec2-8fb4-977974c2caa7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn\" (UID: \"7a1a358a-046b-4ec2-8fb4-977974c2caa7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn" Jul 17 21:09:55.847808 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:55.847683 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wfhh\" (UniqueName: \"kubernetes.io/projected/7a1a358a-046b-4ec2-8fb4-977974c2caa7-kube-api-access-6wfhh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn\" (UID: \"7a1a358a-046b-4ec2-8fb4-977974c2caa7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn" Jul 17 21:09:55.948758 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:55.948722 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a1a358a-046b-4ec2-8fb4-977974c2caa7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn\" (UID: \"7a1a358a-046b-4ec2-8fb4-977974c2caa7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn" Jul 17 21:09:55.948891 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:55.948769 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a1a358a-046b-4ec2-8fb4-977974c2caa7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn\" (UID: \"7a1a358a-046b-4ec2-8fb4-977974c2caa7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn" Jul 17 21:09:55.948891 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:55.948796 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wfhh\" (UniqueName: \"kubernetes.io/projected/7a1a358a-046b-4ec2-8fb4-977974c2caa7-kube-api-access-6wfhh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn\" (UID: \"7a1a358a-046b-4ec2-8fb4-977974c2caa7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn" Jul 17 21:09:55.949104 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:55.949083 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a1a358a-046b-4ec2-8fb4-977974c2caa7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn\" (UID: \"7a1a358a-046b-4ec2-8fb4-977974c2caa7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn" Jul 17 21:09:55.949205 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:55.949163 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a1a358a-046b-4ec2-8fb4-977974c2caa7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn\" (UID: \"7a1a358a-046b-4ec2-8fb4-977974c2caa7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn" Jul 17 21:09:55.959857 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:55.959830 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wfhh\" (UniqueName: \"kubernetes.io/projected/7a1a358a-046b-4ec2-8fb4-977974c2caa7-kube-api-access-6wfhh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn\" (UID: \"7a1a358a-046b-4ec2-8fb4-977974c2caa7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn" Jul 17 21:09:56.036408 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:56.036350 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn" Jul 17 21:09:56.167543 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:56.167519 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn"] Jul 17 21:09:56.169577 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:09:56.169544 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a1a358a_046b_4ec2_8fb4_977974c2caa7.slice/crio-ab50a8c3caf880937e413d4beb15d9efb3fb7e577f6379ba5b1f40257ce221d0 WatchSource:0}: Error finding container ab50a8c3caf880937e413d4beb15d9efb3fb7e577f6379ba5b1f40257ce221d0: Status 404 returned error can't find the container with id ab50a8c3caf880937e413d4beb15d9efb3fb7e577f6379ba5b1f40257ce221d0 Jul 17 21:09:56.323283 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:56.323253 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2"] Jul 17 21:09:56.326646 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:56.326629 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2" Jul 17 21:09:56.336169 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:56.336149 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2"] Jul 17 21:09:56.452970 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:56.452939 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a332ed8-c80f-4e41-94e8-5bfa7169c4b6-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2\" (UID: \"0a332ed8-c80f-4e41-94e8-5bfa7169c4b6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2" Jul 17 21:09:56.453080 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:56.452986 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhkxw\" (UniqueName: \"kubernetes.io/projected/0a332ed8-c80f-4e41-94e8-5bfa7169c4b6-kube-api-access-bhkxw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2\" (UID: \"0a332ed8-c80f-4e41-94e8-5bfa7169c4b6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2" Jul 17 21:09:56.453080 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:56.453020 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a332ed8-c80f-4e41-94e8-5bfa7169c4b6-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2\" (UID: \"0a332ed8-c80f-4e41-94e8-5bfa7169c4b6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2" Jul 17 21:09:56.553460 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:56.553433 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a332ed8-c80f-4e41-94e8-5bfa7169c4b6-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2\" (UID: \"0a332ed8-c80f-4e41-94e8-5bfa7169c4b6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2" Jul 17 21:09:56.553573 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:56.553498 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a332ed8-c80f-4e41-94e8-5bfa7169c4b6-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2\" (UID: \"0a332ed8-c80f-4e41-94e8-5bfa7169c4b6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2" Jul 17 21:09:56.553573 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:56.553531 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhkxw\" (UniqueName: \"kubernetes.io/projected/0a332ed8-c80f-4e41-94e8-5bfa7169c4b6-kube-api-access-bhkxw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2\" (UID: \"0a332ed8-c80f-4e41-94e8-5bfa7169c4b6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2" Jul 17 21:09:56.553765 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:56.553743 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a332ed8-c80f-4e41-94e8-5bfa7169c4b6-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2\" (UID: \"0a332ed8-c80f-4e41-94e8-5bfa7169c4b6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2" Jul 17 21:09:56.553841 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:56.553816 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a332ed8-c80f-4e41-94e8-5bfa7169c4b6-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2\" (UID: \"0a332ed8-c80f-4e41-94e8-5bfa7169c4b6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2" Jul 17 21:09:56.561695 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:56.561673 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhkxw\" (UniqueName: \"kubernetes.io/projected/0a332ed8-c80f-4e41-94e8-5bfa7169c4b6-kube-api-access-bhkxw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2\" (UID: \"0a332ed8-c80f-4e41-94e8-5bfa7169c4b6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2" Jul 17 21:09:56.601477 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:56.601420 2580 generic.go:356] "Generic (PLEG): container finished" podID="7a1a358a-046b-4ec2-8fb4-977974c2caa7" containerID="736ca186c2b594fba153f85354b040f7f87dad9641897fe0e6e0d8ed25cd0212" exitCode=0 Jul 17 21:09:56.601551 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:56.601510 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn" event={"ID":"7a1a358a-046b-4ec2-8fb4-977974c2caa7","Type":"ContainerDied","Data":"736ca186c2b594fba153f85354b040f7f87dad9641897fe0e6e0d8ed25cd0212"} Jul 17 21:09:56.601593 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:56.601554 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn" event={"ID":"7a1a358a-046b-4ec2-8fb4-977974c2caa7","Type":"ContainerStarted","Data":"ab50a8c3caf880937e413d4beb15d9efb3fb7e577f6379ba5b1f40257ce221d0"} Jul 17 21:09:56.601881 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:56.601867 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 21:09:56.643453 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:56.643431 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2" Jul 17 21:09:56.775142 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:56.775113 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2"] Jul 17 21:09:56.778088 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:09:56.778065 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a332ed8_c80f_4e41_94e8_5bfa7169c4b6.slice/crio-b2fa50f3dc916ae1bc808e67aaf9a6a2d6d5d38676d5c5aeae8cc0a3adeca4ee WatchSource:0}: Error finding container b2fa50f3dc916ae1bc808e67aaf9a6a2d6d5d38676d5c5aeae8cc0a3adeca4ee: Status 404 returned error can't find the container with id b2fa50f3dc916ae1bc808e67aaf9a6a2d6d5d38676d5c5aeae8cc0a3adeca4ee Jul 17 21:09:56.924545 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:56.924515 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6"] Jul 17 21:09:56.927901 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:56.927885 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6" Jul 17 21:09:56.936421 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:56.936400 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6"] Jul 17 21:09:57.058794 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.058768 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef5acc2a-487c-4f8d-82f5-9958951821ec-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6\" (UID: \"ef5acc2a-487c-4f8d-82f5-9958951821ec\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6" Jul 17 21:09:57.058901 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.058806 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ncfh\" (UniqueName: \"kubernetes.io/projected/ef5acc2a-487c-4f8d-82f5-9958951821ec-kube-api-access-5ncfh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6\" (UID: \"ef5acc2a-487c-4f8d-82f5-9958951821ec\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6" Jul 17 21:09:57.058901 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.058889 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef5acc2a-487c-4f8d-82f5-9958951821ec-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6\" (UID: \"ef5acc2a-487c-4f8d-82f5-9958951821ec\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6" Jul 17 21:09:57.160068 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.160007 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef5acc2a-487c-4f8d-82f5-9958951821ec-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6\" (UID: \"ef5acc2a-487c-4f8d-82f5-9958951821ec\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6" Jul 17 21:09:57.160068 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.160046 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ncfh\" (UniqueName: \"kubernetes.io/projected/ef5acc2a-487c-4f8d-82f5-9958951821ec-kube-api-access-5ncfh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6\" (UID: \"ef5acc2a-487c-4f8d-82f5-9958951821ec\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6" Jul 17 21:09:57.160222 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.160085 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef5acc2a-487c-4f8d-82f5-9958951821ec-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6\" (UID: \"ef5acc2a-487c-4f8d-82f5-9958951821ec\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6" Jul 17 21:09:57.160462 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.160440 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef5acc2a-487c-4f8d-82f5-9958951821ec-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6\" (UID: \"ef5acc2a-487c-4f8d-82f5-9958951821ec\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6" Jul 17 21:09:57.160507 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.160448 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef5acc2a-487c-4f8d-82f5-9958951821ec-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6\" (UID: \"ef5acc2a-487c-4f8d-82f5-9958951821ec\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6" Jul 17 21:09:57.169069 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.169049 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ncfh\" (UniqueName: \"kubernetes.io/projected/ef5acc2a-487c-4f8d-82f5-9958951821ec-kube-api-access-5ncfh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6\" (UID: \"ef5acc2a-487c-4f8d-82f5-9958951821ec\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6" Jul 17 21:09:57.251247 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.251223 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6" Jul 17 21:09:57.320986 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.320955 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk"] Jul 17 21:09:57.324388 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.324368 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk" Jul 17 21:09:57.331957 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.331929 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk"] Jul 17 21:09:57.390017 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.389846 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6"] Jul 17 21:09:57.394179 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:09:57.394153 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef5acc2a_487c_4f8d_82f5_9958951821ec.slice/crio-a2e9caf06d28ad96d9edef0e0671f46bbcacf60f09ec1b8c3a3fd17272e9b433 WatchSource:0}: Error finding container a2e9caf06d28ad96d9edef0e0671f46bbcacf60f09ec1b8c3a3fd17272e9b433: Status 404 returned error can't find the container with id a2e9caf06d28ad96d9edef0e0671f46bbcacf60f09ec1b8c3a3fd17272e9b433 Jul 17 21:09:57.463084 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.463055 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd522c17-0387-460d-a61a-c988ef4d0496-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk\" (UID: \"bd522c17-0387-460d-a61a-c988ef4d0496\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk" Jul 17 21:09:57.463229 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.463119 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxr7d\" (UniqueName: \"kubernetes.io/projected/bd522c17-0387-460d-a61a-c988ef4d0496-kube-api-access-xxr7d\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk\" (UID: \"bd522c17-0387-460d-a61a-c988ef4d0496\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk" Jul 17 21:09:57.463229 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.463163 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd522c17-0387-460d-a61a-c988ef4d0496-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk\" (UID: \"bd522c17-0387-460d-a61a-c988ef4d0496\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk" Jul 17 21:09:57.564295 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.564266 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd522c17-0387-460d-a61a-c988ef4d0496-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk\" (UID: \"bd522c17-0387-460d-a61a-c988ef4d0496\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk" Jul 17 21:09:57.564415 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.564356 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd522c17-0387-460d-a61a-c988ef4d0496-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk\" (UID: \"bd522c17-0387-460d-a61a-c988ef4d0496\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk" Jul 17 21:09:57.564479 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.564441 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxr7d\" (UniqueName: \"kubernetes.io/projected/bd522c17-0387-460d-a61a-c988ef4d0496-kube-api-access-xxr7d\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk\" (UID: \"bd522c17-0387-460d-a61a-c988ef4d0496\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk" Jul 17 21:09:57.564690 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.564668 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd522c17-0387-460d-a61a-c988ef4d0496-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk\" (UID: \"bd522c17-0387-460d-a61a-c988ef4d0496\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk" Jul 17 21:09:57.564738 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.564692 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd522c17-0387-460d-a61a-c988ef4d0496-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk\" (UID: \"bd522c17-0387-460d-a61a-c988ef4d0496\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk" Jul 17 21:09:57.572472 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.572453 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxr7d\" (UniqueName: \"kubernetes.io/projected/bd522c17-0387-460d-a61a-c988ef4d0496-kube-api-access-xxr7d\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk\" (UID: \"bd522c17-0387-460d-a61a-c988ef4d0496\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk" Jul 17 21:09:57.607963 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.607934 2580 generic.go:356] "Generic (PLEG): container finished" podID="7a1a358a-046b-4ec2-8fb4-977974c2caa7" containerID="0df348e0d5a43516f522327394aada0df93a9c862372a7f277dd81e07e275645" exitCode=0 Jul 17 21:09:57.608051 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.608028 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn" event={"ID":"7a1a358a-046b-4ec2-8fb4-977974c2caa7","Type":"ContainerDied","Data":"0df348e0d5a43516f522327394aada0df93a9c862372a7f277dd81e07e275645"} Jul 17 21:09:57.609687 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.609664 2580 generic.go:356] "Generic (PLEG): container finished" podID="ef5acc2a-487c-4f8d-82f5-9958951821ec" containerID="2e0e46d671818f42075135c43a2ffb9fa0b4c4500ab3f9b37b99bedccc952e68" exitCode=0 Jul 17 21:09:57.609773 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.609751 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6" event={"ID":"ef5acc2a-487c-4f8d-82f5-9958951821ec","Type":"ContainerDied","Data":"2e0e46d671818f42075135c43a2ffb9fa0b4c4500ab3f9b37b99bedccc952e68"} Jul 17 21:09:57.609824 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.609808 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6" event={"ID":"ef5acc2a-487c-4f8d-82f5-9958951821ec","Type":"ContainerStarted","Data":"a2e9caf06d28ad96d9edef0e0671f46bbcacf60f09ec1b8c3a3fd17272e9b433"} Jul 17 21:09:57.611402 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.611372 2580 generic.go:356] "Generic (PLEG): container finished" podID="0a332ed8-c80f-4e41-94e8-5bfa7169c4b6" containerID="14f0b11758591342ffaf17d81b562b0865c3868e629cfc7ebf9dce4cf1a8c27d" exitCode=0 Jul 17 21:09:57.611517 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.611457 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2" event={"ID":"0a332ed8-c80f-4e41-94e8-5bfa7169c4b6","Type":"ContainerDied","Data":"14f0b11758591342ffaf17d81b562b0865c3868e629cfc7ebf9dce4cf1a8c27d"} Jul 17 21:09:57.611568 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.611516 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2" event={"ID":"0a332ed8-c80f-4e41-94e8-5bfa7169c4b6","Type":"ContainerStarted","Data":"b2fa50f3dc916ae1bc808e67aaf9a6a2d6d5d38676d5c5aeae8cc0a3adeca4ee"} Jul 17 21:09:57.636106 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.636088 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk" Jul 17 21:09:57.775769 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:57.775742 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk"] Jul 17 21:09:57.821901 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:09:57.821873 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd522c17_0387_460d_a61a_c988ef4d0496.slice/crio-f0c305e351678ac52f9221bb71336325214570ceb6663c91620b738cc5740174 WatchSource:0}: Error finding container f0c305e351678ac52f9221bb71336325214570ceb6663c91620b738cc5740174: Status 404 returned error can't find the container with id f0c305e351678ac52f9221bb71336325214570ceb6663c91620b738cc5740174 Jul 17 21:09:58.619258 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:58.619233 2580 generic.go:356] "Generic (PLEG): container finished" podID="7a1a358a-046b-4ec2-8fb4-977974c2caa7" containerID="ec5eaaae60d77c5754118d1d5e96ec015221fc94766462404256ebce5375064b" exitCode=0 Jul 17 21:09:58.619389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:58.619307 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn" event={"ID":"7a1a358a-046b-4ec2-8fb4-977974c2caa7","Type":"ContainerDied","Data":"ec5eaaae60d77c5754118d1d5e96ec015221fc94766462404256ebce5375064b"} Jul 17 21:09:58.620887 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:58.620866 2580 generic.go:356] "Generic (PLEG): container finished" podID="bd522c17-0387-460d-a61a-c988ef4d0496" containerID="5beec86eaa7edd0336876cb2d3d067e05fedbb9959234a19b89ad9b76612d5c0" exitCode=0 Jul 17 21:09:58.620988 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:58.620932 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk" event={"ID":"bd522c17-0387-460d-a61a-c988ef4d0496","Type":"ContainerDied","Data":"5beec86eaa7edd0336876cb2d3d067e05fedbb9959234a19b89ad9b76612d5c0"} Jul 17 21:09:58.620988 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:58.620980 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk" event={"ID":"bd522c17-0387-460d-a61a-c988ef4d0496","Type":"ContainerStarted","Data":"f0c305e351678ac52f9221bb71336325214570ceb6663c91620b738cc5740174"} Jul 17 21:09:58.623504 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:58.623239 2580 generic.go:356] "Generic (PLEG): container finished" podID="0a332ed8-c80f-4e41-94e8-5bfa7169c4b6" containerID="aaa0f109085f178cb2ab09e8893a160fdcff99522481127f6cc4fa3bd8e1aa56" exitCode=0 Jul 17 21:09:58.623504 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:58.623306 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2" event={"ID":"0a332ed8-c80f-4e41-94e8-5bfa7169c4b6","Type":"ContainerDied","Data":"aaa0f109085f178cb2ab09e8893a160fdcff99522481127f6cc4fa3bd8e1aa56"} Jul 17 21:09:59.630615 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:59.630533 2580 generic.go:356] "Generic (PLEG): container finished" podID="bd522c17-0387-460d-a61a-c988ef4d0496" containerID="835e09352d0c18aff6e27f19889a7ea305e3e7168ba692aaadacefe8cea4716b" exitCode=0 Jul 17 21:09:59.630992 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:59.630618 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk" event={"ID":"bd522c17-0387-460d-a61a-c988ef4d0496","Type":"ContainerDied","Data":"835e09352d0c18aff6e27f19889a7ea305e3e7168ba692aaadacefe8cea4716b"} Jul 17 21:09:59.632517 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:59.632489 2580 generic.go:356] "Generic (PLEG): container finished" podID="ef5acc2a-487c-4f8d-82f5-9958951821ec" containerID="21a8311df3ca62de80e31f460f46603e5ba2c30430746fdfda4e1eead6b668fb" exitCode=0 Jul 17 21:09:59.632594 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:59.632537 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6" event={"ID":"ef5acc2a-487c-4f8d-82f5-9958951821ec","Type":"ContainerDied","Data":"21a8311df3ca62de80e31f460f46603e5ba2c30430746fdfda4e1eead6b668fb"} Jul 17 21:09:59.634679 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:59.634660 2580 generic.go:356] "Generic (PLEG): container finished" podID="0a332ed8-c80f-4e41-94e8-5bfa7169c4b6" containerID="853e652e6914d304169cc91af858a94bb75b120cb0b0b54a47de52fb441b95f6" exitCode=0 Jul 17 21:09:59.634761 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:59.634740 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2" event={"ID":"0a332ed8-c80f-4e41-94e8-5bfa7169c4b6","Type":"ContainerDied","Data":"853e652e6914d304169cc91af858a94bb75b120cb0b0b54a47de52fb441b95f6"} Jul 17 21:09:59.770954 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:59.770932 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn" Jul 17 21:09:59.886099 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:59.886040 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a1a358a-046b-4ec2-8fb4-977974c2caa7-util\") pod \"7a1a358a-046b-4ec2-8fb4-977974c2caa7\" (UID: \"7a1a358a-046b-4ec2-8fb4-977974c2caa7\") " Jul 17 21:09:59.886208 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:59.886119 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wfhh\" (UniqueName: \"kubernetes.io/projected/7a1a358a-046b-4ec2-8fb4-977974c2caa7-kube-api-access-6wfhh\") pod \"7a1a358a-046b-4ec2-8fb4-977974c2caa7\" (UID: \"7a1a358a-046b-4ec2-8fb4-977974c2caa7\") " Jul 17 21:09:59.886208 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:59.886148 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a1a358a-046b-4ec2-8fb4-977974c2caa7-bundle\") pod \"7a1a358a-046b-4ec2-8fb4-977974c2caa7\" (UID: \"7a1a358a-046b-4ec2-8fb4-977974c2caa7\") " Jul 17 21:09:59.886802 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:59.886766 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a1a358a-046b-4ec2-8fb4-977974c2caa7-bundle" (OuterVolumeSpecName: "bundle") pod "7a1a358a-046b-4ec2-8fb4-977974c2caa7" (UID: "7a1a358a-046b-4ec2-8fb4-977974c2caa7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:09:59.888208 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:59.888176 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a1a358a-046b-4ec2-8fb4-977974c2caa7-kube-api-access-6wfhh" (OuterVolumeSpecName: "kube-api-access-6wfhh") pod "7a1a358a-046b-4ec2-8fb4-977974c2caa7" (UID: "7a1a358a-046b-4ec2-8fb4-977974c2caa7"). InnerVolumeSpecName "kube-api-access-6wfhh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:09:59.891881 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:59.891857 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a1a358a-046b-4ec2-8fb4-977974c2caa7-util" (OuterVolumeSpecName: "util") pod "7a1a358a-046b-4ec2-8fb4-977974c2caa7" (UID: "7a1a358a-046b-4ec2-8fb4-977974c2caa7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:09:59.987761 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:59.987728 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wfhh\" (UniqueName: \"kubernetes.io/projected/7a1a358a-046b-4ec2-8fb4-977974c2caa7-kube-api-access-6wfhh\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:09:59.987761 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:59.987760 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a1a358a-046b-4ec2-8fb4-977974c2caa7-bundle\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:09:59.987892 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:09:59.987776 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a1a358a-046b-4ec2-8fb4-977974c2caa7-util\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:10:00.641958 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:00.641923 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn" event={"ID":"7a1a358a-046b-4ec2-8fb4-977974c2caa7","Type":"ContainerDied","Data":"ab50a8c3caf880937e413d4beb15d9efb3fb7e577f6379ba5b1f40257ce221d0"} Jul 17 21:10:00.642389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:00.641974 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab50a8c3caf880937e413d4beb15d9efb3fb7e577f6379ba5b1f40257ce221d0" Jul 17 21:10:00.642389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:00.641931 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn" Jul 17 21:10:00.644080 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:00.644054 2580 generic.go:356] "Generic (PLEG): container finished" podID="bd522c17-0387-460d-a61a-c988ef4d0496" containerID="f030967a16014d233f7511c58a4c358627ca3e2490ed3aff0821660d0965305f" exitCode=0 Jul 17 21:10:00.644227 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:00.644078 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk" event={"ID":"bd522c17-0387-460d-a61a-c988ef4d0496","Type":"ContainerDied","Data":"f030967a16014d233f7511c58a4c358627ca3e2490ed3aff0821660d0965305f"} Jul 17 21:10:00.646258 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:00.646236 2580 generic.go:356] "Generic (PLEG): container finished" podID="ef5acc2a-487c-4f8d-82f5-9958951821ec" containerID="80f37991a7c1416256a2b1ec02321153ecd7622357209ec5e1f2a720ba6c71c9" exitCode=0 Jul 17 21:10:00.646367 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:00.646262 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6" event={"ID":"ef5acc2a-487c-4f8d-82f5-9958951821ec","Type":"ContainerDied","Data":"80f37991a7c1416256a2b1ec02321153ecd7622357209ec5e1f2a720ba6c71c9"} Jul 17 21:10:00.777811 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:00.777784 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2" Jul 17 21:10:00.895252 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:00.895163 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a332ed8-c80f-4e41-94e8-5bfa7169c4b6-util\") pod \"0a332ed8-c80f-4e41-94e8-5bfa7169c4b6\" (UID: \"0a332ed8-c80f-4e41-94e8-5bfa7169c4b6\") " Jul 17 21:10:00.895416 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:00.895287 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a332ed8-c80f-4e41-94e8-5bfa7169c4b6-bundle\") pod \"0a332ed8-c80f-4e41-94e8-5bfa7169c4b6\" (UID: \"0a332ed8-c80f-4e41-94e8-5bfa7169c4b6\") " Jul 17 21:10:00.895416 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:00.895336 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhkxw\" (UniqueName: \"kubernetes.io/projected/0a332ed8-c80f-4e41-94e8-5bfa7169c4b6-kube-api-access-bhkxw\") pod \"0a332ed8-c80f-4e41-94e8-5bfa7169c4b6\" (UID: \"0a332ed8-c80f-4e41-94e8-5bfa7169c4b6\") " Jul 17 21:10:00.895744 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:00.895722 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a332ed8-c80f-4e41-94e8-5bfa7169c4b6-bundle" (OuterVolumeSpecName: "bundle") pod "0a332ed8-c80f-4e41-94e8-5bfa7169c4b6" (UID: "0a332ed8-c80f-4e41-94e8-5bfa7169c4b6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:10:00.897814 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:00.897787 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a332ed8-c80f-4e41-94e8-5bfa7169c4b6-kube-api-access-bhkxw" (OuterVolumeSpecName: "kube-api-access-bhkxw") pod "0a332ed8-c80f-4e41-94e8-5bfa7169c4b6" (UID: "0a332ed8-c80f-4e41-94e8-5bfa7169c4b6"). InnerVolumeSpecName "kube-api-access-bhkxw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:10:00.900878 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:00.900843 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a332ed8-c80f-4e41-94e8-5bfa7169c4b6-util" (OuterVolumeSpecName: "util") pod "0a332ed8-c80f-4e41-94e8-5bfa7169c4b6" (UID: "0a332ed8-c80f-4e41-94e8-5bfa7169c4b6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:10:00.996633 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:00.996599 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a332ed8-c80f-4e41-94e8-5bfa7169c4b6-bundle\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:10:00.996633 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:00.996629 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhkxw\" (UniqueName: \"kubernetes.io/projected/0a332ed8-c80f-4e41-94e8-5bfa7169c4b6-kube-api-access-bhkxw\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:10:00.996633 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:00.996638 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a332ed8-c80f-4e41-94e8-5bfa7169c4b6-util\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:10:01.653972 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:01.653945 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2" Jul 17 21:10:01.654435 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:01.653981 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2" event={"ID":"0a332ed8-c80f-4e41-94e8-5bfa7169c4b6","Type":"ContainerDied","Data":"b2fa50f3dc916ae1bc808e67aaf9a6a2d6d5d38676d5c5aeae8cc0a3adeca4ee"} Jul 17 21:10:01.654435 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:01.654035 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2fa50f3dc916ae1bc808e67aaf9a6a2d6d5d38676d5c5aeae8cc0a3adeca4ee" Jul 17 21:10:01.824058 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:01.824033 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6" Jul 17 21:10:01.826143 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:01.826125 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk" Jul 17 21:10:01.906764 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:01.906702 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxr7d\" (UniqueName: \"kubernetes.io/projected/bd522c17-0387-460d-a61a-c988ef4d0496-kube-api-access-xxr7d\") pod \"bd522c17-0387-460d-a61a-c988ef4d0496\" (UID: \"bd522c17-0387-460d-a61a-c988ef4d0496\") " Jul 17 21:10:01.906764 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:01.906738 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd522c17-0387-460d-a61a-c988ef4d0496-bundle\") pod \"bd522c17-0387-460d-a61a-c988ef4d0496\" (UID: \"bd522c17-0387-460d-a61a-c988ef4d0496\") " Jul 17 21:10:01.906914 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:01.906789 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef5acc2a-487c-4f8d-82f5-9958951821ec-bundle\") pod \"ef5acc2a-487c-4f8d-82f5-9958951821ec\" (UID: \"ef5acc2a-487c-4f8d-82f5-9958951821ec\") " Jul 17 21:10:01.906914 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:01.906817 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd522c17-0387-460d-a61a-c988ef4d0496-util\") pod \"bd522c17-0387-460d-a61a-c988ef4d0496\" (UID: \"bd522c17-0387-460d-a61a-c988ef4d0496\") " Jul 17 21:10:01.906990 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:01.906912 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef5acc2a-487c-4f8d-82f5-9958951821ec-util\") pod \"ef5acc2a-487c-4f8d-82f5-9958951821ec\" (UID: \"ef5acc2a-487c-4f8d-82f5-9958951821ec\") " Jul 17 21:10:01.906990 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:01.906939 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ncfh\" (UniqueName: \"kubernetes.io/projected/ef5acc2a-487c-4f8d-82f5-9958951821ec-kube-api-access-5ncfh\") pod \"ef5acc2a-487c-4f8d-82f5-9958951821ec\" (UID: \"ef5acc2a-487c-4f8d-82f5-9958951821ec\") " Jul 17 21:10:01.907387 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:01.907356 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd522c17-0387-460d-a61a-c988ef4d0496-bundle" (OuterVolumeSpecName: "bundle") pod "bd522c17-0387-460d-a61a-c988ef4d0496" (UID: "bd522c17-0387-460d-a61a-c988ef4d0496"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:10:01.907502 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:01.907407 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef5acc2a-487c-4f8d-82f5-9958951821ec-bundle" (OuterVolumeSpecName: "bundle") pod "ef5acc2a-487c-4f8d-82f5-9958951821ec" (UID: "ef5acc2a-487c-4f8d-82f5-9958951821ec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:10:01.909413 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:01.909390 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef5acc2a-487c-4f8d-82f5-9958951821ec-kube-api-access-5ncfh" (OuterVolumeSpecName: "kube-api-access-5ncfh") pod "ef5acc2a-487c-4f8d-82f5-9958951821ec" (UID: "ef5acc2a-487c-4f8d-82f5-9958951821ec"). InnerVolumeSpecName "kube-api-access-5ncfh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:10:01.909491 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:01.909395 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd522c17-0387-460d-a61a-c988ef4d0496-kube-api-access-xxr7d" (OuterVolumeSpecName: "kube-api-access-xxr7d") pod "bd522c17-0387-460d-a61a-c988ef4d0496" (UID: "bd522c17-0387-460d-a61a-c988ef4d0496"). InnerVolumeSpecName "kube-api-access-xxr7d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:10:01.912908 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:01.912876 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd522c17-0387-460d-a61a-c988ef4d0496-util" (OuterVolumeSpecName: "util") pod "bd522c17-0387-460d-a61a-c988ef4d0496" (UID: "bd522c17-0387-460d-a61a-c988ef4d0496"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:10:01.915174 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:01.915150 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef5acc2a-487c-4f8d-82f5-9958951821ec-util" (OuterVolumeSpecName: "util") pod "ef5acc2a-487c-4f8d-82f5-9958951821ec" (UID: "ef5acc2a-487c-4f8d-82f5-9958951821ec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:10:02.008449 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:02.008430 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef5acc2a-487c-4f8d-82f5-9958951821ec-util\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:10:02.008532 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:02.008450 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ncfh\" (UniqueName: \"kubernetes.io/projected/ef5acc2a-487c-4f8d-82f5-9958951821ec-kube-api-access-5ncfh\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:10:02.008532 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:02.008461 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxr7d\" (UniqueName: \"kubernetes.io/projected/bd522c17-0387-460d-a61a-c988ef4d0496-kube-api-access-xxr7d\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:10:02.008532 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:02.008470 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd522c17-0387-460d-a61a-c988ef4d0496-bundle\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:10:02.008532 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:02.008479 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef5acc2a-487c-4f8d-82f5-9958951821ec-bundle\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:10:02.008532 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:02.008486 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd522c17-0387-460d-a61a-c988ef4d0496-util\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:10:02.661342 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:02.661308 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk" Jul 17 21:10:02.661342 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:02.661320 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk" event={"ID":"bd522c17-0387-460d-a61a-c988ef4d0496","Type":"ContainerDied","Data":"f0c305e351678ac52f9221bb71336325214570ceb6663c91620b738cc5740174"} Jul 17 21:10:02.661808 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:02.661369 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0c305e351678ac52f9221bb71336325214570ceb6663c91620b738cc5740174" Jul 17 21:10:02.663270 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:02.663245 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6" event={"ID":"ef5acc2a-487c-4f8d-82f5-9958951821ec","Type":"ContainerDied","Data":"a2e9caf06d28ad96d9edef0e0671f46bbcacf60f09ec1b8c3a3fd17272e9b433"} Jul 17 21:10:02.663270 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:02.663263 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6" Jul 17 21:10:02.663489 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:10:02.663280 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a2e9caf06d28ad96d9edef0e0671f46bbcacf60f09ec1b8c3a3fd17272e9b433" Jul 17 21:11:16.013649 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.013551 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v"] Jul 17 21:11:16.014156 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.013902 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd522c17-0387-460d-a61a-c988ef4d0496" containerName="pull" Jul 17 21:11:16.014156 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.013915 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd522c17-0387-460d-a61a-c988ef4d0496" containerName="pull" Jul 17 21:11:16.014156 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.013926 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd522c17-0387-460d-a61a-c988ef4d0496" containerName="extract" Jul 17 21:11:16.014156 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.013931 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd522c17-0387-460d-a61a-c988ef4d0496" containerName="extract" Jul 17 21:11:16.014156 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.013940 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef5acc2a-487c-4f8d-82f5-9958951821ec" containerName="extract" Jul 17 21:11:16.014156 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.013946 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef5acc2a-487c-4f8d-82f5-9958951821ec" containerName="extract" Jul 17 21:11:16.014156 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.013955 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a1a358a-046b-4ec2-8fb4-977974c2caa7" containerName="pull" Jul 17 21:11:16.014156 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.013961 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a1a358a-046b-4ec2-8fb4-977974c2caa7" containerName="pull" Jul 17 21:11:16.014156 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.013969 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a1a358a-046b-4ec2-8fb4-977974c2caa7" containerName="extract" Jul 17 21:11:16.014156 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.013977 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a1a358a-046b-4ec2-8fb4-977974c2caa7" containerName="extract" Jul 17 21:11:16.014156 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.013996 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a332ed8-c80f-4e41-94e8-5bfa7169c4b6" containerName="pull" Jul 17 21:11:16.014156 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.014003 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a332ed8-c80f-4e41-94e8-5bfa7169c4b6" containerName="pull" Jul 17 21:11:16.014156 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.014009 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef5acc2a-487c-4f8d-82f5-9958951821ec" containerName="pull" Jul 17 21:11:16.014156 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.014014 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef5acc2a-487c-4f8d-82f5-9958951821ec" containerName="pull" Jul 17 21:11:16.014156 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.014021 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a1a358a-046b-4ec2-8fb4-977974c2caa7" containerName="util" Jul 17 21:11:16.014156 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.014026 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a1a358a-046b-4ec2-8fb4-977974c2caa7" containerName="util" Jul 17 21:11:16.014156 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.014031 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a332ed8-c80f-4e41-94e8-5bfa7169c4b6" containerName="extract" Jul 17 21:11:16.014156 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.014036 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a332ed8-c80f-4e41-94e8-5bfa7169c4b6" containerName="extract" Jul 17 21:11:16.014156 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.014044 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a332ed8-c80f-4e41-94e8-5bfa7169c4b6" containerName="util" Jul 17 21:11:16.014156 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.014052 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a332ed8-c80f-4e41-94e8-5bfa7169c4b6" containerName="util" Jul 17 21:11:16.014156 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.014070 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef5acc2a-487c-4f8d-82f5-9958951821ec" containerName="util" Jul 17 21:11:16.014156 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.014076 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef5acc2a-487c-4f8d-82f5-9958951821ec" containerName="util" Jul 17 21:11:16.014156 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.014082 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd522c17-0387-460d-a61a-c988ef4d0496" containerName="util" Jul 17 21:11:16.014156 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.014086 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd522c17-0387-460d-a61a-c988ef4d0496" containerName="util" Jul 17 21:11:16.014156 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.014143 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef5acc2a-487c-4f8d-82f5-9958951821ec" containerName="extract" Jul 17 21:11:16.014156 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.014156 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a1a358a-046b-4ec2-8fb4-977974c2caa7" containerName="extract" Jul 17 21:11:16.014156 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.014162 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a332ed8-c80f-4e41-94e8-5bfa7169c4b6" containerName="extract" Jul 17 21:11:16.014156 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.014170 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd522c17-0387-460d-a61a-c988ef4d0496" containerName="extract" Jul 17 21:11:16.017362 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.017344 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:16.019777 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.019759 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-w7xn6\"" Jul 17 21:11:16.031719 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.031692 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v"] Jul 17 21:11:16.201520 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.201484 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vpj7v\" (UID: \"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:16.201695 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.201539 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vpj7v\" (UID: \"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:16.201695 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.201608 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vpj7v\" (UID: \"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:16.201695 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.201655 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vpj7v\" (UID: \"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:16.201695 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.201692 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vpj7v\" (UID: \"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:16.201902 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.201710 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vpj7v\" (UID: \"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:16.201902 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.201724 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vpj7v\" (UID: \"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:16.201902 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.201797 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dqm6\" (UniqueName: \"kubernetes.io/projected/ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df-kube-api-access-8dqm6\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vpj7v\" (UID: \"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:16.201902 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.201866 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vpj7v\" (UID: \"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:16.302492 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.302459 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vpj7v\" (UID: \"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:16.302695 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.302512 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vpj7v\" (UID: \"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:16.302695 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.302540 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vpj7v\" (UID: \"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:16.302695 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.302556 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vpj7v\" (UID: \"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:16.302695 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.302594 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dqm6\" (UniqueName: \"kubernetes.io/projected/ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df-kube-api-access-8dqm6\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vpj7v\" (UID: \"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:16.302695 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.302634 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vpj7v\" (UID: \"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:16.302695 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.302678 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vpj7v\" (UID: \"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:16.303019 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.302745 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vpj7v\" (UID: \"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:16.303019 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.302785 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vpj7v\" (UID: \"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:16.303113 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.303049 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vpj7v\" (UID: \"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:16.303168 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.303140 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vpj7v\" (UID: \"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:16.303258 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.303174 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vpj7v\" (UID: \"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:16.303258 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.303249 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vpj7v\" (UID: \"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:16.303470 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.303446 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vpj7v\" (UID: \"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:16.304947 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.304928 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vpj7v\" (UID: \"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:16.305289 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.305268 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vpj7v\" (UID: \"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:16.311137 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.311114 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vpj7v\" (UID: \"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:16.311318 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.311295 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dqm6\" (UniqueName: \"kubernetes.io/projected/ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df-kube-api-access-8dqm6\") pod \"maas-default-gateway-openshift-default-5896d4dd49-vpj7v\" (UID: \"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:16.327052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.327032 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:16.473454 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.473429 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v"] Jul 17 21:11:16.474836 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:11:16.474809 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddb75bb9_5a3e_47e1_b7fe_94cdc060d9df.slice/crio-51e41597236db006a42aac1614b1f94d0b7982be8504c52777e9cd136924314b WatchSource:0}: Error finding container 51e41597236db006a42aac1614b1f94d0b7982be8504c52777e9cd136924314b: Status 404 returned error can't find the container with id 51e41597236db006a42aac1614b1f94d0b7982be8504c52777e9cd136924314b Jul 17 21:11:16.476897 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.476861 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:11:16.476992 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.476927 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:11:16.476992 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:16.476957 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:11:17.050357 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:17.050314 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" event={"ID":"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df","Type":"ContainerStarted","Data":"0f7ba45f20a8edd726ec90436476af5d4ead28f2bad77c241b6af03060df8e1c"} Jul 17 21:11:17.050720 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:17.050373 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" event={"ID":"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df","Type":"ContainerStarted","Data":"51e41597236db006a42aac1614b1f94d0b7982be8504c52777e9cd136924314b"} Jul 17 21:11:17.075239 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:17.075166 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" podStartSLOduration=2.075151636 podStartE2EDuration="2.075151636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:11:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:11:17.072862602 +0000 UTC m=+449.670545243" watchObservedRunningTime="2026-07-17 21:11:17.075151636 +0000 UTC m=+449.672834278" Jul 17 21:11:17.327646 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:17.327578 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:17.332152 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:17.332128 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:18.055409 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:18.055367 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:11:18.056276 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:11:18.056252 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:12:52.540681 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:12:52.540576 2580 generic.go:356] "Generic (PLEG): container finished" podID="ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df" containerID="0f7ba45f20a8edd726ec90436476af5d4ead28f2bad77c241b6af03060df8e1c" exitCode=0 Jul 17 21:12:52.540681 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:12:52.540647 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" event={"ID":"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df","Type":"ContainerDied","Data":"0f7ba45f20a8edd726ec90436476af5d4ead28f2bad77c241b6af03060df8e1c"} Jul 17 21:12:52.541129 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:12:52.541082 2580 scope.go:117] "RemoveContainer" containerID="0f7ba45f20a8edd726ec90436476af5d4ead28f2bad77c241b6af03060df8e1c" Jul 17 21:12:52.542170 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:12:52.542138 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:12:52.542333 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:12:52.542256 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:12:52.542402 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:12:52.542373 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:12:53.549237 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:12:53.549182 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" event={"ID":"ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df","Type":"ContainerStarted","Data":"12395d0ede3e55b7cc7d60349e9927dfe6352812a2c003ec1d1c96059eb5de2c"} Jul 17 21:12:54.327483 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:12:54.327442 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:12:54.327675 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:12:54.327651 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-vpj7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 17 21:12:54.327727 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:12:54.327709 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" podUID="ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 17 21:12:55.328122 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:12:55.328075 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-vpj7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 17 21:12:55.328561 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:12:55.328138 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" podUID="ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 17 21:12:56.328314 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:12:56.328276 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-vpj7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 17 21:12:56.328681 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:12:56.328332 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" podUID="ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 17 21:12:57.327645 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:12:57.327606 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-vpj7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 17 21:12:57.327822 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:12:57.327668 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" podUID="ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 17 21:12:58.331318 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:12:58.331290 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:12:58.331813 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:12:58.331794 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:12:58.332514 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:12:58.332493 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-vpj7v" Jul 17 21:13:32.493971 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:32.493931 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c"] Jul 17 21:13:32.497487 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:32.497468 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c" Jul 17 21:13:32.500620 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:32.500590 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 17 21:13:32.500737 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:32.500675 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 17 21:13:32.500737 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:32.500676 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lhl2r\"" Jul 17 21:13:32.501460 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:32.501441 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 17 21:13:32.507623 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:32.507601 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c"] Jul 17 21:13:32.554745 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:32.554721 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c\" (UID: \"3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c" Jul 17 21:13:32.554844 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:32.554768 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c\" (UID: \"3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c" Jul 17 21:13:32.554844 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:32.554787 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c\" (UID: \"3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c" Jul 17 21:13:32.554940 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:32.554861 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7dxw\" (UniqueName: \"kubernetes.io/projected/3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7-kube-api-access-d7dxw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c\" (UID: \"3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c" Jul 17 21:13:32.554940 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:32.554889 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c\" (UID: \"3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c" Jul 17 21:13:32.554940 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:32.554914 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c\" (UID: \"3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c" Jul 17 21:13:32.655874 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:32.655835 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c\" (UID: \"3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c" Jul 17 21:13:32.656054 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:32.655890 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c\" (UID: \"3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c" Jul 17 21:13:32.656054 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:32.656002 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c\" (UID: \"3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c" Jul 17 21:13:32.656177 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:32.656080 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7dxw\" (UniqueName: \"kubernetes.io/projected/3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7-kube-api-access-d7dxw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c\" (UID: \"3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c" Jul 17 21:13:32.656177 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:32.656118 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c\" (UID: \"3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c" Jul 17 21:13:32.656177 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:32.656163 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c\" (UID: \"3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c" Jul 17 21:13:32.656372 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:32.656229 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c\" (UID: \"3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c" Jul 17 21:13:32.656372 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:32.656281 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c\" (UID: \"3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c" Jul 17 21:13:32.656372 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:32.656327 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c\" (UID: \"3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c" Jul 17 21:13:32.658389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:32.658362 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c\" (UID: \"3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c" Jul 17 21:13:32.658576 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:32.658557 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c\" (UID: \"3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c" Jul 17 21:13:32.665704 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:32.665678 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7dxw\" (UniqueName: \"kubernetes.io/projected/3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7-kube-api-access-d7dxw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c\" (UID: \"3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c" Jul 17 21:13:32.809352 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:32.809315 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c" Jul 17 21:13:32.942359 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:32.942326 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c"] Jul 17 21:13:32.945024 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:13:32.944995 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f6ab25c_f3ae_4e3e_a77b_83cca3b77ae7.slice/crio-2080ef8c6b06c2185e3b2e856b8fce209efd68073f27031da7ecf92d122293a1 WatchSource:0}: Error finding container 2080ef8c6b06c2185e3b2e856b8fce209efd68073f27031da7ecf92d122293a1: Status 404 returned error can't find the container with id 2080ef8c6b06c2185e3b2e856b8fce209efd68073f27031da7ecf92d122293a1 Jul 17 21:13:33.781339 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:33.781299 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c" event={"ID":"3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7","Type":"ContainerStarted","Data":"2080ef8c6b06c2185e3b2e856b8fce209efd68073f27031da7ecf92d122293a1"} Jul 17 21:13:34.789252 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:34.789141 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c" event={"ID":"3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7","Type":"ContainerStarted","Data":"1b6cf7df01f4aedea4d293cf991f7614cfd7afbed00acba79c96842c8bc02dbd"} Jul 17 21:13:34.808005 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:34.807953 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c" podStartSLOduration=1.407143102 podStartE2EDuration="2.807937197s" totalImagesPullingTime="1.400794095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:13:34.806805084 +0000 UTC m=+587.404487730" watchObservedRunningTime="2026-07-17 21:13:34.807937197 +0000 UTC m=+587.405619883" Jul 17 21:13:42.810284 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:42.810241 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c" Jul 17 21:13:42.810712 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:42.810320 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c" Jul 17 21:13:42.822968 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:42.822937 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c" Jul 17 21:13:42.846232 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:42.846203 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c" Jul 17 21:13:47.821351 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:47.821320 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bk9fq_c7148bac-9a70-453b-a952-2a7a5e4a0ea6/console-operator/1.log" Jul 17 21:13:47.821890 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:47.821795 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bk9fq_c7148bac-9a70-453b-a952-2a7a5e4a0ea6/console-operator/1.log" Jul 17 21:13:47.827583 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:47.827561 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lj5lm_6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd/ovn-acl-logging/0.log" Jul 17 21:13:47.827883 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:47.827866 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lj5lm_6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd/ovn-acl-logging/0.log" Jul 17 21:13:50.588151 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:50.588112 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf"] Jul 17 21:13:50.591573 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:50.591555 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf" Jul 17 21:13:50.593953 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:50.593933 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 17 21:13:50.603575 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:50.603549 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf"] Jul 17 21:13:50.708313 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:50.708288 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qldjk\" (UniqueName: \"kubernetes.io/projected/fc119d62-7896-4f95-93e9-79e9dbabab94-kube-api-access-qldjk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4x8qf\" (UID: \"fc119d62-7896-4f95-93e9-79e9dbabab94\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf" Jul 17 21:13:50.708436 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:50.708333 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc119d62-7896-4f95-93e9-79e9dbabab94-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4x8qf\" (UID: \"fc119d62-7896-4f95-93e9-79e9dbabab94\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf" Jul 17 21:13:50.708436 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:50.708364 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc119d62-7896-4f95-93e9-79e9dbabab94-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4x8qf\" (UID: \"fc119d62-7896-4f95-93e9-79e9dbabab94\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf" Jul 17 21:13:50.708436 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:50.708426 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc119d62-7896-4f95-93e9-79e9dbabab94-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4x8qf\" (UID: \"fc119d62-7896-4f95-93e9-79e9dbabab94\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf" Jul 17 21:13:50.708553 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:50.708458 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc119d62-7896-4f95-93e9-79e9dbabab94-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4x8qf\" (UID: \"fc119d62-7896-4f95-93e9-79e9dbabab94\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf" Jul 17 21:13:50.708553 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:50.708489 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc119d62-7896-4f95-93e9-79e9dbabab94-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4x8qf\" (UID: \"fc119d62-7896-4f95-93e9-79e9dbabab94\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf" Jul 17 21:13:50.809677 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:50.809652 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc119d62-7896-4f95-93e9-79e9dbabab94-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4x8qf\" (UID: \"fc119d62-7896-4f95-93e9-79e9dbabab94\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf" Jul 17 21:13:50.809787 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:50.809688 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc119d62-7896-4f95-93e9-79e9dbabab94-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4x8qf\" (UID: \"fc119d62-7896-4f95-93e9-79e9dbabab94\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf" Jul 17 21:13:50.809787 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:50.809711 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc119d62-7896-4f95-93e9-79e9dbabab94-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4x8qf\" (UID: \"fc119d62-7896-4f95-93e9-79e9dbabab94\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf" Jul 17 21:13:50.809787 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:50.809728 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc119d62-7896-4f95-93e9-79e9dbabab94-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4x8qf\" (UID: \"fc119d62-7896-4f95-93e9-79e9dbabab94\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf" Jul 17 21:13:50.809787 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:50.809753 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc119d62-7896-4f95-93e9-79e9dbabab94-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4x8qf\" (UID: \"fc119d62-7896-4f95-93e9-79e9dbabab94\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf" Jul 17 21:13:50.809987 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:50.809812 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qldjk\" (UniqueName: \"kubernetes.io/projected/fc119d62-7896-4f95-93e9-79e9dbabab94-kube-api-access-qldjk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4x8qf\" (UID: \"fc119d62-7896-4f95-93e9-79e9dbabab94\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf" Jul 17 21:13:50.810147 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:50.810122 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc119d62-7896-4f95-93e9-79e9dbabab94-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4x8qf\" (UID: \"fc119d62-7896-4f95-93e9-79e9dbabab94\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf" Jul 17 21:13:50.810307 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:50.810223 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc119d62-7896-4f95-93e9-79e9dbabab94-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4x8qf\" (UID: \"fc119d62-7896-4f95-93e9-79e9dbabab94\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf" Jul 17 21:13:50.810307 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:50.810290 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc119d62-7896-4f95-93e9-79e9dbabab94-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4x8qf\" (UID: \"fc119d62-7896-4f95-93e9-79e9dbabab94\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf" Jul 17 21:13:50.812126 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:50.812091 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc119d62-7896-4f95-93e9-79e9dbabab94-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4x8qf\" (UID: \"fc119d62-7896-4f95-93e9-79e9dbabab94\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf" Jul 17 21:13:50.812286 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:50.812269 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc119d62-7896-4f95-93e9-79e9dbabab94-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4x8qf\" (UID: \"fc119d62-7896-4f95-93e9-79e9dbabab94\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf" Jul 17 21:13:50.817609 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:50.817587 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qldjk\" (UniqueName: \"kubernetes.io/projected/fc119d62-7896-4f95-93e9-79e9dbabab94-kube-api-access-qldjk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4x8qf\" (UID: \"fc119d62-7896-4f95-93e9-79e9dbabab94\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf" Jul 17 21:13:50.901909 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:50.901836 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf" Jul 17 21:13:51.031553 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:51.031524 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf"] Jul 17 21:13:51.033338 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:13:51.033311 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc119d62_7896_4f95_93e9_79e9dbabab94.slice/crio-7537e7e7892c31df3e9454e95d728c6608a36a7e2a880fe154c0c61b4b22e89e WatchSource:0}: Error finding container 7537e7e7892c31df3e9454e95d728c6608a36a7e2a880fe154c0c61b4b22e89e: Status 404 returned error can't find the container with id 7537e7e7892c31df3e9454e95d728c6608a36a7e2a880fe154c0c61b4b22e89e Jul 17 21:13:51.884207 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:51.884142 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf" event={"ID":"fc119d62-7896-4f95-93e9-79e9dbabab94","Type":"ContainerStarted","Data":"8fc273517306186817f6ed60dfcf5e51feaa15a749ea73fc71bec684b6e706c4"} Jul 17 21:13:51.884697 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:51.884224 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf" event={"ID":"fc119d62-7896-4f95-93e9-79e9dbabab94","Type":"ContainerStarted","Data":"7537e7e7892c31df3e9454e95d728c6608a36a7e2a880fe154c0c61b4b22e89e"} Jul 17 21:13:51.906418 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:13:51.906365 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf" podStartSLOduration=1.648955618 podStartE2EDuration="1.906347353s" totalImagesPullingTime="257.391735ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:13:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:13:51.905396566 +0000 UTC m=+604.503079209" watchObservedRunningTime="2026-07-17 21:13:51.906347353 +0000 UTC m=+604.504029996" Jul 17 21:14:00.902396 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:14:00.902363 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf" Jul 17 21:14:00.902893 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:14:00.902434 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf" Jul 17 21:14:00.915135 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:14:00.915110 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf" Jul 17 21:14:00.943018 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:14:00.942996 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4x8qf" Jul 17 21:14:38.299267 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:14:38.299222 2580 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": read tcp 10.133.0.2:38484->10.133.0.30:15021: read: connection reset by peer" start-of-body= Jul 17 21:14:38.299785 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:14:38.299298 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wgvnm" podUID="d553ae0c-64a6-4338-8003-3425c4a1acdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": read tcp 10.133.0.2:38484->10.133.0.30:15021: read: connection reset by peer" Jul 17 21:15:00.152765 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:15:00.152712 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738715-gbhzc"] Jul 17 21:15:00.156528 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:15:00.156504 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738715-gbhzc" Jul 17 21:15:00.159376 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:15:00.159347 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-km5xb\"" Jul 17 21:15:00.168037 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:15:00.167945 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738715-gbhzc"] Jul 17 21:15:00.169954 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:15:00.169879 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738715-gbhzc" Jul 17 21:15:00.328138 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:15:00.328112 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738715-gbhzc"] Jul 17 21:15:00.330517 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:15:00.330486 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1af75215_7a01_4201_8768_45ce84b3d204.slice/crio-d97ddcb1d9def4886e1f6cf6a5fcfc88961480f0f8d5e814bc1b2cdb90df06b1 WatchSource:0}: Error finding container d97ddcb1d9def4886e1f6cf6a5fcfc88961480f0f8d5e814bc1b2cdb90df06b1: Status 404 returned error can't find the container with id d97ddcb1d9def4886e1f6cf6a5fcfc88961480f0f8d5e814bc1b2cdb90df06b1 Jul 17 21:15:00.332558 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:15:00.332540 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 21:15:01.254480 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:15:01.254439 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738715-gbhzc" event={"ID":"1af75215-7a01-4201-8768-45ce84b3d204","Type":"ContainerStarted","Data":"d97ddcb1d9def4886e1f6cf6a5fcfc88961480f0f8d5e814bc1b2cdb90df06b1"} Jul 17 21:15:03.267726 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:15:03.267677 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738715-gbhzc" event={"ID":"1af75215-7a01-4201-8768-45ce84b3d204","Type":"ContainerStarted","Data":"da664a380eefb069706baf74e5c7f2427bc4af2d47bea4304c82c450cd83c093"} Jul 17 21:15:03.286567 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:15:03.286505 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738715-gbhzc" podStartSLOduration=0.828816273 podStartE2EDuration="3.286463636s" totalImagesPullingTime="2.457647363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:15:03.285007306 +0000 UTC m=+675.882689950" watchObservedRunningTime="2026-07-17 21:15:03.286463636 +0000 UTC m=+675.884146310" Jul 17 21:15:04.274964 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:15:04.274925 2580 generic.go:356] "Generic (PLEG): container finished" podID="1af75215-7a01-4201-8768-45ce84b3d204" containerID="da664a380eefb069706baf74e5c7f2427bc4af2d47bea4304c82c450cd83c093" exitCode=0 Jul 17 21:15:04.275371 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:15:04.275006 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738715-gbhzc" event={"ID":"1af75215-7a01-4201-8768-45ce84b3d204","Type":"ContainerDied","Data":"da664a380eefb069706baf74e5c7f2427bc4af2d47bea4304c82c450cd83c093"} Jul 17 21:15:05.419832 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:15:05.419798 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738715-gbhzc" Jul 17 21:15:06.286822 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:15:06.286733 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738715-gbhzc" Jul 17 21:15:06.286822 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:15:06.286758 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738715-gbhzc" event={"ID":"1af75215-7a01-4201-8768-45ce84b3d204","Type":"ContainerDied","Data":"d97ddcb1d9def4886e1f6cf6a5fcfc88961480f0f8d5e814bc1b2cdb90df06b1"} Jul 17 21:15:06.286822 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:15:06.286815 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d97ddcb1d9def4886e1f6cf6a5fcfc88961480f0f8d5e814bc1b2cdb90df06b1" Jul 17 21:18:47.868440 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:18:47.868361 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bk9fq_c7148bac-9a70-453b-a952-2a7a5e4a0ea6/console-operator/1.log" Jul 17 21:18:47.872160 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:18:47.872135 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bk9fq_c7148bac-9a70-453b-a952-2a7a5e4a0ea6/console-operator/1.log" Jul 17 21:18:47.874912 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:18:47.874889 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lj5lm_6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd/ovn-acl-logging/0.log" Jul 17 21:18:47.877934 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:18:47.877914 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lj5lm_6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd/ovn-acl-logging/0.log" Jul 17 21:23:47.906128 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:23:47.906094 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bk9fq_c7148bac-9a70-453b-a952-2a7a5e4a0ea6/console-operator/1.log" Jul 17 21:23:47.911135 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:23:47.911108 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bk9fq_c7148bac-9a70-453b-a952-2a7a5e4a0ea6/console-operator/1.log" Jul 17 21:23:47.912442 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:23:47.912416 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lj5lm_6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd/ovn-acl-logging/0.log" Jul 17 21:23:47.917816 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:23:47.917789 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lj5lm_6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd/ovn-acl-logging/0.log" Jul 17 21:28:47.946619 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:28:47.946482 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bk9fq_c7148bac-9a70-453b-a952-2a7a5e4a0ea6/console-operator/1.log" Jul 17 21:28:47.954298 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:28:47.954261 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bk9fq_c7148bac-9a70-453b-a952-2a7a5e4a0ea6/console-operator/1.log" Jul 17 21:28:47.955076 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:28:47.955009 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lj5lm_6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd/ovn-acl-logging/0.log" Jul 17 21:28:47.962312 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:28:47.962281 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lj5lm_6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd/ovn-acl-logging/0.log" Jul 17 21:30:00.140879 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:00.140841 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738730-tttwx"] Jul 17 21:30:00.141447 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:00.141235 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1af75215-7a01-4201-8768-45ce84b3d204" containerName="cleanup" Jul 17 21:30:00.141447 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:00.141247 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1af75215-7a01-4201-8768-45ce84b3d204" containerName="cleanup" Jul 17 21:30:00.141447 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:00.141319 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1af75215-7a01-4201-8768-45ce84b3d204" containerName="cleanup" Jul 17 21:30:00.144570 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:00.144546 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738730-tttwx" Jul 17 21:30:00.146915 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:00.146892 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-km5xb\"" Jul 17 21:30:00.154533 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:00.154511 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738730-tttwx" Jul 17 21:30:00.160841 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:00.160805 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738730-tttwx"] Jul 17 21:30:00.313777 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:00.309320 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738730-tttwx"] Jul 17 21:30:00.315374 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:30:00.315340 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod721dea68_316f_4d26_8b4c_40e85a38f7ea.slice/crio-8d4e49bf8b175d109e1f8c99f95916c8027c8d9706a03935a0098183370001f1 WatchSource:0}: Error finding container 8d4e49bf8b175d109e1f8c99f95916c8027c8d9706a03935a0098183370001f1: Status 404 returned error can't find the container with id 8d4e49bf8b175d109e1f8c99f95916c8027c8d9706a03935a0098183370001f1 Jul 17 21:30:01.209469 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:01.209430 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738730-tttwx" event={"ID":"721dea68-316f-4d26-8b4c-40e85a38f7ea","Type":"ContainerStarted","Data":"a4b76aeb0b4ff437609dd6dbe6927f13029d50853261f28578ef7ffd8590fdd7"} Jul 17 21:30:01.209951 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:01.209493 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738730-tttwx" event={"ID":"721dea68-316f-4d26-8b4c-40e85a38f7ea","Type":"ContainerStarted","Data":"8d4e49bf8b175d109e1f8c99f95916c8027c8d9706a03935a0098183370001f1"} Jul 17 21:30:01.224982 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:01.224914 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738730-tttwx" podStartSLOduration=1.224896948 podStartE2EDuration="1.224896948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:30:01.223383874 +0000 UTC m=+1573.821066520" watchObservedRunningTime="2026-07-17 21:30:01.224896948 +0000 UTC m=+1573.822579590" Jul 17 21:30:01.833226 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:01.833172 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r"] Jul 17 21:30:01.836841 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:01.836816 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:01.839356 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:01.839331 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-98ea8db6-openshift-default-dockercfg-pmhqk\"" Jul 17 21:30:01.847201 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:01.847162 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r"] Jul 17 21:30:01.910940 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:01.910895 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-workload-socket\") pod \"e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:01.911134 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:01.910946 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-workload-certs\") pod \"e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:01.911134 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:01.910987 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istio-data\") pod \"e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:01.911134 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:01.911021 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istiod-ca-cert\") pod \"e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:01.911134 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:01.911062 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istio-envoy\") pod \"e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:01.911134 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:01.911090 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istio-podinfo\") pod \"e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:01.911134 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:01.911114 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-credential-socket\") pod \"e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:01.911379 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:01.911154 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p28kd\" (UniqueName: \"kubernetes.io/projected/1d88d4c6-eba4-4f0a-b75b-64993fd43118-kube-api-access-p28kd\") pod \"e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:01.911379 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:01.911174 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istio-token\") pod \"e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:02.011831 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:02.011790 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-workload-socket\") pod \"e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:02.012027 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:02.011846 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-workload-certs\") pod \"e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:02.012027 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:02.011951 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istio-data\") pod \"e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:02.012027 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:02.012003 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istiod-ca-cert\") pod \"e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:02.012216 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:02.012060 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istio-envoy\") pod \"e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:02.012216 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:02.012103 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istio-podinfo\") pod \"e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:02.012216 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:02.012130 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-credential-socket\") pod \"e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:02.012216 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:02.012206 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p28kd\" (UniqueName: \"kubernetes.io/projected/1d88d4c6-eba4-4f0a-b75b-64993fd43118-kube-api-access-p28kd\") pod \"e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:02.012421 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:02.012243 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istio-token\") pod \"e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:02.012421 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:02.012246 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-workload-certs\") pod \"e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:02.012421 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:02.012271 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-workload-socket\") pod \"e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:02.012564 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:02.012420 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istio-data\") pod \"e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:02.012630 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:02.012602 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-credential-socket\") pod \"e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:02.012818 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:02.012799 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istiod-ca-cert\") pod \"e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:02.014501 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:02.014471 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istio-envoy\") pod \"e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:02.014638 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:02.014615 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istio-podinfo\") pod \"e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:02.023839 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:02.023807 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istio-token\") pod \"e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:02.023938 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:02.023925 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p28kd\" (UniqueName: \"kubernetes.io/projected/1d88d4c6-eba4-4f0a-b75b-64993fd43118-kube-api-access-p28kd\") pod \"e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:02.149541 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:02.149444 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:02.220426 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:02.220388 2580 generic.go:356] "Generic (PLEG): container finished" podID="721dea68-316f-4d26-8b4c-40e85a38f7ea" containerID="a4b76aeb0b4ff437609dd6dbe6927f13029d50853261f28578ef7ffd8590fdd7" exitCode=0 Jul 17 21:30:02.220821 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:02.220477 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738730-tttwx" event={"ID":"721dea68-316f-4d26-8b4c-40e85a38f7ea","Type":"ContainerDied","Data":"a4b76aeb0b4ff437609dd6dbe6927f13029d50853261f28578ef7ffd8590fdd7"} Jul 17 21:30:02.300412 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:02.300384 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r"] Jul 17 21:30:02.302686 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:30:02.302657 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d88d4c6_eba4_4f0a_b75b_64993fd43118.slice/crio-c53c00dadb9049ca73061638528326ea221943b65a19b81338e7119d6c4c6f14 WatchSource:0}: Error finding container c53c00dadb9049ca73061638528326ea221943b65a19b81338e7119d6c4c6f14: Status 404 returned error can't find the container with id c53c00dadb9049ca73061638528326ea221943b65a19b81338e7119d6c4c6f14 Jul 17 21:30:02.305174 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:02.305129 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:30:02.305271 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:02.305251 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:30:02.305321 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:02.305302 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:30:03.228123 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:03.228079 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" event={"ID":"1d88d4c6-eba4-4f0a-b75b-64993fd43118","Type":"ContainerStarted","Data":"c1b55d257b6be3330154943f8f605c5f2f561bfb6f312115eca1473a69c740ab"} Jul 17 21:30:03.228573 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:03.228140 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" event={"ID":"1d88d4c6-eba4-4f0a-b75b-64993fd43118","Type":"ContainerStarted","Data":"c53c00dadb9049ca73061638528326ea221943b65a19b81338e7119d6c4c6f14"} Jul 17 21:30:03.260026 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:03.259967 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" podStartSLOduration=2.259947836 podStartE2EDuration="2.259947836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:30:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:30:03.256275591 +0000 UTC m=+1575.853958235" watchObservedRunningTime="2026-07-17 21:30:03.259947836 +0000 UTC m=+1575.857630478" Jul 17 21:30:03.365979 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:03.365947 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738730-tttwx" Jul 17 21:30:04.150295 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:04.150169 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:04.155282 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:04.155254 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:04.235129 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:04.235095 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738730-tttwx" Jul 17 21:30:04.235129 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:04.235114 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738730-tttwx" event={"ID":"721dea68-316f-4d26-8b4c-40e85a38f7ea","Type":"ContainerDied","Data":"8d4e49bf8b175d109e1f8c99f95916c8027c8d9706a03935a0098183370001f1"} Jul 17 21:30:04.235658 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:04.235167 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d4e49bf8b175d109e1f8c99f95916c8027c8d9706a03935a0098183370001f1" Jul 17 21:30:04.235658 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:04.235500 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:04.236599 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:04.236572 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:19.720731 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:19.719751 2580 patch_prober.go:28] interesting pod/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": read tcp 10.133.0.2:45666->10.133.0.41:15021: read: connection reset by peer" start-of-body= Jul 17 21:30:19.720731 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:19.719831 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" podUID="1d88d4c6-eba4-4f0a-b75b-64993fd43118" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": read tcp 10.133.0.2:45666->10.133.0.41:15021: read: connection reset by peer" Jul 17 21:30:20.326067 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:20.326028 2580 generic.go:356] "Generic (PLEG): container finished" podID="1d88d4c6-eba4-4f0a-b75b-64993fd43118" containerID="c1b55d257b6be3330154943f8f605c5f2f561bfb6f312115eca1473a69c740ab" exitCode=0 Jul 17 21:30:20.326394 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:20.326102 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" event={"ID":"1d88d4c6-eba4-4f0a-b75b-64993fd43118","Type":"ContainerDied","Data":"c1b55d257b6be3330154943f8f605c5f2f561bfb6f312115eca1473a69c740ab"} Jul 17 21:30:20.326531 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:20.326517 2580 scope.go:117] "RemoveContainer" containerID="c1b55d257b6be3330154943f8f605c5f2f561bfb6f312115eca1473a69c740ab" Jul 17 21:30:20.327554 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:20.327516 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:30:20.327607 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:20.327595 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:30:20.327644 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:20.327628 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:30:21.332860 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:21.332825 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" event={"ID":"1d88d4c6-eba4-4f0a-b75b-64993fd43118","Type":"ContainerStarted","Data":"0de7d5be8d4035d6b45d059ad9b4e4d548e118cf7255ca233f514d0856a43717"} Jul 17 21:30:22.149970 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:22.149929 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:22.150274 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:22.150237 2580 patch_prober.go:28] interesting pod/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 17 21:30:22.150419 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:22.150312 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" podUID="1d88d4c6-eba4-4f0a-b75b-64993fd43118" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 17 21:30:23.150258 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:23.150212 2580 patch_prober.go:28] interesting pod/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 17 21:30:23.150791 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:23.150294 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" podUID="1d88d4c6-eba4-4f0a-b75b-64993fd43118" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 17 21:30:24.150498 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:24.150452 2580 patch_prober.go:28] interesting pod/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 17 21:30:24.151016 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:24.150540 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" podUID="1d88d4c6-eba4-4f0a-b75b-64993fd43118" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 17 21:30:25.153314 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:25.153280 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:25.153806 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:25.153556 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:25.154161 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:25.154144 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:45.337150 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:45.337066 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r"] Jul 17 21:30:45.337671 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:45.337357 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" podUID="1d88d4c6-eba4-4f0a-b75b-64993fd43118" containerName="istio-proxy" containerID="cri-o://0de7d5be8d4035d6b45d059ad9b4e4d548e118cf7255ca233f514d0856a43717" gracePeriod=30 Jul 17 21:30:46.402019 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.401985 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9"] Jul 17 21:30:46.402427 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.402397 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="721dea68-316f-4d26-8b4c-40e85a38f7ea" containerName="cleanup" Jul 17 21:30:46.402427 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.402410 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="721dea68-316f-4d26-8b4c-40e85a38f7ea" containerName="cleanup" Jul 17 21:30:46.402507 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.402478 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="721dea68-316f-4d26-8b4c-40e85a38f7ea" containerName="cleanup" Jul 17 21:30:46.405636 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.405619 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:46.409055 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.409035 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-8795fd2a-gw-openshift-default-dockercfg-5gvn5\"" Jul 17 21:30:46.424977 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.424949 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9"] Jul 17 21:30:46.541766 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.541728 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-workload-socket\") pod \"e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:46.541924 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.541788 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af60d411-3b49-45b7-b229-d65713b1cd11-istiod-ca-cert\") pod \"e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:46.541924 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.541824 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z44sd\" (UniqueName: \"kubernetes.io/projected/af60d411-3b49-45b7-b229-d65713b1cd11-kube-api-access-z44sd\") pod \"e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:46.541924 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.541846 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af60d411-3b49-45b7-b229-d65713b1cd11-istio-podinfo\") pod \"e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:46.541924 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.541886 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af60d411-3b49-45b7-b229-d65713b1cd11-istio-token\") pod \"e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:46.541924 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.541914 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-istio-data\") pod \"e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:46.542138 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.541986 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-credential-socket\") pod \"e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:46.542138 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.542027 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-istio-envoy\") pod \"e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:46.542138 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.542062 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-workload-certs\") pod \"e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:46.643080 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.643049 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-credential-socket\") pod \"e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:46.643080 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.643081 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-istio-envoy\") pod \"e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:46.643290 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.643110 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-workload-certs\") pod \"e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:46.643290 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.643140 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-workload-socket\") pod \"e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:46.643290 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.643171 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af60d411-3b49-45b7-b229-d65713b1cd11-istiod-ca-cert\") pod \"e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:46.643290 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.643223 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z44sd\" (UniqueName: \"kubernetes.io/projected/af60d411-3b49-45b7-b229-d65713b1cd11-kube-api-access-z44sd\") pod \"e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:46.643290 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.643256 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af60d411-3b49-45b7-b229-d65713b1cd11-istio-podinfo\") pod \"e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:46.643290 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.643288 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af60d411-3b49-45b7-b229-d65713b1cd11-istio-token\") pod \"e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:46.643604 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.643330 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-istio-data\") pod \"e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:46.643604 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.643578 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-credential-socket\") pod \"e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:46.643721 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.643638 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-workload-socket\") pod \"e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:46.643721 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.643706 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-istio-data\") pod \"e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:46.643721 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.643705 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-workload-certs\") pod \"e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:46.643960 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.643938 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af60d411-3b49-45b7-b229-d65713b1cd11-istiod-ca-cert\") pod \"e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:46.645430 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.645409 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-istio-envoy\") pod \"e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:46.645967 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.645940 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af60d411-3b49-45b7-b229-d65713b1cd11-istio-podinfo\") pod \"e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:46.651609 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.651584 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af60d411-3b49-45b7-b229-d65713b1cd11-istio-token\") pod \"e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:46.651725 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.651711 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z44sd\" (UniqueName: \"kubernetes.io/projected/af60d411-3b49-45b7-b229-d65713b1cd11-kube-api-access-z44sd\") pod \"e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:46.715279 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.715219 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:46.856063 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.856032 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9"] Jul 17 21:30:46.857586 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:30:46.857558 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf60d411_3b49_45b7_b229_d65713b1cd11.slice/crio-5ee74be41de014a361f0be27712437b9bd2fe6eb72bb83ee9485d4dbdc61b824 WatchSource:0}: Error finding container 5ee74be41de014a361f0be27712437b9bd2fe6eb72bb83ee9485d4dbdc61b824: Status 404 returned error can't find the container with id 5ee74be41de014a361f0be27712437b9bd2fe6eb72bb83ee9485d4dbdc61b824 Jul 17 21:30:46.859801 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.859766 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:30:46.859893 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.859828 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:30:46.859893 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:46.859857 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:30:47.483435 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:47.483393 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" event={"ID":"af60d411-3b49-45b7-b229-d65713b1cd11","Type":"ContainerStarted","Data":"29d94251753d96ee88692adb8c71a95b9e3717435fb44284ee022c4cc4f60188"} Jul 17 21:30:47.483867 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:47.483452 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" event={"ID":"af60d411-3b49-45b7-b229-d65713b1cd11","Type":"ContainerStarted","Data":"5ee74be41de014a361f0be27712437b9bd2fe6eb72bb83ee9485d4dbdc61b824"} Jul 17 21:30:47.505636 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:47.505577 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" podStartSLOduration=1.505561581 podStartE2EDuration="1.505561581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:30:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:30:47.503981463 +0000 UTC m=+1620.101664132" watchObservedRunningTime="2026-07-17 21:30:47.505561581 +0000 UTC m=+1620.103244224" Jul 17 21:30:47.715895 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:47.715857 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:47.720655 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:47.720630 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:48.488850 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:48.488809 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:48.489791 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:48.489767 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:30:50.502575 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.502511 2580 generic.go:356] "Generic (PLEG): container finished" podID="1d88d4c6-eba4-4f0a-b75b-64993fd43118" containerID="0de7d5be8d4035d6b45d059ad9b4e4d548e118cf7255ca233f514d0856a43717" exitCode=0 Jul 17 21:30:50.502915 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.502587 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" event={"ID":"1d88d4c6-eba4-4f0a-b75b-64993fd43118","Type":"ContainerDied","Data":"0de7d5be8d4035d6b45d059ad9b4e4d548e118cf7255ca233f514d0856a43717"} Jul 17 21:30:50.502915 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.502665 2580 scope.go:117] "RemoveContainer" containerID="c1b55d257b6be3330154943f8f605c5f2f561bfb6f312115eca1473a69c740ab" Jul 17 21:30:50.580918 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.580888 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:50.685034 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.684958 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istio-token\") pod \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " Jul 17 21:30:50.685034 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.685004 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-workload-socket\") pod \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " Jul 17 21:30:50.685279 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.685036 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-workload-certs\") pod \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " Jul 17 21:30:50.685279 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.685055 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istiod-ca-cert\") pod \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " Jul 17 21:30:50.685279 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.685078 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-credential-socket\") pod \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " Jul 17 21:30:50.685279 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.685099 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istio-podinfo\") pod \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " Jul 17 21:30:50.685279 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.685117 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istio-data\") pod \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " Jul 17 21:30:50.685279 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.685142 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p28kd\" (UniqueName: \"kubernetes.io/projected/1d88d4c6-eba4-4f0a-b75b-64993fd43118-kube-api-access-p28kd\") pod \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " Jul 17 21:30:50.685279 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.685172 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istio-envoy\") pod \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\" (UID: \"1d88d4c6-eba4-4f0a-b75b-64993fd43118\") " Jul 17 21:30:50.685675 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.685378 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1d88d4c6-eba4-4f0a-b75b-64993fd43118" (UID: "1d88d4c6-eba4-4f0a-b75b-64993fd43118"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:30:50.685675 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.685416 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1d88d4c6-eba4-4f0a-b75b-64993fd43118" (UID: "1d88d4c6-eba4-4f0a-b75b-64993fd43118"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:30:50.685675 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.685425 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1d88d4c6-eba4-4f0a-b75b-64993fd43118" (UID: "1d88d4c6-eba4-4f0a-b75b-64993fd43118"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:30:50.685675 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.685621 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1d88d4c6-eba4-4f0a-b75b-64993fd43118" (UID: "1d88d4c6-eba4-4f0a-b75b-64993fd43118"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:30:50.685890 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.685863 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-workload-socket\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:30:50.685948 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.685889 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-workload-certs\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:30:50.685948 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.685904 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istiod-ca-cert\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:30:50.685948 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.685920 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-credential-socket\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:30:50.686073 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.686010 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istio-data" (OuterVolumeSpecName: "istio-data") pod "1d88d4c6-eba4-4f0a-b75b-64993fd43118" (UID: "1d88d4c6-eba4-4f0a-b75b-64993fd43118"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:30:50.687589 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.687560 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1d88d4c6-eba4-4f0a-b75b-64993fd43118" (UID: "1d88d4c6-eba4-4f0a-b75b-64993fd43118"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:30:50.687675 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.687663 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istio-token" (OuterVolumeSpecName: "istio-token") pod "1d88d4c6-eba4-4f0a-b75b-64993fd43118" (UID: "1d88d4c6-eba4-4f0a-b75b-64993fd43118"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:30:50.687882 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.687849 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1d88d4c6-eba4-4f0a-b75b-64993fd43118" (UID: "1d88d4c6-eba4-4f0a-b75b-64993fd43118"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 21:30:50.687974 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.687852 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d88d4c6-eba4-4f0a-b75b-64993fd43118-kube-api-access-p28kd" (OuterVolumeSpecName: "kube-api-access-p28kd") pod "1d88d4c6-eba4-4f0a-b75b-64993fd43118" (UID: "1d88d4c6-eba4-4f0a-b75b-64993fd43118"). InnerVolumeSpecName "kube-api-access-p28kd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:30:50.787261 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.787229 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istio-podinfo\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:30:50.787261 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.787252 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istio-data\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:30:50.787261 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.787262 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p28kd\" (UniqueName: \"kubernetes.io/projected/1d88d4c6-eba4-4f0a-b75b-64993fd43118-kube-api-access-p28kd\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:30:50.787470 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.787271 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istio-envoy\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:30:50.787470 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:50.787279 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d88d4c6-eba4-4f0a-b75b-64993fd43118-istio-token\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:30:51.509526 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:51.509495 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" Jul 17 21:30:51.510036 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:51.509533 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r" event={"ID":"1d88d4c6-eba4-4f0a-b75b-64993fd43118","Type":"ContainerDied","Data":"c53c00dadb9049ca73061638528326ea221943b65a19b81338e7119d6c4c6f14"} Jul 17 21:30:51.510036 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:51.509588 2580 scope.go:117] "RemoveContainer" containerID="0de7d5be8d4035d6b45d059ad9b4e4d548e118cf7255ca233f514d0856a43717" Jul 17 21:30:51.532438 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:51.532405 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r"] Jul 17 21:30:51.536035 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:51.536010 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-98ea8db6-openshift-default-6fc5564c65-6mp2r"] Jul 17 21:30:51.860292 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:30:51.860253 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d88d4c6-eba4-4f0a-b75b-64993fd43118" path="/var/lib/kubelet/pods/1d88d4c6-eba4-4f0a-b75b-64993fd43118/volumes" Jul 17 21:31:03.490890 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:03.490795 2580 patch_prober.go:28] interesting pod/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 17 21:31:03.490890 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:03.490865 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" podUID="af60d411-3b49-45b7-b229-d65713b1cd11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 17 21:31:03.585202 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:03.585155 2580 generic.go:356] "Generic (PLEG): container finished" podID="af60d411-3b49-45b7-b229-d65713b1cd11" containerID="29d94251753d96ee88692adb8c71a95b9e3717435fb44284ee022c4cc4f60188" exitCode=0 Jul 17 21:31:03.585361 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:03.585231 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" event={"ID":"af60d411-3b49-45b7-b229-d65713b1cd11","Type":"ContainerDied","Data":"29d94251753d96ee88692adb8c71a95b9e3717435fb44284ee022c4cc4f60188"} Jul 17 21:31:03.585664 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:03.585650 2580 scope.go:117] "RemoveContainer" containerID="29d94251753d96ee88692adb8c71a95b9e3717435fb44284ee022c4cc4f60188" Jul 17 21:31:03.586689 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:03.586658 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:31:03.586813 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:03.586748 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:31:03.586813 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:03.586802 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:31:04.592251 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:04.592213 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" event={"ID":"af60d411-3b49-45b7-b229-d65713b1cd11","Type":"ContainerStarted","Data":"54a78abd60b31e2d34a4d43837545d8e9af4cf6716c0fb686decced35e88eddf"} Jul 17 21:31:04.715503 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:04.715471 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:31:04.715697 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:04.715673 2580 patch_prober.go:28] interesting pod/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 17 21:31:04.715747 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:04.715726 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" podUID="af60d411-3b49-45b7-b229-d65713b1cd11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 17 21:31:05.715916 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:05.715878 2580 patch_prober.go:28] interesting pod/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 17 21:31:05.716341 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:05.715932 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" podUID="af60d411-3b49-45b7-b229-d65713b1cd11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 17 21:31:06.715694 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:06.715657 2580 patch_prober.go:28] interesting pod/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 17 21:31:06.715904 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:06.715732 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" podUID="af60d411-3b49-45b7-b229-d65713b1cd11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 17 21:31:07.716182 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:07.716143 2580 patch_prober.go:28] interesting pod/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 17 21:31:07.716620 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:07.716216 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" podUID="af60d411-3b49-45b7-b229-d65713b1cd11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 17 21:31:08.716409 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:08.716362 2580 patch_prober.go:28] interesting pod/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 17 21:31:08.716817 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:08.716427 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" podUID="af60d411-3b49-45b7-b229-d65713b1cd11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 17 21:31:09.720556 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:09.720521 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:31:09.721039 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:09.720911 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:31:09.721587 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:09.721564 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:31:29.172774 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:29.172738 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9"] Jul 17 21:31:29.173319 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:29.172947 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" podUID="af60d411-3b49-45b7-b229-d65713b1cd11" containerName="istio-proxy" containerID="cri-o://54a78abd60b31e2d34a4d43837545d8e9af4cf6716c0fb686decced35e88eddf" gracePeriod=30 Jul 17 21:31:29.959655 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:29.959609 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm"] Jul 17 21:31:29.960014 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:29.959999 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d88d4c6-eba4-4f0a-b75b-64993fd43118" containerName="istio-proxy" Jul 17 21:31:29.960065 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:29.960016 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d88d4c6-eba4-4f0a-b75b-64993fd43118" containerName="istio-proxy" Jul 17 21:31:29.960065 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:29.960026 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d88d4c6-eba4-4f0a-b75b-64993fd43118" containerName="istio-proxy" Jul 17 21:31:29.960065 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:29.960033 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d88d4c6-eba4-4f0a-b75b-64993fd43118" containerName="istio-proxy" Jul 17 21:31:29.960158 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:29.960116 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d88d4c6-eba4-4f0a-b75b-64993fd43118" containerName="istio-proxy" Jul 17 21:31:29.963333 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:29.963312 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:29.965912 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:29.965892 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-3ed68410-openshift-default-dockercfg-2hr7z\"" Jul 17 21:31:29.975727 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:29.975704 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm"] Jul 17 21:31:30.063181 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.063147 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-workload-certs\") pod \"e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:30.063181 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.063198 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istio-envoy\") pod \"e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:30.063414 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.063304 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istio-data\") pod \"e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:30.063414 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.063342 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istio-podinfo\") pod \"e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:30.063498 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.063423 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istio-token\") pod \"e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:30.063498 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.063448 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istiod-ca-cert\") pod \"e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:30.063498 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.063476 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqmpb\" (UniqueName: \"kubernetes.io/projected/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-kube-api-access-sqmpb\") pod \"e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:30.063664 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.063566 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-credential-socket\") pod \"e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:30.063664 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.063652 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-workload-socket\") pod \"e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:30.164566 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.164532 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istio-data\") pod \"e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:30.164566 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.164567 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istio-podinfo\") pod \"e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:30.164790 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.164602 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istio-token\") pod \"e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:30.164790 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.164624 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istiod-ca-cert\") pod \"e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:30.164790 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.164651 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqmpb\" (UniqueName: \"kubernetes.io/projected/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-kube-api-access-sqmpb\") pod \"e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:30.164790 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.164669 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-credential-socket\") pod \"e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:30.164790 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.164705 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-workload-socket\") pod \"e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:30.164790 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.164741 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-workload-certs\") pod \"e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:30.164790 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.164767 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istio-envoy\") pod \"e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:30.165151 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.165131 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-credential-socket\") pod \"e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:30.165246 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.165156 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-workload-socket\") pod \"e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:30.165312 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.165278 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-workload-certs\") pod \"e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:30.165370 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.165331 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istio-data\") pod \"e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:30.165665 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.165643 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istiod-ca-cert\") pod \"e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:30.167114 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.167091 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istio-envoy\") pod \"e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:30.167234 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.167212 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istio-podinfo\") pod \"e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:30.172106 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.172083 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istio-token\") pod \"e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:30.172340 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.172321 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqmpb\" (UniqueName: \"kubernetes.io/projected/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-kube-api-access-sqmpb\") pod \"e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:30.274440 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.274373 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:30.409205 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.409157 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm"] Jul 17 21:31:30.410390 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:31:30.410366 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3a4ed96_8f0c_4e3d_9dea_90ada6a678c2.slice/crio-d269ec16c3a765477ab3e2d6b1cbf9699e1e65845e25167573e329bb988aadbd WatchSource:0}: Error finding container d269ec16c3a765477ab3e2d6b1cbf9699e1e65845e25167573e329bb988aadbd: Status 404 returned error can't find the container with id d269ec16c3a765477ab3e2d6b1cbf9699e1e65845e25167573e329bb988aadbd Jul 17 21:31:30.412659 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.412610 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:31:30.412742 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.412713 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:31:30.412782 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.412757 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:31:30.753542 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.753501 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" event={"ID":"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2","Type":"ContainerStarted","Data":"b520238ed520fe3d4cebb22956942d9555c7842f8d6ac6b1e001f3e872afc846"} Jul 17 21:31:30.753738 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.753557 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" event={"ID":"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2","Type":"ContainerStarted","Data":"d269ec16c3a765477ab3e2d6b1cbf9699e1e65845e25167573e329bb988aadbd"} Jul 17 21:31:30.774624 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:30.774584 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" podStartSLOduration=1.774569905 podStartE2EDuration="1.774569905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:31:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:31:30.772952355 +0000 UTC m=+1663.370634997" watchObservedRunningTime="2026-07-17 21:31:30.774569905 +0000 UTC m=+1663.372252547" Jul 17 21:31:31.275199 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:31.275164 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:31.280081 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:31.280057 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:31.758989 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:31.758949 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:31.760055 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:31.760031 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:34.421252 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.421228 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:31:34.509282 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.509209 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-istio-data\") pod \"af60d411-3b49-45b7-b229-d65713b1cd11\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " Jul 17 21:31:34.509282 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.509247 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af60d411-3b49-45b7-b229-d65713b1cd11-istiod-ca-cert\") pod \"af60d411-3b49-45b7-b229-d65713b1cd11\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " Jul 17 21:31:34.509282 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.509267 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-istio-envoy\") pod \"af60d411-3b49-45b7-b229-d65713b1cd11\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " Jul 17 21:31:34.509540 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.509456 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z44sd\" (UniqueName: \"kubernetes.io/projected/af60d411-3b49-45b7-b229-d65713b1cd11-kube-api-access-z44sd\") pod \"af60d411-3b49-45b7-b229-d65713b1cd11\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " Jul 17 21:31:34.509540 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.509525 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-workload-certs\") pod \"af60d411-3b49-45b7-b229-d65713b1cd11\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " Jul 17 21:31:34.509647 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.509609 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af60d411-3b49-45b7-b229-d65713b1cd11-istio-podinfo\") pod \"af60d411-3b49-45b7-b229-d65713b1cd11\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " Jul 17 21:31:34.509699 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.509657 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af60d411-3b49-45b7-b229-d65713b1cd11-istio-token\") pod \"af60d411-3b49-45b7-b229-d65713b1cd11\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " Jul 17 21:31:34.509699 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.509670 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af60d411-3b49-45b7-b229-d65713b1cd11-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "af60d411-3b49-45b7-b229-d65713b1cd11" (UID: "af60d411-3b49-45b7-b229-d65713b1cd11"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:31:34.509699 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.509685 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-credential-socket\") pod \"af60d411-3b49-45b7-b229-d65713b1cd11\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " Jul 17 21:31:34.509866 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.509835 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "af60d411-3b49-45b7-b229-d65713b1cd11" (UID: "af60d411-3b49-45b7-b229-d65713b1cd11"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:31:34.510015 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.509918 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-workload-socket\") pod \"af60d411-3b49-45b7-b229-d65713b1cd11\" (UID: \"af60d411-3b49-45b7-b229-d65713b1cd11\") " Jul 17 21:31:34.510015 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.509918 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "af60d411-3b49-45b7-b229-d65713b1cd11" (UID: "af60d411-3b49-45b7-b229-d65713b1cd11"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:31:34.510225 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.510093 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "af60d411-3b49-45b7-b229-d65713b1cd11" (UID: "af60d411-3b49-45b7-b229-d65713b1cd11"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:31:34.510290 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.510263 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-istio-data" (OuterVolumeSpecName: "istio-data") pod "af60d411-3b49-45b7-b229-d65713b1cd11" (UID: "af60d411-3b49-45b7-b229-d65713b1cd11"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:31:34.510350 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.510298 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-workload-certs\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:31:34.510350 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.510319 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-credential-socket\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:31:34.510350 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.510333 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-workload-socket\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:31:34.510350 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.510347 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af60d411-3b49-45b7-b229-d65713b1cd11-istiod-ca-cert\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:31:34.511653 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.511627 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af60d411-3b49-45b7-b229-d65713b1cd11-kube-api-access-z44sd" (OuterVolumeSpecName: "kube-api-access-z44sd") pod "af60d411-3b49-45b7-b229-d65713b1cd11" (UID: "af60d411-3b49-45b7-b229-d65713b1cd11"). InnerVolumeSpecName "kube-api-access-z44sd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:31:34.511750 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.511651 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/af60d411-3b49-45b7-b229-d65713b1cd11-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "af60d411-3b49-45b7-b229-d65713b1cd11" (UID: "af60d411-3b49-45b7-b229-d65713b1cd11"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 21:31:34.511837 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.511820 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "af60d411-3b49-45b7-b229-d65713b1cd11" (UID: "af60d411-3b49-45b7-b229-d65713b1cd11"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:31:34.511939 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.511925 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af60d411-3b49-45b7-b229-d65713b1cd11-istio-token" (OuterVolumeSpecName: "istio-token") pod "af60d411-3b49-45b7-b229-d65713b1cd11" (UID: "af60d411-3b49-45b7-b229-d65713b1cd11"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:31:34.611014 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.610989 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-istio-data\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:31:34.611014 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.611011 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af60d411-3b49-45b7-b229-d65713b1cd11-istio-envoy\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:31:34.611163 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.611019 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z44sd\" (UniqueName: \"kubernetes.io/projected/af60d411-3b49-45b7-b229-d65713b1cd11-kube-api-access-z44sd\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:31:34.611163 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.611029 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af60d411-3b49-45b7-b229-d65713b1cd11-istio-podinfo\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:31:34.611163 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.611037 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af60d411-3b49-45b7-b229-d65713b1cd11-istio-token\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:31:34.776637 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.776564 2580 generic.go:356] "Generic (PLEG): container finished" podID="af60d411-3b49-45b7-b229-d65713b1cd11" containerID="54a78abd60b31e2d34a4d43837545d8e9af4cf6716c0fb686decced35e88eddf" exitCode=0 Jul 17 21:31:34.776637 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.776609 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" Jul 17 21:31:34.776786 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.776643 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" event={"ID":"af60d411-3b49-45b7-b229-d65713b1cd11","Type":"ContainerDied","Data":"54a78abd60b31e2d34a4d43837545d8e9af4cf6716c0fb686decced35e88eddf"} Jul 17 21:31:34.776786 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.776692 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9" event={"ID":"af60d411-3b49-45b7-b229-d65713b1cd11","Type":"ContainerDied","Data":"5ee74be41de014a361f0be27712437b9bd2fe6eb72bb83ee9485d4dbdc61b824"} Jul 17 21:31:34.776786 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.776714 2580 scope.go:117] "RemoveContainer" containerID="54a78abd60b31e2d34a4d43837545d8e9af4cf6716c0fb686decced35e88eddf" Jul 17 21:31:34.789290 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.789178 2580 scope.go:117] "RemoveContainer" containerID="29d94251753d96ee88692adb8c71a95b9e3717435fb44284ee022c4cc4f60188" Jul 17 21:31:34.797556 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.797536 2580 scope.go:117] "RemoveContainer" containerID="54a78abd60b31e2d34a4d43837545d8e9af4cf6716c0fb686decced35e88eddf" Jul 17 21:31:34.797876 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:31:34.797806 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54a78abd60b31e2d34a4d43837545d8e9af4cf6716c0fb686decced35e88eddf\": container with ID starting with 54a78abd60b31e2d34a4d43837545d8e9af4cf6716c0fb686decced35e88eddf not found: ID does not exist" containerID="54a78abd60b31e2d34a4d43837545d8e9af4cf6716c0fb686decced35e88eddf" Jul 17 21:31:34.797876 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.797845 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54a78abd60b31e2d34a4d43837545d8e9af4cf6716c0fb686decced35e88eddf"} err="failed to get container status \"54a78abd60b31e2d34a4d43837545d8e9af4cf6716c0fb686decced35e88eddf\": rpc error: code = NotFound desc = could not find container \"54a78abd60b31e2d34a4d43837545d8e9af4cf6716c0fb686decced35e88eddf\": container with ID starting with 54a78abd60b31e2d34a4d43837545d8e9af4cf6716c0fb686decced35e88eddf not found: ID does not exist" Jul 17 21:31:34.797876 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.797871 2580 scope.go:117] "RemoveContainer" containerID="29d94251753d96ee88692adb8c71a95b9e3717435fb44284ee022c4cc4f60188" Jul 17 21:31:34.798214 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:31:34.798164 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29d94251753d96ee88692adb8c71a95b9e3717435fb44284ee022c4cc4f60188\": container with ID starting with 29d94251753d96ee88692adb8c71a95b9e3717435fb44284ee022c4cc4f60188 not found: ID does not exist" containerID="29d94251753d96ee88692adb8c71a95b9e3717435fb44284ee022c4cc4f60188" Jul 17 21:31:34.798303 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.798216 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29d94251753d96ee88692adb8c71a95b9e3717435fb44284ee022c4cc4f60188"} err="failed to get container status \"29d94251753d96ee88692adb8c71a95b9e3717435fb44284ee022c4cc4f60188\": rpc error: code = NotFound desc = could not find container \"29d94251753d96ee88692adb8c71a95b9e3717435fb44284ee022c4cc4f60188\": container with ID starting with 29d94251753d96ee88692adb8c71a95b9e3717435fb44284ee022c4cc4f60188 not found: ID does not exist" Jul 17 21:31:34.800795 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.800775 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9"] Jul 17 21:31:34.806896 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:34.806874 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-8795fd2a-gw-openshift-default-7848649779-6z8l9"] Jul 17 21:31:35.858601 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:35.858571 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af60d411-3b49-45b7-b229-d65713b1cd11" path="/var/lib/kubelet/pods/af60d411-3b49-45b7-b229-d65713b1cd11/volumes" Jul 17 21:31:46.759952 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:46.759913 2580 patch_prober.go:28] interesting pod/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 17 21:31:46.760392 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:46.759978 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" podUID="c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 17 21:31:46.843530 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:46.843500 2580 generic.go:356] "Generic (PLEG): container finished" podID="c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2" containerID="b520238ed520fe3d4cebb22956942d9555c7842f8d6ac6b1e001f3e872afc846" exitCode=0 Jul 17 21:31:46.843681 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:46.843579 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" event={"ID":"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2","Type":"ContainerDied","Data":"b520238ed520fe3d4cebb22956942d9555c7842f8d6ac6b1e001f3e872afc846"} Jul 17 21:31:46.843958 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:46.843945 2580 scope.go:117] "RemoveContainer" containerID="b520238ed520fe3d4cebb22956942d9555c7842f8d6ac6b1e001f3e872afc846" Jul 17 21:31:46.844978 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:46.844947 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:31:46.845038 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:46.845019 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:31:46.845118 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:46.845078 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:31:47.851024 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:47.850991 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" event={"ID":"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2","Type":"ContainerStarted","Data":"d92f15aac5506e8c726d227c61183ec63742faad71043bb17a0b699973f32e6a"} Jul 17 21:31:48.275489 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:48.275390 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:48.275747 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:48.275726 2580 patch_prober.go:28] interesting pod/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 17 21:31:48.275798 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:48.275771 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" podUID="c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 17 21:31:49.274960 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:49.274921 2580 patch_prober.go:28] interesting pod/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 17 21:31:49.275401 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:49.274976 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" podUID="c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 17 21:31:50.275473 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:50.275436 2580 patch_prober.go:28] interesting pod/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 17 21:31:50.275872 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:50.275492 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" podUID="c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 17 21:31:51.274847 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:51.274808 2580 patch_prober.go:28] interesting pod/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 17 21:31:51.275037 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:51.274902 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" podUID="c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 17 21:31:52.278997 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:52.278956 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:52.279491 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:52.279360 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:31:52.279936 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:31:52.279912 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:32:14.110014 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:14.109982 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm"] Jul 17 21:32:14.110546 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:14.110198 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" podUID="c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2" containerName="istio-proxy" containerID="cri-o://d92f15aac5506e8c726d227c61183ec63742faad71043bb17a0b699973f32e6a" gracePeriod=30 Jul 17 21:32:14.869273 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:14.869232 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b"] Jul 17 21:32:14.869739 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:14.869718 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af60d411-3b49-45b7-b229-d65713b1cd11" containerName="istio-proxy" Jul 17 21:32:14.869804 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:14.869743 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="af60d411-3b49-45b7-b229-d65713b1cd11" containerName="istio-proxy" Jul 17 21:32:14.869804 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:14.869772 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af60d411-3b49-45b7-b229-d65713b1cd11" containerName="istio-proxy" Jul 17 21:32:14.869804 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:14.869780 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="af60d411-3b49-45b7-b229-d65713b1cd11" containerName="istio-proxy" Jul 17 21:32:14.869900 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:14.869860 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d88d4c6-eba4-4f0a-b75b-64993fd43118" containerName="istio-proxy" Jul 17 21:32:14.869900 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:14.869875 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="af60d411-3b49-45b7-b229-d65713b1cd11" containerName="istio-proxy" Jul 17 21:32:14.869900 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:14.869887 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="af60d411-3b49-45b7-b229-d65713b1cd11" containerName="istio-proxy" Jul 17 21:32:14.873499 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:14.873482 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:14.877436 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:14.877414 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-5b4896c2-openshift-default-dockercfg-vwzkk\"" Jul 17 21:32:14.884595 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:14.884573 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b"] Jul 17 21:32:15.067339 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.067297 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68578649-b948-45da-9161-fbce81517f0c-istiod-ca-cert\") pod \"e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:15.067516 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.067354 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkqr7\" (UniqueName: \"kubernetes.io/projected/68578649-b948-45da-9161-fbce81517f0c-kube-api-access-gkqr7\") pod \"e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:15.067516 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.067397 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-istio-envoy\") pod \"e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:15.067516 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.067419 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-workload-socket\") pod \"e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:15.067516 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.067493 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-credential-socket\") pod \"e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:15.067669 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.067533 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-workload-certs\") pod \"e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:15.067669 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.067560 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-istio-data\") pod \"e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:15.067669 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.067601 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68578649-b948-45da-9161-fbce81517f0c-istio-token\") pod \"e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:15.067763 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.067667 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68578649-b948-45da-9161-fbce81517f0c-istio-podinfo\") pod \"e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:15.168917 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.168848 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-credential-socket\") pod \"e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:15.168917 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.168885 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-workload-certs\") pod \"e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:15.168917 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.168907 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-istio-data\") pod \"e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:15.169465 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.168931 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68578649-b948-45da-9161-fbce81517f0c-istio-token\") pod \"e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:15.169465 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.168983 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68578649-b948-45da-9161-fbce81517f0c-istio-podinfo\") pod \"e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:15.169465 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.169030 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68578649-b948-45da-9161-fbce81517f0c-istiod-ca-cert\") pod \"e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:15.169465 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.169070 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkqr7\" (UniqueName: \"kubernetes.io/projected/68578649-b948-45da-9161-fbce81517f0c-kube-api-access-gkqr7\") pod \"e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:15.169465 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.169100 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-istio-envoy\") pod \"e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:15.169465 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.169126 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-workload-socket\") pod \"e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:15.169465 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.169407 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-istio-data\") pod \"e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:15.169465 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.169453 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-workload-certs\") pod \"e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:15.169773 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.169507 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-credential-socket\") pod \"e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:15.169908 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.169884 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68578649-b948-45da-9161-fbce81517f0c-istiod-ca-cert\") pod \"e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:15.170065 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.170049 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-workload-socket\") pod \"e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:15.171819 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.171793 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68578649-b948-45da-9161-fbce81517f0c-istio-podinfo\") pod \"e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:15.172015 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.171995 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-istio-envoy\") pod \"e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:15.177060 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.177040 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68578649-b948-45da-9161-fbce81517f0c-istio-token\") pod \"e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:15.177470 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.177449 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkqr7\" (UniqueName: \"kubernetes.io/projected/68578649-b948-45da-9161-fbce81517f0c-kube-api-access-gkqr7\") pod \"e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:15.185101 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.185081 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:15.321978 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.321952 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b"] Jul 17 21:32:15.322759 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:32:15.322734 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68578649_b948_45da_9161_fbce81517f0c.slice/crio-5b2bf6f738ccd0bf7f91287c4211198fa33fa1752f42c9a66c3d9bc922606996 WatchSource:0}: Error finding container 5b2bf6f738ccd0bf7f91287c4211198fa33fa1752f42c9a66c3d9bc922606996: Status 404 returned error can't find the container with id 5b2bf6f738ccd0bf7f91287c4211198fa33fa1752f42c9a66c3d9bc922606996 Jul 17 21:32:15.324943 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.324908 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:32:15.325018 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.324973 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:32:15.325018 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.324999 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:32:15.998366 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.998329 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" event={"ID":"68578649-b948-45da-9161-fbce81517f0c","Type":"ContainerStarted","Data":"ecbe732eaa715aaa2f7bbeb01da2dd838a6e48bad2a20ba30ffa0b9bcff127ba"} Jul 17 21:32:15.998540 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:15.998382 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" event={"ID":"68578649-b948-45da-9161-fbce81517f0c","Type":"ContainerStarted","Data":"5b2bf6f738ccd0bf7f91287c4211198fa33fa1752f42c9a66c3d9bc922606996"} Jul 17 21:32:16.019808 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:16.019761 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" podStartSLOduration=2.019745617 podStartE2EDuration="2.019745617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:32:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:32:16.018090339 +0000 UTC m=+1708.615772983" watchObservedRunningTime="2026-07-17 21:32:16.019745617 +0000 UTC m=+1708.617428324" Jul 17 21:32:16.185443 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:16.185412 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:16.190062 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:16.190036 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:17.005332 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:17.005297 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:17.006463 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:17.006436 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:19.367981 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:19.367957 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:32:19.413503 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:19.413441 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istio-token\") pod \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " Jul 17 21:32:19.413503 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:19.413479 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istio-data\") pod \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " Jul 17 21:32:19.413665 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:19.413524 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-credential-socket\") pod \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " Jul 17 21:32:19.413665 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:19.413557 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqmpb\" (UniqueName: \"kubernetes.io/projected/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-kube-api-access-sqmpb\") pod \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " Jul 17 21:32:19.413665 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:19.413592 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istiod-ca-cert\") pod \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " Jul 17 21:32:19.413665 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:19.413645 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-workload-certs\") pod \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " Jul 17 21:32:19.413957 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:19.413671 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-workload-socket\") pod \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " Jul 17 21:32:19.413957 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:19.413735 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istio-envoy\") pod \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " Jul 17 21:32:19.413957 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:19.413803 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istio-podinfo\") pod \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\" (UID: \"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2\") " Jul 17 21:32:19.413957 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:19.413882 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2" (UID: "c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:32:19.414159 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:19.414037 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2" (UID: "c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:32:19.414213 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:19.414172 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-credential-socket\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:32:19.414255 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:19.414218 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istiod-ca-cert\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:32:19.414499 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:19.414416 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istio-data" (OuterVolumeSpecName: "istio-data") pod "c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2" (UID: "c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:32:19.414845 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:19.414799 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2" (UID: "c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:32:19.416134 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:19.416055 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2" (UID: "c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:32:19.416134 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:19.416129 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2" (UID: "c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 21:32:19.416480 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:19.416456 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2" (UID: "c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:32:19.416985 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:19.416964 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istio-token" (OuterVolumeSpecName: "istio-token") pod "c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2" (UID: "c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:32:19.417057 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:19.417037 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-kube-api-access-sqmpb" (OuterVolumeSpecName: "kube-api-access-sqmpb") pod "c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2" (UID: "c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2"). InnerVolumeSpecName "kube-api-access-sqmpb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:32:19.514668 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:19.514644 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqmpb\" (UniqueName: \"kubernetes.io/projected/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-kube-api-access-sqmpb\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:32:19.514668 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:19.514667 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-workload-certs\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:32:19.514791 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:19.514676 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-workload-socket\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:32:19.514791 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:19.514687 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istio-envoy\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:32:19.514791 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:19.514694 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istio-podinfo\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:32:19.514791 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:19.514702 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istio-token\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:32:19.514791 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:19.514709 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2-istio-data\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:32:20.025702 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:20.025665 2580 generic.go:356] "Generic (PLEG): container finished" podID="c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2" containerID="d92f15aac5506e8c726d227c61183ec63742faad71043bb17a0b699973f32e6a" exitCode=0 Jul 17 21:32:20.025865 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:20.025701 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" event={"ID":"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2","Type":"ContainerDied","Data":"d92f15aac5506e8c726d227c61183ec63742faad71043bb17a0b699973f32e6a"} Jul 17 21:32:20.025865 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:20.025743 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" Jul 17 21:32:20.025865 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:20.025766 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm" event={"ID":"c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2","Type":"ContainerDied","Data":"d269ec16c3a765477ab3e2d6b1cbf9699e1e65845e25167573e329bb988aadbd"} Jul 17 21:32:20.025865 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:20.025797 2580 scope.go:117] "RemoveContainer" containerID="d92f15aac5506e8c726d227c61183ec63742faad71043bb17a0b699973f32e6a" Jul 17 21:32:20.037523 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:20.037504 2580 scope.go:117] "RemoveContainer" containerID="b520238ed520fe3d4cebb22956942d9555c7842f8d6ac6b1e001f3e872afc846" Jul 17 21:32:20.045408 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:20.045388 2580 scope.go:117] "RemoveContainer" containerID="d92f15aac5506e8c726d227c61183ec63742faad71043bb17a0b699973f32e6a" Jul 17 21:32:20.045680 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:32:20.045659 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d92f15aac5506e8c726d227c61183ec63742faad71043bb17a0b699973f32e6a\": container with ID starting with d92f15aac5506e8c726d227c61183ec63742faad71043bb17a0b699973f32e6a not found: ID does not exist" containerID="d92f15aac5506e8c726d227c61183ec63742faad71043bb17a0b699973f32e6a" Jul 17 21:32:20.045728 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:20.045689 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d92f15aac5506e8c726d227c61183ec63742faad71043bb17a0b699973f32e6a"} err="failed to get container status \"d92f15aac5506e8c726d227c61183ec63742faad71043bb17a0b699973f32e6a\": rpc error: code = NotFound desc = could not find container \"d92f15aac5506e8c726d227c61183ec63742faad71043bb17a0b699973f32e6a\": container with ID starting with d92f15aac5506e8c726d227c61183ec63742faad71043bb17a0b699973f32e6a not found: ID does not exist" Jul 17 21:32:20.045728 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:20.045708 2580 scope.go:117] "RemoveContainer" containerID="b520238ed520fe3d4cebb22956942d9555c7842f8d6ac6b1e001f3e872afc846" Jul 17 21:32:20.045938 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:32:20.045917 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b520238ed520fe3d4cebb22956942d9555c7842f8d6ac6b1e001f3e872afc846\": container with ID starting with b520238ed520fe3d4cebb22956942d9555c7842f8d6ac6b1e001f3e872afc846 not found: ID does not exist" containerID="b520238ed520fe3d4cebb22956942d9555c7842f8d6ac6b1e001f3e872afc846" Jul 17 21:32:20.045980 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:20.045944 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b520238ed520fe3d4cebb22956942d9555c7842f8d6ac6b1e001f3e872afc846"} err="failed to get container status \"b520238ed520fe3d4cebb22956942d9555c7842f8d6ac6b1e001f3e872afc846\": rpc error: code = NotFound desc = could not find container \"b520238ed520fe3d4cebb22956942d9555c7842f8d6ac6b1e001f3e872afc846\": container with ID starting with b520238ed520fe3d4cebb22956942d9555c7842f8d6ac6b1e001f3e872afc846 not found: ID does not exist" Jul 17 21:32:20.053089 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:20.053067 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm"] Jul 17 21:32:20.060045 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:20.060012 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-3ed68410-openshift-default-7dcdcb69d9-hcflm"] Jul 17 21:32:21.858091 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:21.858053 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2" path="/var/lib/kubelet/pods/c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2/volumes" Jul 17 21:32:30.089902 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:30.089874 2580 generic.go:356] "Generic (PLEG): container finished" podID="68578649-b948-45da-9161-fbce81517f0c" containerID="ecbe732eaa715aaa2f7bbeb01da2dd838a6e48bad2a20ba30ffa0b9bcff127ba" exitCode=0 Jul 17 21:32:30.090281 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:30.089945 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" event={"ID":"68578649-b948-45da-9161-fbce81517f0c","Type":"ContainerDied","Data":"ecbe732eaa715aaa2f7bbeb01da2dd838a6e48bad2a20ba30ffa0b9bcff127ba"} Jul 17 21:32:30.090382 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:30.090368 2580 scope.go:117] "RemoveContainer" containerID="ecbe732eaa715aaa2f7bbeb01da2dd838a6e48bad2a20ba30ffa0b9bcff127ba" Jul 17 21:32:30.091438 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:30.091405 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:32:30.091517 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:30.091497 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:32:30.091584 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:30.091570 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:32:31.097451 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:31.097412 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" event={"ID":"68578649-b948-45da-9161-fbce81517f0c","Type":"ContainerStarted","Data":"a0b27a323a7fa2069f16bcd291ad37d051789cf2581e2370bc452140a7974442"} Jul 17 21:32:31.186256 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:31.186221 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:31.187130 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:31.187106 2580 patch_prober.go:28] interesting pod/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jul 17 21:32:31.187208 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:31.187162 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" podUID="68578649-b948-45da-9161-fbce81517f0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jul 17 21:32:32.005449 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:32.005415 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:32.185590 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:32.185558 2580 patch_prober.go:28] interesting pod/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jul 17 21:32:32.185975 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:32.185610 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" podUID="68578649-b948-45da-9161-fbce81517f0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jul 17 21:32:33.185871 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:33.185838 2580 patch_prober.go:28] interesting pod/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jul 17 21:32:33.186279 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:33.185896 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" podUID="68578649-b948-45da-9161-fbce81517f0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jul 17 21:32:34.185553 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:34.185519 2580 patch_prober.go:28] interesting pod/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jul 17 21:32:34.185752 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:34.185578 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" podUID="68578649-b948-45da-9161-fbce81517f0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jul 17 21:32:35.189350 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:35.189318 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:35.190315 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:35.190298 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:32:57.423451 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:57.423410 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b"] Jul 17 21:32:57.423857 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:32:57.423675 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" podUID="68578649-b948-45da-9161-fbce81517f0c" containerName="istio-proxy" containerID="cri-o://a0b27a323a7fa2069f16bcd291ad37d051789cf2581e2370bc452140a7974442" gracePeriod=30 Jul 17 21:33:02.666764 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:02.666735 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:33:02.694599 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:02.694542 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-workload-certs\") pod \"68578649-b948-45da-9161-fbce81517f0c\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " Jul 17 21:33:02.694599 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:02.694581 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-workload-socket\") pod \"68578649-b948-45da-9161-fbce81517f0c\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " Jul 17 21:33:02.694786 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:02.694615 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-credential-socket\") pod \"68578649-b948-45da-9161-fbce81517f0c\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " Jul 17 21:33:02.694786 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:02.694662 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-istio-envoy\") pod \"68578649-b948-45da-9161-fbce81517f0c\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " Jul 17 21:33:02.694786 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:02.694708 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkqr7\" (UniqueName: \"kubernetes.io/projected/68578649-b948-45da-9161-fbce81517f0c-kube-api-access-gkqr7\") pod \"68578649-b948-45da-9161-fbce81517f0c\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " Jul 17 21:33:02.694786 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:02.694732 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-istio-data\") pod \"68578649-b948-45da-9161-fbce81517f0c\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " Jul 17 21:33:02.694786 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:02.694763 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68578649-b948-45da-9161-fbce81517f0c-istio-podinfo\") pod \"68578649-b948-45da-9161-fbce81517f0c\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " Jul 17 21:33:02.695039 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:02.694817 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68578649-b948-45da-9161-fbce81517f0c-istio-token\") pod \"68578649-b948-45da-9161-fbce81517f0c\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " Jul 17 21:33:02.695039 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:02.694824 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "68578649-b948-45da-9161-fbce81517f0c" (UID: "68578649-b948-45da-9161-fbce81517f0c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:33:02.695039 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:02.694844 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68578649-b948-45da-9161-fbce81517f0c-istiod-ca-cert\") pod \"68578649-b948-45da-9161-fbce81517f0c\" (UID: \"68578649-b948-45da-9161-fbce81517f0c\") " Jul 17 21:33:02.695039 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:02.694944 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "68578649-b948-45da-9161-fbce81517f0c" (UID: "68578649-b948-45da-9161-fbce81517f0c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:33:02.695272 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:02.695231 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-credential-socket\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:33:02.695272 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:02.695251 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-workload-certs\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:33:02.695470 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:02.695439 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "68578649-b948-45da-9161-fbce81517f0c" (UID: "68578649-b948-45da-9161-fbce81517f0c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:33:02.695599 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:02.695500 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68578649-b948-45da-9161-fbce81517f0c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "68578649-b948-45da-9161-fbce81517f0c" (UID: "68578649-b948-45da-9161-fbce81517f0c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:33:02.695876 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:02.695848 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-istio-data" (OuterVolumeSpecName: "istio-data") pod "68578649-b948-45da-9161-fbce81517f0c" (UID: "68578649-b948-45da-9161-fbce81517f0c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:33:02.696968 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:02.696936 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "68578649-b948-45da-9161-fbce81517f0c" (UID: "68578649-b948-45da-9161-fbce81517f0c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:33:02.697070 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:02.697026 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/68578649-b948-45da-9161-fbce81517f0c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "68578649-b948-45da-9161-fbce81517f0c" (UID: "68578649-b948-45da-9161-fbce81517f0c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 21:33:02.697121 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:02.697075 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68578649-b948-45da-9161-fbce81517f0c-istio-token" (OuterVolumeSpecName: "istio-token") pod "68578649-b948-45da-9161-fbce81517f0c" (UID: "68578649-b948-45da-9161-fbce81517f0c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:33:02.697295 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:02.697270 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68578649-b948-45da-9161-fbce81517f0c-kube-api-access-gkqr7" (OuterVolumeSpecName: "kube-api-access-gkqr7") pod "68578649-b948-45da-9161-fbce81517f0c" (UID: "68578649-b948-45da-9161-fbce81517f0c"). InnerVolumeSpecName "kube-api-access-gkqr7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:33:02.795888 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:02.795849 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68578649-b948-45da-9161-fbce81517f0c-istio-token\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:33:02.795888 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:02.795883 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68578649-b948-45da-9161-fbce81517f0c-istiod-ca-cert\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:33:02.795888 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:02.795899 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-workload-socket\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:33:02.796134 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:02.795910 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-istio-envoy\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:33:02.796134 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:02.795923 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkqr7\" (UniqueName: \"kubernetes.io/projected/68578649-b948-45da-9161-fbce81517f0c-kube-api-access-gkqr7\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:33:02.796134 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:02.795936 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68578649-b948-45da-9161-fbce81517f0c-istio-data\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:33:02.796134 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:02.795946 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68578649-b948-45da-9161-fbce81517f0c-istio-podinfo\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:33:03.275977 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:03.275940 2580 generic.go:356] "Generic (PLEG): container finished" podID="68578649-b948-45da-9161-fbce81517f0c" containerID="a0b27a323a7fa2069f16bcd291ad37d051789cf2581e2370bc452140a7974442" exitCode=0 Jul 17 21:33:03.276143 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:03.275983 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" Jul 17 21:33:03.276143 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:03.276025 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" event={"ID":"68578649-b948-45da-9161-fbce81517f0c","Type":"ContainerDied","Data":"a0b27a323a7fa2069f16bcd291ad37d051789cf2581e2370bc452140a7974442"} Jul 17 21:33:03.276143 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:03.276079 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b" event={"ID":"68578649-b948-45da-9161-fbce81517f0c","Type":"ContainerDied","Data":"5b2bf6f738ccd0bf7f91287c4211198fa33fa1752f42c9a66c3d9bc922606996"} Jul 17 21:33:03.276143 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:03.276103 2580 scope.go:117] "RemoveContainer" containerID="a0b27a323a7fa2069f16bcd291ad37d051789cf2581e2370bc452140a7974442" Jul 17 21:33:03.285702 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:03.285686 2580 scope.go:117] "RemoveContainer" containerID="ecbe732eaa715aaa2f7bbeb01da2dd838a6e48bad2a20ba30ffa0b9bcff127ba" Jul 17 21:33:03.293535 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:03.293512 2580 scope.go:117] "RemoveContainer" containerID="a0b27a323a7fa2069f16bcd291ad37d051789cf2581e2370bc452140a7974442" Jul 17 21:33:03.293773 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:33:03.293754 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0b27a323a7fa2069f16bcd291ad37d051789cf2581e2370bc452140a7974442\": container with ID starting with a0b27a323a7fa2069f16bcd291ad37d051789cf2581e2370bc452140a7974442 not found: ID does not exist" containerID="a0b27a323a7fa2069f16bcd291ad37d051789cf2581e2370bc452140a7974442" Jul 17 21:33:03.293821 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:03.293780 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0b27a323a7fa2069f16bcd291ad37d051789cf2581e2370bc452140a7974442"} err="failed to get container status \"a0b27a323a7fa2069f16bcd291ad37d051789cf2581e2370bc452140a7974442\": rpc error: code = NotFound desc = could not find container \"a0b27a323a7fa2069f16bcd291ad37d051789cf2581e2370bc452140a7974442\": container with ID starting with a0b27a323a7fa2069f16bcd291ad37d051789cf2581e2370bc452140a7974442 not found: ID does not exist" Jul 17 21:33:03.293821 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:03.293797 2580 scope.go:117] "RemoveContainer" containerID="ecbe732eaa715aaa2f7bbeb01da2dd838a6e48bad2a20ba30ffa0b9bcff127ba" Jul 17 21:33:03.294032 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:33:03.294011 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecbe732eaa715aaa2f7bbeb01da2dd838a6e48bad2a20ba30ffa0b9bcff127ba\": container with ID starting with ecbe732eaa715aaa2f7bbeb01da2dd838a6e48bad2a20ba30ffa0b9bcff127ba not found: ID does not exist" containerID="ecbe732eaa715aaa2f7bbeb01da2dd838a6e48bad2a20ba30ffa0b9bcff127ba" Jul 17 21:33:03.294086 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:03.294040 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecbe732eaa715aaa2f7bbeb01da2dd838a6e48bad2a20ba30ffa0b9bcff127ba"} err="failed to get container status \"ecbe732eaa715aaa2f7bbeb01da2dd838a6e48bad2a20ba30ffa0b9bcff127ba\": rpc error: code = NotFound desc = could not find container \"ecbe732eaa715aaa2f7bbeb01da2dd838a6e48bad2a20ba30ffa0b9bcff127ba\": container with ID starting with ecbe732eaa715aaa2f7bbeb01da2dd838a6e48bad2a20ba30ffa0b9bcff127ba not found: ID does not exist" Jul 17 21:33:03.299606 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:03.299583 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b"] Jul 17 21:33:03.303147 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:03.303126 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-5b4896c2-openshift-default-8d88cfdf9-5dd4b"] Jul 17 21:33:03.857944 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:03.857912 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68578649-b948-45da-9161-fbce81517f0c" path="/var/lib/kubelet/pods/68578649-b948-45da-9161-fbce81517f0c/volumes" Jul 17 21:33:47.986952 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:47.986925 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bk9fq_c7148bac-9a70-453b-a952-2a7a5e4a0ea6/console-operator/1.log" Jul 17 21:33:47.992947 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:47.992923 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bk9fq_c7148bac-9a70-453b-a952-2a7a5e4a0ea6/console-operator/1.log" Jul 17 21:33:47.993072 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:47.992991 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lj5lm_6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd/ovn-acl-logging/0.log" Jul 17 21:33:47.998960 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:33:47.998944 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lj5lm_6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd/ovn-acl-logging/0.log" Jul 17 21:34:40.799939 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:40.799904 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6"] Jul 17 21:34:40.800439 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:40.800292 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2" containerName="istio-proxy" Jul 17 21:34:40.800439 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:40.800305 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2" containerName="istio-proxy" Jul 17 21:34:40.800439 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:40.800326 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2" containerName="istio-proxy" Jul 17 21:34:40.800439 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:40.800333 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2" containerName="istio-proxy" Jul 17 21:34:40.800439 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:40.800343 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68578649-b948-45da-9161-fbce81517f0c" containerName="istio-proxy" Jul 17 21:34:40.800439 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:40.800348 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="68578649-b948-45da-9161-fbce81517f0c" containerName="istio-proxy" Jul 17 21:34:40.800439 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:40.800355 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68578649-b948-45da-9161-fbce81517f0c" containerName="istio-proxy" Jul 17 21:34:40.800439 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:40.800360 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="68578649-b948-45da-9161-fbce81517f0c" containerName="istio-proxy" Jul 17 21:34:40.800439 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:40.800418 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="68578649-b948-45da-9161-fbce81517f0c" containerName="istio-proxy" Jul 17 21:34:40.800439 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:40.800426 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2" containerName="istio-proxy" Jul 17 21:34:40.800439 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:40.800432 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="68578649-b948-45da-9161-fbce81517f0c" containerName="istio-proxy" Jul 17 21:34:40.800439 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:40.800440 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3a4ed96-8f0c-4e3d-9dea-90ada6a678c2" containerName="istio-proxy" Jul 17 21:34:40.803489 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:40.803472 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:40.807243 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:40.807220 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-4ad88838-openshift-default-dockercfg-kcqs2\"" Jul 17 21:34:40.833937 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:40.833911 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6"] Jul 17 21:34:40.917004 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:40.916970 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istio-podinfo\") pod \"e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:40.917218 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:40.917020 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-credential-socket\") pod \"e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:40.917218 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:40.917096 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-workload-certs\") pod \"e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:40.917218 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:40.917145 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxnkg\" (UniqueName: \"kubernetes.io/projected/c329b8ee-99f7-4c7c-80fa-f16f006b2158-kube-api-access-kxnkg\") pod \"e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:40.917376 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:40.917231 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istio-data\") pod \"e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:40.917376 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:40.917267 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istio-token\") pod \"e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:40.917376 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:40.917305 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-workload-socket\") pod \"e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:40.917376 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:40.917339 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istio-envoy\") pod \"e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:40.917376 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:40.917359 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istiod-ca-cert\") pod \"e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:41.017890 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:41.017852 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istio-podinfo\") pod \"e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:41.018209 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:41.018158 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-credential-socket\") pod \"e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:41.018320 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:41.018281 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-workload-certs\") pod \"e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:41.018381 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:41.018320 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxnkg\" (UniqueName: \"kubernetes.io/projected/c329b8ee-99f7-4c7c-80fa-f16f006b2158-kube-api-access-kxnkg\") pod \"e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:41.018442 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:41.018412 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istio-data\") pod \"e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:41.018518 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:41.018452 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istio-token\") pod \"e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:41.018518 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:41.018484 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-workload-socket\") pod \"e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:41.018624 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:41.018554 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-credential-socket\") pod \"e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:41.018624 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:41.018574 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istio-envoy\") pod \"e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:41.018727 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:41.018625 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-workload-certs\") pod \"e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:41.018727 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:41.018639 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istiod-ca-cert\") pod \"e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:41.018833 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:41.018805 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-workload-socket\") pod \"e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:41.018992 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:41.018970 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istio-data\") pod \"e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:41.019319 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:41.019296 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istiod-ca-cert\") pod \"e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:41.020683 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:41.020658 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istio-envoy\") pod \"e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:41.020772 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:41.020692 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istio-podinfo\") pod \"e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:41.037149 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:41.037114 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxnkg\" (UniqueName: \"kubernetes.io/projected/c329b8ee-99f7-4c7c-80fa-f16f006b2158-kube-api-access-kxnkg\") pod \"e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:41.038293 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:41.038275 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istio-token\") pod \"e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:41.113613 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:41.113563 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:41.250755 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:41.250720 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6"] Jul 17 21:34:41.253163 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:34:41.253135 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc329b8ee_99f7_4c7c_80fa_f16f006b2158.slice/crio-4ecc418213de68e95c5ca7469732d5acbccb048812d7eb2d045e80522b43f7cb WatchSource:0}: Error finding container 4ecc418213de68e95c5ca7469732d5acbccb048812d7eb2d045e80522b43f7cb: Status 404 returned error can't find the container with id 4ecc418213de68e95c5ca7469732d5acbccb048812d7eb2d045e80522b43f7cb Jul 17 21:34:41.255317 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:41.255284 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:34:41.255424 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:41.255362 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:34:41.255424 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:41.255411 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:34:41.782500 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:41.782454 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" event={"ID":"c329b8ee-99f7-4c7c-80fa-f16f006b2158","Type":"ContainerStarted","Data":"18f65aaf1dc3331782ef2746198803ade5365fba1632c33777baf511692a8245"} Jul 17 21:34:41.782667 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:41.782515 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" event={"ID":"c329b8ee-99f7-4c7c-80fa-f16f006b2158","Type":"ContainerStarted","Data":"4ecc418213de68e95c5ca7469732d5acbccb048812d7eb2d045e80522b43f7cb"} Jul 17 21:34:41.808337 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:41.808284 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" podStartSLOduration=1.808265244 podStartE2EDuration="1.808265244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:34:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:34:41.807171077 +0000 UTC m=+1854.404853721" watchObservedRunningTime="2026-07-17 21:34:41.808265244 +0000 UTC m=+1854.405947960" Jul 17 21:34:42.114394 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:42.114367 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:42.118755 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:42.118733 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:42.788043 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:42.788008 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:42.789027 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:42.789009 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:56.871565 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:56.871486 2580 generic.go:356] "Generic (PLEG): container finished" podID="c329b8ee-99f7-4c7c-80fa-f16f006b2158" containerID="18f65aaf1dc3331782ef2746198803ade5365fba1632c33777baf511692a8245" exitCode=0 Jul 17 21:34:56.872039 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:56.871567 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" event={"ID":"c329b8ee-99f7-4c7c-80fa-f16f006b2158","Type":"ContainerDied","Data":"18f65aaf1dc3331782ef2746198803ade5365fba1632c33777baf511692a8245"} Jul 17 21:34:56.872105 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:56.872064 2580 scope.go:117] "RemoveContainer" containerID="18f65aaf1dc3331782ef2746198803ade5365fba1632c33777baf511692a8245" Jul 17 21:34:56.873037 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:56.873009 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:34:56.873137 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:56.873078 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:34:56.873137 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:56.873112 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:34:57.788539 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:57.788502 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:57.878905 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:57.878874 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" event={"ID":"c329b8ee-99f7-4c7c-80fa-f16f006b2158","Type":"ContainerStarted","Data":"83a95608b1046cad71e6630e669b303e51209947b4ac84d7db631ef8cefd84f8"} Jul 17 21:34:58.114601 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:58.114564 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:34:58.115759 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:58.115733 2580 patch_prober.go:28] interesting pod/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 17 21:34:58.115821 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:58.115782 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" podUID="c329b8ee-99f7-4c7c-80fa-f16f006b2158" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 17 21:34:59.114525 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:59.114487 2580 patch_prober.go:28] interesting pod/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 17 21:34:59.114929 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:34:59.114556 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" podUID="c329b8ee-99f7-4c7c-80fa-f16f006b2158" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 17 21:35:00.114508 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:00.114469 2580 patch_prober.go:28] interesting pod/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 17 21:35:00.114676 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:00.114525 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" podUID="c329b8ee-99f7-4c7c-80fa-f16f006b2158" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 17 21:35:01.114596 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:01.114557 2580 patch_prober.go:28] interesting pod/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 17 21:35:01.114770 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:01.114622 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" podUID="c329b8ee-99f7-4c7c-80fa-f16f006b2158" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 17 21:35:02.117565 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:02.117531 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:35:02.117992 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:02.117971 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:35:02.118641 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:02.118622 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:35:17.033864 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:17.033785 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6"] Jul 17 21:35:17.034402 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:17.034022 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" podUID="c329b8ee-99f7-4c7c-80fa-f16f006b2158" containerName="istio-proxy" containerID="cri-o://83a95608b1046cad71e6630e669b303e51209947b4ac84d7db631ef8cefd84f8" gracePeriod=30 Jul 17 21:35:17.120235 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:17.120203 2580 patch_prober.go:28] interesting pod/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 17 21:35:17.120367 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:17.120269 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" podUID="c329b8ee-99f7-4c7c-80fa-f16f006b2158" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 17 21:35:22.289262 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:22.289237 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:35:22.380931 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:22.380899 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istio-data\") pod \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " Jul 17 21:35:22.380931 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:22.380937 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istio-token\") pod \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " Jul 17 21:35:22.381155 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:22.380993 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istio-podinfo\") pod \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " Jul 17 21:35:22.381155 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:22.381037 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-workload-socket\") pod \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " Jul 17 21:35:22.381155 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:22.381054 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-credential-socket\") pod \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " Jul 17 21:35:22.381155 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:22.381092 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istiod-ca-cert\") pod \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " Jul 17 21:35:22.381155 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:22.381109 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istio-envoy\") pod \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " Jul 17 21:35:22.381155 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:22.381135 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-workload-certs\") pod \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " Jul 17 21:35:22.381541 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:22.381215 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxnkg\" (UniqueName: \"kubernetes.io/projected/c329b8ee-99f7-4c7c-80fa-f16f006b2158-kube-api-access-kxnkg\") pod \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\" (UID: \"c329b8ee-99f7-4c7c-80fa-f16f006b2158\") " Jul 17 21:35:22.381541 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:22.381329 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c329b8ee-99f7-4c7c-80fa-f16f006b2158" (UID: "c329b8ee-99f7-4c7c-80fa-f16f006b2158"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:35:22.381646 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:22.381539 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c329b8ee-99f7-4c7c-80fa-f16f006b2158" (UID: "c329b8ee-99f7-4c7c-80fa-f16f006b2158"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:35:22.381646 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:22.381556 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c329b8ee-99f7-4c7c-80fa-f16f006b2158" (UID: "c329b8ee-99f7-4c7c-80fa-f16f006b2158"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:35:22.381754 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:22.381649 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-workload-socket\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:35:22.381754 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:22.381671 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istiod-ca-cert\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:35:22.381754 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:22.381720 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-workload-certs\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:35:22.381878 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:22.381757 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c329b8ee-99f7-4c7c-80fa-f16f006b2158" (UID: "c329b8ee-99f7-4c7c-80fa-f16f006b2158"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:35:22.381878 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:22.381788 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istio-data" (OuterVolumeSpecName: "istio-data") pod "c329b8ee-99f7-4c7c-80fa-f16f006b2158" (UID: "c329b8ee-99f7-4c7c-80fa-f16f006b2158"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:35:22.383391 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:22.383360 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c329b8ee-99f7-4c7c-80fa-f16f006b2158" (UID: "c329b8ee-99f7-4c7c-80fa-f16f006b2158"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 21:35:22.383514 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:22.383490 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c329b8ee-99f7-4c7c-80fa-f16f006b2158-kube-api-access-kxnkg" (OuterVolumeSpecName: "kube-api-access-kxnkg") pod "c329b8ee-99f7-4c7c-80fa-f16f006b2158" (UID: "c329b8ee-99f7-4c7c-80fa-f16f006b2158"). InnerVolumeSpecName "kube-api-access-kxnkg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:35:22.383690 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:22.383669 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istio-token" (OuterVolumeSpecName: "istio-token") pod "c329b8ee-99f7-4c7c-80fa-f16f006b2158" (UID: "c329b8ee-99f7-4c7c-80fa-f16f006b2158"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:35:22.383734 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:22.383676 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c329b8ee-99f7-4c7c-80fa-f16f006b2158" (UID: "c329b8ee-99f7-4c7c-80fa-f16f006b2158"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:35:22.482197 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:22.482164 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istio-data\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:35:22.482326 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:22.482210 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istio-token\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:35:22.482326 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:22.482219 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istio-podinfo\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:35:22.482326 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:22.482228 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-credential-socket\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:35:22.482326 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:22.482237 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c329b8ee-99f7-4c7c-80fa-f16f006b2158-istio-envoy\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:35:22.482326 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:22.482246 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxnkg\" (UniqueName: \"kubernetes.io/projected/c329b8ee-99f7-4c7c-80fa-f16f006b2158-kube-api-access-kxnkg\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:35:23.013372 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:23.013333 2580 generic.go:356] "Generic (PLEG): container finished" podID="c329b8ee-99f7-4c7c-80fa-f16f006b2158" containerID="83a95608b1046cad71e6630e669b303e51209947b4ac84d7db631ef8cefd84f8" exitCode=0 Jul 17 21:35:23.013544 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:23.013382 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" Jul 17 21:35:23.013544 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:23.013413 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" event={"ID":"c329b8ee-99f7-4c7c-80fa-f16f006b2158","Type":"ContainerDied","Data":"83a95608b1046cad71e6630e669b303e51209947b4ac84d7db631ef8cefd84f8"} Jul 17 21:35:23.013544 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:23.013469 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6" event={"ID":"c329b8ee-99f7-4c7c-80fa-f16f006b2158","Type":"ContainerDied","Data":"4ecc418213de68e95c5ca7469732d5acbccb048812d7eb2d045e80522b43f7cb"} Jul 17 21:35:23.013544 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:23.013493 2580 scope.go:117] "RemoveContainer" containerID="83a95608b1046cad71e6630e669b303e51209947b4ac84d7db631ef8cefd84f8" Jul 17 21:35:23.023924 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:23.023907 2580 scope.go:117] "RemoveContainer" containerID="18f65aaf1dc3331782ef2746198803ade5365fba1632c33777baf511692a8245" Jul 17 21:35:23.031878 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:23.031858 2580 scope.go:117] "RemoveContainer" containerID="83a95608b1046cad71e6630e669b303e51209947b4ac84d7db631ef8cefd84f8" Jul 17 21:35:23.032155 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:35:23.032136 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83a95608b1046cad71e6630e669b303e51209947b4ac84d7db631ef8cefd84f8\": container with ID starting with 83a95608b1046cad71e6630e669b303e51209947b4ac84d7db631ef8cefd84f8 not found: ID does not exist" containerID="83a95608b1046cad71e6630e669b303e51209947b4ac84d7db631ef8cefd84f8" Jul 17 21:35:23.032221 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:23.032164 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83a95608b1046cad71e6630e669b303e51209947b4ac84d7db631ef8cefd84f8"} err="failed to get container status \"83a95608b1046cad71e6630e669b303e51209947b4ac84d7db631ef8cefd84f8\": rpc error: code = NotFound desc = could not find container \"83a95608b1046cad71e6630e669b303e51209947b4ac84d7db631ef8cefd84f8\": container with ID starting with 83a95608b1046cad71e6630e669b303e51209947b4ac84d7db631ef8cefd84f8 not found: ID does not exist" Jul 17 21:35:23.032221 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:23.032181 2580 scope.go:117] "RemoveContainer" containerID="18f65aaf1dc3331782ef2746198803ade5365fba1632c33777baf511692a8245" Jul 17 21:35:23.032447 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:35:23.032431 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18f65aaf1dc3331782ef2746198803ade5365fba1632c33777baf511692a8245\": container with ID starting with 18f65aaf1dc3331782ef2746198803ade5365fba1632c33777baf511692a8245 not found: ID does not exist" containerID="18f65aaf1dc3331782ef2746198803ade5365fba1632c33777baf511692a8245" Jul 17 21:35:23.032492 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:23.032452 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18f65aaf1dc3331782ef2746198803ade5365fba1632c33777baf511692a8245"} err="failed to get container status \"18f65aaf1dc3331782ef2746198803ade5365fba1632c33777baf511692a8245\": rpc error: code = NotFound desc = could not find container \"18f65aaf1dc3331782ef2746198803ade5365fba1632c33777baf511692a8245\": container with ID starting with 18f65aaf1dc3331782ef2746198803ade5365fba1632c33777baf511692a8245 not found: ID does not exist" Jul 17 21:35:23.035670 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:23.035650 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6"] Jul 17 21:35:23.042175 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:23.042156 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-4ad88838-openshift-default-55989779d7-v6ls6"] Jul 17 21:35:23.858963 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:23.858928 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c329b8ee-99f7-4c7c-80fa-f16f006b2158" path="/var/lib/kubelet/pods/c329b8ee-99f7-4c7c-80fa-f16f006b2158/volumes" Jul 17 21:35:37.172784 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.172743 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2"] Jul 17 21:35:37.173339 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.173319 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c329b8ee-99f7-4c7c-80fa-f16f006b2158" containerName="istio-proxy" Jul 17 21:35:37.173437 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.173340 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c329b8ee-99f7-4c7c-80fa-f16f006b2158" containerName="istio-proxy" Jul 17 21:35:37.173492 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.173447 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c329b8ee-99f7-4c7c-80fa-f16f006b2158" containerName="istio-proxy" Jul 17 21:35:37.177977 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.177954 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:37.180896 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.180877 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-1f606ba2-openshift-default-dockercfg-xc46h\"" Jul 17 21:35:37.193093 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.193067 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2"] Jul 17 21:35:37.302924 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.302891 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istiod-ca-cert\") pod \"e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:37.303115 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.302930 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istio-data\") pod \"e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:37.303115 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.302963 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-workload-certs\") pod \"e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:37.303115 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.303020 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-workload-socket\") pod \"e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:37.303115 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.303101 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istio-podinfo\") pod \"e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:37.303286 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.303131 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-credential-socket\") pod \"e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:37.303286 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.303152 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istio-envoy\") pod \"e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:37.303286 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.303177 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istio-token\") pod \"e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:37.303286 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.303233 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cxg2\" (UniqueName: \"kubernetes.io/projected/8564fcc7-b67d-4f7e-a81a-f79b8992e798-kube-api-access-2cxg2\") pod \"e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:37.404496 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.404467 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istio-token\") pod \"e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:37.404616 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.404501 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cxg2\" (UniqueName: \"kubernetes.io/projected/8564fcc7-b67d-4f7e-a81a-f79b8992e798-kube-api-access-2cxg2\") pod \"e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:37.404616 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.404525 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istiod-ca-cert\") pod \"e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:37.404616 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.404550 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istio-data\") pod \"e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:37.404616 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.404583 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-workload-certs\") pod \"e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:37.404815 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.404632 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-workload-socket\") pod \"e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:37.404815 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.404695 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istio-podinfo\") pod \"e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:37.404815 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.404741 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-credential-socket\") pod \"e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:37.404815 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.404794 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istio-envoy\") pod \"e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:37.405012 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.404975 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istio-data\") pod \"e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:37.405206 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.405157 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-workload-certs\") pod \"e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:37.405274 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.405221 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-workload-socket\") pod \"e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:37.405274 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.405262 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-credential-socket\") pod \"e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:37.405355 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.405346 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istiod-ca-cert\") pod \"e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:37.407046 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.407030 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istio-envoy\") pod \"e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:37.407431 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.407413 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istio-podinfo\") pod \"e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:37.412890 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.412860 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istio-token\") pod \"e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:37.412981 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.412950 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cxg2\" (UniqueName: \"kubernetes.io/projected/8564fcc7-b67d-4f7e-a81a-f79b8992e798-kube-api-access-2cxg2\") pod \"e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:37.487779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.487721 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:37.630504 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.630467 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2"] Jul 17 21:35:37.631929 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:35:37.631903 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8564fcc7_b67d_4f7e_a81a_f79b8992e798.slice/crio-7fb82211897d053f42bfd8d687b6925224ec973a4363fa3ae4e714d6b18a0d43 WatchSource:0}: Error finding container 7fb82211897d053f42bfd8d687b6925224ec973a4363fa3ae4e714d6b18a0d43: Status 404 returned error can't find the container with id 7fb82211897d053f42bfd8d687b6925224ec973a4363fa3ae4e714d6b18a0d43 Jul 17 21:35:37.634017 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.633977 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:35:37.634100 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.634083 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:35:37.634148 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:37.634131 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:35:38.095946 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:38.095903 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" event={"ID":"8564fcc7-b67d-4f7e-a81a-f79b8992e798","Type":"ContainerStarted","Data":"a841e70da7ecd9749a0a820249d8b521f85c453f119ce9b4414c34d3ce9314d3"} Jul 17 21:35:38.096096 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:38.095964 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" event={"ID":"8564fcc7-b67d-4f7e-a81a-f79b8992e798","Type":"ContainerStarted","Data":"7fb82211897d053f42bfd8d687b6925224ec973a4363fa3ae4e714d6b18a0d43"} Jul 17 21:35:38.124069 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:38.124030 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" podStartSLOduration=1.124017049 podStartE2EDuration="1.124017049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:35:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:35:38.12323136 +0000 UTC m=+1910.720914004" watchObservedRunningTime="2026-07-17 21:35:38.124017049 +0000 UTC m=+1910.721699692" Jul 17 21:35:38.488208 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:38.488116 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:38.492578 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:38.492556 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:39.101725 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:39.101694 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:39.102515 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:39.102495 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:52.184052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:52.183974 2580 generic.go:356] "Generic (PLEG): container finished" podID="8564fcc7-b67d-4f7e-a81a-f79b8992e798" containerID="a841e70da7ecd9749a0a820249d8b521f85c453f119ce9b4414c34d3ce9314d3" exitCode=0 Jul 17 21:35:52.184546 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:52.184061 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" event={"ID":"8564fcc7-b67d-4f7e-a81a-f79b8992e798","Type":"ContainerDied","Data":"a841e70da7ecd9749a0a820249d8b521f85c453f119ce9b4414c34d3ce9314d3"} Jul 17 21:35:52.184613 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:52.184580 2580 scope.go:117] "RemoveContainer" containerID="a841e70da7ecd9749a0a820249d8b521f85c453f119ce9b4414c34d3ce9314d3" Jul 17 21:35:52.185660 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:52.185631 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:35:52.185727 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:52.185701 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:35:52.185771 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:52.185733 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:35:53.191598 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:53.191561 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" event={"ID":"8564fcc7-b67d-4f7e-a81a-f79b8992e798","Type":"ContainerStarted","Data":"fa7176a5d33fa642b8b2242f3635dc885645bae2bdb67f7d2a1193b6035ae495"} Jul 17 21:35:53.488886 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:53.488778 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:53.489860 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:53.489827 2580 patch_prober.go:28] interesting pod/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 17 21:35:53.489991 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:53.489885 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" podUID="8564fcc7-b67d-4f7e-a81a-f79b8992e798" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 17 21:35:54.102620 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:54.102574 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:54.488860 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:54.488775 2580 patch_prober.go:28] interesting pod/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 17 21:35:54.488860 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:54.488846 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" podUID="8564fcc7-b67d-4f7e-a81a-f79b8992e798" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 17 21:35:55.488287 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:55.488251 2580 patch_prober.go:28] interesting pod/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 17 21:35:55.488457 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:55.488318 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" podUID="8564fcc7-b67d-4f7e-a81a-f79b8992e798" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 17 21:35:56.488540 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:56.488504 2580 patch_prober.go:28] interesting pod/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 17 21:35:56.488919 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:56.488554 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" podUID="8564fcc7-b67d-4f7e-a81a-f79b8992e798" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 17 21:35:57.492731 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:57.492691 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:35:57.493661 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:35:57.493637 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:36:17.801086 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:36:17.801048 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f606ba2-4z7p5"] Jul 17 21:36:17.801499 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:36:17.801485 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c329b8ee-99f7-4c7c-80fa-f16f006b2158" containerName="istio-proxy" Jul 17 21:36:17.801499 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:36:17.801498 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c329b8ee-99f7-4c7c-80fa-f16f006b2158" containerName="istio-proxy" Jul 17 21:36:17.801575 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:36:17.801558 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c329b8ee-99f7-4c7c-80fa-f16f006b2158" containerName="istio-proxy" Jul 17 21:36:17.805055 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:36:17.805036 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f606ba2-4z7p5" Jul 17 21:36:17.807828 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:36:17.807808 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-km5xb\"" Jul 17 21:36:17.807886 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:36:17.807853 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 17 21:36:17.811559 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:36:17.811521 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f606ba2-4z7p5"] Jul 17 21:36:17.957477 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:36:17.957436 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b88ffd2c-5407-46dc-a50f-bf0b5a381322-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1f606ba2-4z7p5\" (UID: \"b88ffd2c-5407-46dc-a50f-bf0b5a381322\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f606ba2-4z7p5" Jul 17 21:36:18.058983 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:36:18.058907 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b88ffd2c-5407-46dc-a50f-bf0b5a381322-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1f606ba2-4z7p5\" (UID: \"b88ffd2c-5407-46dc-a50f-bf0b5a381322\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f606ba2-4z7p5" Jul 17 21:36:18.059524 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:36:18.059505 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b88ffd2c-5407-46dc-a50f-bf0b5a381322-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1f606ba2-4z7p5\" (UID: \"b88ffd2c-5407-46dc-a50f-bf0b5a381322\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f606ba2-4z7p5" Jul 17 21:36:18.117557 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:36:18.117533 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f606ba2-4z7p5" Jul 17 21:36:18.245398 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:36:18.245373 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f606ba2-4z7p5"] Jul 17 21:36:18.246949 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:36:18.246919 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb88ffd2c_5407_46dc_a50f_bf0b5a381322.slice/crio-f9a13e6cc751c591c79a79afe9215e0641869492daac921128f1732991cb094a WatchSource:0}: Error finding container f9a13e6cc751c591c79a79afe9215e0641869492daac921128f1732991cb094a: Status 404 returned error can't find the container with id f9a13e6cc751c591c79a79afe9215e0641869492daac921128f1732991cb094a Jul 17 21:36:18.333708 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:36:18.333652 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f606ba2-4z7p5" event={"ID":"b88ffd2c-5407-46dc-a50f-bf0b5a381322","Type":"ContainerStarted","Data":"f9a13e6cc751c591c79a79afe9215e0641869492daac921128f1732991cb094a"} Jul 17 21:36:19.340653 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:36:19.340615 2580 generic.go:356] "Generic (PLEG): container finished" podID="b88ffd2c-5407-46dc-a50f-bf0b5a381322" containerID="ca78128b0e7c067c4f654aeb1c18136574540942aa4df846dd95cd85e0e19ea8" exitCode=0 Jul 17 21:36:19.341100 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:36:19.340699 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f606ba2-4z7p5" event={"ID":"b88ffd2c-5407-46dc-a50f-bf0b5a381322","Type":"ContainerDied","Data":"ca78128b0e7c067c4f654aeb1c18136574540942aa4df846dd95cd85e0e19ea8"} Jul 17 21:36:20.477889 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:36:20.477866 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f606ba2-4z7p5" Jul 17 21:36:20.582324 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:36:20.582299 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b88ffd2c-5407-46dc-a50f-bf0b5a381322-maas-api-service-ca\") pod \"b88ffd2c-5407-46dc-a50f-bf0b5a381322\" (UID: \"b88ffd2c-5407-46dc-a50f-bf0b5a381322\") " Jul 17 21:36:20.582628 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:36:20.582605 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b88ffd2c-5407-46dc-a50f-bf0b5a381322-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b88ffd2c-5407-46dc-a50f-bf0b5a381322" (UID: "b88ffd2c-5407-46dc-a50f-bf0b5a381322"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:36:20.683775 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:36:20.683716 2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b88ffd2c-5407-46dc-a50f-bf0b5a381322-maas-api-service-ca\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:36:21.351860 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:36:21.351831 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f606ba2-4z7p5" Jul 17 21:36:21.352028 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:36:21.351826 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f606ba2-4z7p5" event={"ID":"b88ffd2c-5407-46dc-a50f-bf0b5a381322","Type":"ContainerDied","Data":"f9a13e6cc751c591c79a79afe9215e0641869492daac921128f1732991cb094a"} Jul 17 21:36:21.352028 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:36:21.351965 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f9a13e6cc751c591c79a79afe9215e0641869492daac921128f1732991cb094a" Jul 17 21:36:37.893554 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:36:37.893519 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f606ba2-4z7p5"] Jul 17 21:36:37.896297 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:36:37.896276 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f606ba2-4z7p5"] Jul 17 21:36:39.858011 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:36:39.857971 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b88ffd2c-5407-46dc-a50f-bf0b5a381322" path="/var/lib/kubelet/pods/b88ffd2c-5407-46dc-a50f-bf0b5a381322/volumes" Jul 17 21:37:43.705232 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:43.705178 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2"] Jul 17 21:37:43.705822 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:43.705469 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" podUID="8564fcc7-b67d-4f7e-a81a-f79b8992e798" containerName="istio-proxy" containerID="cri-o://fa7176a5d33fa642b8b2242f3635dc885645bae2bdb67f7d2a1193b6035ae495" gracePeriod=30 Jul 17 21:37:48.853431 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:48.853399 2580 generic.go:356] "Generic (PLEG): container finished" podID="8564fcc7-b67d-4f7e-a81a-f79b8992e798" containerID="fa7176a5d33fa642b8b2242f3635dc885645bae2bdb67f7d2a1193b6035ae495" exitCode=0 Jul 17 21:37:48.853818 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:48.853435 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" event={"ID":"8564fcc7-b67d-4f7e-a81a-f79b8992e798","Type":"ContainerDied","Data":"fa7176a5d33fa642b8b2242f3635dc885645bae2bdb67f7d2a1193b6035ae495"} Jul 17 21:37:48.853818 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:48.853492 2580 scope.go:117] "RemoveContainer" containerID="a841e70da7ecd9749a0a820249d8b521f85c453f119ce9b4414c34d3ce9314d3" Jul 17 21:37:48.958936 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:48.958914 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:37:48.995737 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:48.995671 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-workload-socket\") pod \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " Jul 17 21:37:48.995737 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:48.995728 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istio-envoy\") pod \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " Jul 17 21:37:48.995922 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:48.995787 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istiod-ca-cert\") pod \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " Jul 17 21:37:48.995922 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:48.995828 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-credential-socket\") pod \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " Jul 17 21:37:48.995922 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:48.995860 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istio-data\") pod \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " Jul 17 21:37:48.995922 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:48.995888 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-workload-certs\") pod \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " Jul 17 21:37:48.996128 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:48.995921 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istio-token\") pod \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " Jul 17 21:37:48.996128 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:48.995925 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8564fcc7-b67d-4f7e-a81a-f79b8992e798" (UID: "8564fcc7-b67d-4f7e-a81a-f79b8992e798"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:37:48.996128 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:48.995953 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istio-podinfo\") pod \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " Jul 17 21:37:48.996128 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:48.995982 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cxg2\" (UniqueName: \"kubernetes.io/projected/8564fcc7-b67d-4f7e-a81a-f79b8992e798-kube-api-access-2cxg2\") pod \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\" (UID: \"8564fcc7-b67d-4f7e-a81a-f79b8992e798\") " Jul 17 21:37:48.996362 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:48.996154 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8564fcc7-b67d-4f7e-a81a-f79b8992e798" (UID: "8564fcc7-b67d-4f7e-a81a-f79b8992e798"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:37:48.996362 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:48.996212 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8564fcc7-b67d-4f7e-a81a-f79b8992e798" (UID: "8564fcc7-b67d-4f7e-a81a-f79b8992e798"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:37:48.996362 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:48.996278 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8564fcc7-b67d-4f7e-a81a-f79b8992e798" (UID: "8564fcc7-b67d-4f7e-a81a-f79b8992e798"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:37:48.996362 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:48.996342 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istiod-ca-cert\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:37:48.996362 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:48.996357 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-credential-socket\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:37:48.996608 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:48.996370 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-workload-certs\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:37:48.996608 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:48.996384 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-workload-socket\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:37:48.996957 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:48.996929 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istio-data" (OuterVolumeSpecName: "istio-data") pod "8564fcc7-b67d-4f7e-a81a-f79b8992e798" (UID: "8564fcc7-b67d-4f7e-a81a-f79b8992e798"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:37:48.998398 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:48.998355 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8564fcc7-b67d-4f7e-a81a-f79b8992e798" (UID: "8564fcc7-b67d-4f7e-a81a-f79b8992e798"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:37:48.998598 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:48.998567 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istio-token" (OuterVolumeSpecName: "istio-token") pod "8564fcc7-b67d-4f7e-a81a-f79b8992e798" (UID: "8564fcc7-b67d-4f7e-a81a-f79b8992e798"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:37:48.998702 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:48.998686 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8564fcc7-b67d-4f7e-a81a-f79b8992e798" (UID: "8564fcc7-b67d-4f7e-a81a-f79b8992e798"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 21:37:48.998801 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:48.998785 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8564fcc7-b67d-4f7e-a81a-f79b8992e798-kube-api-access-2cxg2" (OuterVolumeSpecName: "kube-api-access-2cxg2") pod "8564fcc7-b67d-4f7e-a81a-f79b8992e798" (UID: "8564fcc7-b67d-4f7e-a81a-f79b8992e798"). InnerVolumeSpecName "kube-api-access-2cxg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:37:49.097664 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:49.097636 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istio-data\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:37:49.097664 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:49.097661 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istio-token\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:37:49.097806 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:49.097670 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istio-podinfo\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:37:49.097806 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:49.097679 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cxg2\" (UniqueName: \"kubernetes.io/projected/8564fcc7-b67d-4f7e-a81a-f79b8992e798-kube-api-access-2cxg2\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:37:49.097806 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:49.097689 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8564fcc7-b67d-4f7e-a81a-f79b8992e798-istio-envoy\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:37:49.862004 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:49.861975 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" Jul 17 21:37:49.862569 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:49.861997 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2" event={"ID":"8564fcc7-b67d-4f7e-a81a-f79b8992e798","Type":"ContainerDied","Data":"7fb82211897d053f42bfd8d687b6925224ec973a4363fa3ae4e714d6b18a0d43"} Jul 17 21:37:49.862569 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:49.862059 2580 scope.go:117] "RemoveContainer" containerID="fa7176a5d33fa642b8b2242f3635dc885645bae2bdb67f7d2a1193b6035ae495" Jul 17 21:37:49.889014 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:49.888987 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2"] Jul 17 21:37:49.892338 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:49.892315 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-1f606ba2-openshift-default-59cdb86f8c-nzkr2"] Jul 17 21:37:51.857716 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:37:51.857669 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8564fcc7-b67d-4f7e-a81a-f79b8992e798" path="/var/lib/kubelet/pods/8564fcc7-b67d-4f7e-a81a-f79b8992e798/volumes" Jul 17 21:38:40.364544 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.364512 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt"] Jul 17 21:38:40.365043 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.364859 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8564fcc7-b67d-4f7e-a81a-f79b8992e798" containerName="istio-proxy" Jul 17 21:38:40.365043 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.364869 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8564fcc7-b67d-4f7e-a81a-f79b8992e798" containerName="istio-proxy" Jul 17 21:38:40.365043 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.364883 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b88ffd2c-5407-46dc-a50f-bf0b5a381322" containerName="revoke-keys" Jul 17 21:38:40.365043 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.364889 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b88ffd2c-5407-46dc-a50f-bf0b5a381322" containerName="revoke-keys" Jul 17 21:38:40.365043 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.364956 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8564fcc7-b67d-4f7e-a81a-f79b8992e798" containerName="istio-proxy" Jul 17 21:38:40.365043 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.364965 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b88ffd2c-5407-46dc-a50f-bf0b5a381322" containerName="revoke-keys" Jul 17 21:38:40.365043 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.364972 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8564fcc7-b67d-4f7e-a81a-f79b8992e798" containerName="istio-proxy" Jul 17 21:38:40.367992 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.367975 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:40.370544 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.370518 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-b28fb0-openshift-default-dockercfg-cvzpr\"" Jul 17 21:38:40.382123 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.382099 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt"] Jul 17 21:38:40.431745 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.431716 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-credential-socket\") pod \"e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:40.431858 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.431763 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwp4z\" (UniqueName: \"kubernetes.io/projected/2b64be2f-1e0d-44c0-8582-b05f97379f2d-kube-api-access-xwp4z\") pod \"e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:40.431858 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.431843 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istio-data\") pod \"e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:40.431938 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.431876 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-workload-socket\") pod \"e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:40.431938 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.431914 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istio-podinfo\") pod \"e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:40.431938 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.431933 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istiod-ca-cert\") pod \"e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:40.432050 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.431952 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-workload-certs\") pod \"e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:40.432050 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.432009 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istio-envoy\") pod \"e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:40.432050 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.432037 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istio-token\") pod \"e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:40.533182 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.533145 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-credential-socket\") pod \"e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:40.533377 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.533215 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwp4z\" (UniqueName: \"kubernetes.io/projected/2b64be2f-1e0d-44c0-8582-b05f97379f2d-kube-api-access-xwp4z\") pod \"e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:40.533377 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.533250 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istio-data\") pod \"e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:40.533377 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.533273 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-workload-socket\") pod \"e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:40.533377 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.533305 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istio-podinfo\") pod \"e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:40.533606 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.533421 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istiod-ca-cert\") pod \"e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:40.533606 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.533456 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-workload-certs\") pod \"e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:40.533606 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.533500 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istio-envoy\") pod \"e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:40.533606 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.533528 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istio-token\") pod \"e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:40.533818 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.533660 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-credential-socket\") pod \"e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:40.533818 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.533660 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istio-data\") pod \"e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:40.533818 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.533702 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-workload-socket\") pod \"e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:40.533989 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.533863 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-workload-certs\") pod \"e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:40.534052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.534031 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istiod-ca-cert\") pod \"e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:40.535680 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.535660 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istio-envoy\") pod \"e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:40.535821 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.535803 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istio-podinfo\") pod \"e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:40.555573 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.555552 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwp4z\" (UniqueName: \"kubernetes.io/projected/2b64be2f-1e0d-44c0-8582-b05f97379f2d-kube-api-access-xwp4z\") pod \"e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:40.555660 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.555584 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istio-token\") pod \"e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:40.678089 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.678028 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:40.817144 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.817118 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt"] Jul 17 21:38:40.818573 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:38:40.818546 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b64be2f_1e0d_44c0_8582_b05f97379f2d.slice/crio-292a97de7a9fbabf27a15900afb3e1c68c3ea981060c3d1aece475a334bce6e6 WatchSource:0}: Error finding container 292a97de7a9fbabf27a15900afb3e1c68c3ea981060c3d1aece475a334bce6e6: Status 404 returned error can't find the container with id 292a97de7a9fbabf27a15900afb3e1c68c3ea981060c3d1aece475a334bce6e6 Jul 17 21:38:40.820683 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.820650 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:38:40.820758 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.820717 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:38:40.820758 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:40.820744 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:38:41.143910 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:41.143872 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" event={"ID":"2b64be2f-1e0d-44c0-8582-b05f97379f2d","Type":"ContainerStarted","Data":"c58f7056c681172683fbf4de9b7b0ee2174a7bb5eaca8eb911175577ce85265b"} Jul 17 21:38:41.144131 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:41.143953 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" event={"ID":"2b64be2f-1e0d-44c0-8582-b05f97379f2d","Type":"ContainerStarted","Data":"292a97de7a9fbabf27a15900afb3e1c68c3ea981060c3d1aece475a334bce6e6"} Jul 17 21:38:41.165972 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:41.165924 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" podStartSLOduration=1.165911226 podStartE2EDuration="1.165911226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:38:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:38:41.163607518 +0000 UTC m=+2093.761290160" watchObservedRunningTime="2026-07-17 21:38:41.165911226 +0000 UTC m=+2093.763593869" Jul 17 21:38:41.679029 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:41.678994 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:41.683819 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:41.683791 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:42.149417 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:42.149389 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:42.150165 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:42.150144 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:48.027124 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.027094 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bk9fq_c7148bac-9a70-453b-a952-2a7a5e4a0ea6/console-operator/1.log" Jul 17 21:38:48.033362 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.033341 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lj5lm_6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd/ovn-acl-logging/0.log" Jul 17 21:38:48.034361 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.034332 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bk9fq_c7148bac-9a70-453b-a952-2a7a5e4a0ea6/console-operator/1.log" Jul 17 21:38:48.040223 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.040202 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lj5lm_6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd/ovn-acl-logging/0.log" Jul 17 21:38:48.184896 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.184864 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52"] Jul 17 21:38:48.185382 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.185361 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8564fcc7-b67d-4f7e-a81a-f79b8992e798" containerName="istio-proxy" Jul 17 21:38:48.185382 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.185379 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8564fcc7-b67d-4f7e-a81a-f79b8992e798" containerName="istio-proxy" Jul 17 21:38:48.189912 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.189893 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:48.192431 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.192411 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-c2706a-openshift-default-dockercfg-jtj7v\"" Jul 17 21:38:48.203885 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.203865 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52"] Jul 17 21:38:48.303426 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.303396 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7676a95-b974-4709-a99c-21459579b84f-istio-podinfo\") pod \"e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:48.303614 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.303530 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-workload-socket\") pod \"e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:48.303614 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.303566 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-istio-data\") pod \"e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:48.303614 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.303603 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7676a95-b974-4709-a99c-21459579b84f-istiod-ca-cert\") pod \"e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:48.303780 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.303636 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-istio-envoy\") pod \"e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:48.303780 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.303739 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7676a95-b974-4709-a99c-21459579b84f-istio-token\") pod \"e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:48.303780 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.303767 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-workload-certs\") pod \"e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:48.303930 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.303800 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvmm7\" (UniqueName: \"kubernetes.io/projected/d7676a95-b974-4709-a99c-21459579b84f-kube-api-access-jvmm7\") pod \"e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:48.303930 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.303850 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-credential-socket\") pod \"e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:48.405337 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.405297 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7676a95-b974-4709-a99c-21459579b84f-istio-token\") pod \"e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:48.405337 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.405343 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-workload-certs\") pod \"e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:48.405599 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.405367 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvmm7\" (UniqueName: \"kubernetes.io/projected/d7676a95-b974-4709-a99c-21459579b84f-kube-api-access-jvmm7\") pod \"e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:48.405599 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.405393 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-credential-socket\") pod \"e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:48.405599 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.405416 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7676a95-b974-4709-a99c-21459579b84f-istio-podinfo\") pod \"e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:48.405599 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.405463 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-workload-socket\") pod \"e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:48.405599 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.405478 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-istio-data\") pod \"e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:48.405599 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.405508 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7676a95-b974-4709-a99c-21459579b84f-istiod-ca-cert\") pod \"e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:48.405599 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.405537 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-istio-envoy\") pod \"e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:48.405967 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.405724 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-workload-certs\") pod \"e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:48.405967 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.405812 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-credential-socket\") pod \"e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:48.405967 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.405852 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-istio-data\") pod \"e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:48.405967 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.405906 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-workload-socket\") pod \"e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:48.406343 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.406322 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7676a95-b974-4709-a99c-21459579b84f-istiod-ca-cert\") pod \"e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:48.407732 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.407712 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-istio-envoy\") pod \"e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:48.407932 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.407914 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7676a95-b974-4709-a99c-21459579b84f-istio-podinfo\") pod \"e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:48.413575 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.413553 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7676a95-b974-4709-a99c-21459579b84f-istio-token\") pod \"e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:48.413870 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.413850 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvmm7\" (UniqueName: \"kubernetes.io/projected/d7676a95-b974-4709-a99c-21459579b84f-kube-api-access-jvmm7\") pod \"e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:48.500919 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.500889 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:48.634787 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.634758 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52"] Jul 17 21:38:48.636102 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:38:48.636077 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7676a95_b974_4709_a99c_21459579b84f.slice/crio-3fe9b9f777fbeaa72e05f35c9582a59fd93fe5e053863a6123155379163c4967 WatchSource:0}: Error finding container 3fe9b9f777fbeaa72e05f35c9582a59fd93fe5e053863a6123155379163c4967: Status 404 returned error can't find the container with id 3fe9b9f777fbeaa72e05f35c9582a59fd93fe5e053863a6123155379163c4967 Jul 17 21:38:48.638496 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.638462 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:38:48.638570 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.638527 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:38:48.638570 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:48.638561 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:38:49.187554 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:49.187502 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" event={"ID":"d7676a95-b974-4709-a99c-21459579b84f","Type":"ContainerStarted","Data":"79619b4f77f4bbb26a7657ec079a624e2a975fef219ee256f68ff1af5fe0eb11"} Jul 17 21:38:49.187933 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:49.187576 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" event={"ID":"d7676a95-b974-4709-a99c-21459579b84f","Type":"ContainerStarted","Data":"3fe9b9f777fbeaa72e05f35c9582a59fd93fe5e053863a6123155379163c4967"} Jul 17 21:38:49.209906 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:49.209857 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" podStartSLOduration=1.209843516 podStartE2EDuration="1.209843516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:38:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:38:49.207925836 +0000 UTC m=+2101.805608494" watchObservedRunningTime="2026-07-17 21:38:49.209843516 +0000 UTC m=+2101.807526216" Jul 17 21:38:49.501573 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:49.501487 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:49.505787 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:49.505764 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:50.196870 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:50.196841 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:50.197808 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:50.197787 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:38:57.271772 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:57.270934 2580 patch_prober.go:28] interesting pod/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": read tcp 10.133.0.2:53550->10.133.0.48:15021: read: connection reset by peer" start-of-body= Jul 17 21:38:57.271772 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:57.271005 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" podUID="2b64be2f-1e0d-44c0-8582-b05f97379f2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": read tcp 10.133.0.2:53550->10.133.0.48:15021: read: connection reset by peer" Jul 17 21:38:58.265649 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:58.265615 2580 generic.go:356] "Generic (PLEG): container finished" podID="2b64be2f-1e0d-44c0-8582-b05f97379f2d" containerID="c58f7056c681172683fbf4de9b7b0ee2174a7bb5eaca8eb911175577ce85265b" exitCode=0 Jul 17 21:38:58.265815 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:58.265660 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" event={"ID":"2b64be2f-1e0d-44c0-8582-b05f97379f2d","Type":"ContainerDied","Data":"c58f7056c681172683fbf4de9b7b0ee2174a7bb5eaca8eb911175577ce85265b"} Jul 17 21:38:58.266092 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:58.266078 2580 scope.go:117] "RemoveContainer" containerID="c58f7056c681172683fbf4de9b7b0ee2174a7bb5eaca8eb911175577ce85265b" Jul 17 21:38:58.267140 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:58.267108 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:38:58.267248 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:58.267227 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:38:58.267307 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:58.267276 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:38:59.273352 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:59.273314 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" event={"ID":"2b64be2f-1e0d-44c0-8582-b05f97379f2d","Type":"ContainerStarted","Data":"fc4c12fcd6c1017a969ca22085843523a3dcfd0931e15197582a1910a67a2766"} Jul 17 21:38:59.679058 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:59.679009 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:38:59.679279 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:59.679252 2580 patch_prober.go:28] interesting pod/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 17 21:38:59.679357 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:38:59.679297 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" podUID="2b64be2f-1e0d-44c0-8582-b05f97379f2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 17 21:39:00.678804 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:00.678763 2580 patch_prober.go:28] interesting pod/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 17 21:39:00.679226 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:00.678826 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" podUID="2b64be2f-1e0d-44c0-8582-b05f97379f2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 17 21:39:01.678819 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:01.678784 2580 patch_prober.go:28] interesting pod/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 17 21:39:01.679312 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:01.678849 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" podUID="2b64be2f-1e0d-44c0-8582-b05f97379f2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 17 21:39:02.679179 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:02.679145 2580 patch_prober.go:28] interesting pod/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 17 21:39:02.681542 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:02.679233 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" podUID="2b64be2f-1e0d-44c0-8582-b05f97379f2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 17 21:39:03.298228 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:03.298178 2580 generic.go:356] "Generic (PLEG): container finished" podID="d7676a95-b974-4709-a99c-21459579b84f" containerID="79619b4f77f4bbb26a7657ec079a624e2a975fef219ee256f68ff1af5fe0eb11" exitCode=0 Jul 17 21:39:03.298388 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:03.298251 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" event={"ID":"d7676a95-b974-4709-a99c-21459579b84f","Type":"ContainerDied","Data":"79619b4f77f4bbb26a7657ec079a624e2a975fef219ee256f68ff1af5fe0eb11"} Jul 17 21:39:03.298635 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:03.298612 2580 scope.go:117] "RemoveContainer" containerID="79619b4f77f4bbb26a7657ec079a624e2a975fef219ee256f68ff1af5fe0eb11" Jul 17 21:39:03.299614 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:03.299588 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:39:03.299679 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:03.299655 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:39:03.299715 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:03.299686 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:39:03.682057 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:03.681971 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:39:03.682437 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:03.682370 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:39:03.682914 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:03.682894 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:39:04.304864 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:04.304831 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" event={"ID":"d7676a95-b974-4709-a99c-21459579b84f","Type":"ContainerStarted","Data":"3b9f9965f426747cc0ad6f3be2bf88f10db25d8dccae7ccca84ab06d09552b60"} Jul 17 21:39:04.501168 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:04.501132 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:39:04.502392 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:04.502360 2580 patch_prober.go:28] interesting pod/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 17 21:39:04.502540 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:04.502413 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" podUID="d7676a95-b974-4709-a99c-21459579b84f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 17 21:39:05.197173 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:05.197132 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:39:05.501994 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:05.501901 2580 patch_prober.go:28] interesting pod/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 17 21:39:05.501994 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:05.501969 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" podUID="d7676a95-b974-4709-a99c-21459579b84f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 17 21:39:06.502219 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:06.502156 2580 patch_prober.go:28] interesting pod/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 17 21:39:06.502615 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:06.502247 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" podUID="d7676a95-b974-4709-a99c-21459579b84f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 17 21:39:07.501528 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:07.501489 2580 patch_prober.go:28] interesting pod/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 17 21:39:07.501695 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:07.501547 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" podUID="d7676a95-b974-4709-a99c-21459579b84f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 17 21:39:08.505082 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:08.505048 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:39:08.506138 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:08.506118 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:39:55.393599 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:55.393562 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b28fb0-vmtzq"] Jul 17 21:39:55.397254 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:55.397229 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b28fb0-vmtzq" Jul 17 21:39:55.399684 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:55.399664 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-km5xb\"" Jul 17 21:39:55.399773 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:55.399663 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 17 21:39:55.403987 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:55.403962 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b28fb0-vmtzq"] Jul 17 21:39:55.418274 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:55.418253 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/735a3c24-4bb5-41a9-ad60-dfef57cef6ff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-b28fb0-vmtzq\" (UID: \"735a3c24-4bb5-41a9-ad60-dfef57cef6ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b28fb0-vmtzq" Jul 17 21:39:55.519116 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:55.519094 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/735a3c24-4bb5-41a9-ad60-dfef57cef6ff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-b28fb0-vmtzq\" (UID: \"735a3c24-4bb5-41a9-ad60-dfef57cef6ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b28fb0-vmtzq" Jul 17 21:39:55.519694 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:55.519676 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/735a3c24-4bb5-41a9-ad60-dfef57cef6ff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-b28fb0-vmtzq\" (UID: \"735a3c24-4bb5-41a9-ad60-dfef57cef6ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b28fb0-vmtzq" Jul 17 21:39:55.708389 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:55.708326 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b28fb0-vmtzq" Jul 17 21:39:55.839941 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:55.839917 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b28fb0-vmtzq"] Jul 17 21:39:55.840929 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:39:55.840901 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod735a3c24_4bb5_41a9_ad60_dfef57cef6ff.slice/crio-270a0d5a120602b5b71d0ccf04d511ff6d672353ec9b87b7cb65f281945394dd WatchSource:0}: Error finding container 270a0d5a120602b5b71d0ccf04d511ff6d672353ec9b87b7cb65f281945394dd: Status 404 returned error can't find the container with id 270a0d5a120602b5b71d0ccf04d511ff6d672353ec9b87b7cb65f281945394dd Jul 17 21:39:56.598026 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:56.597989 2580 generic.go:356] "Generic (PLEG): container finished" podID="735a3c24-4bb5-41a9-ad60-dfef57cef6ff" containerID="541cc1358ab46b559b11e00ba6c5114580d6724fcdfb969c8da5ad211a63360b" exitCode=0 Jul 17 21:39:56.598547 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:56.598030 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b28fb0-vmtzq" event={"ID":"735a3c24-4bb5-41a9-ad60-dfef57cef6ff","Type":"ContainerDied","Data":"541cc1358ab46b559b11e00ba6c5114580d6724fcdfb969c8da5ad211a63360b"} Jul 17 21:39:56.598547 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:56.598103 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b28fb0-vmtzq" event={"ID":"735a3c24-4bb5-41a9-ad60-dfef57cef6ff","Type":"ContainerStarted","Data":"270a0d5a120602b5b71d0ccf04d511ff6d672353ec9b87b7cb65f281945394dd"} Jul 17 21:39:57.732916 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:57.732889 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b28fb0-vmtzq" Jul 17 21:39:57.742320 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:57.742297 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/735a3c24-4bb5-41a9-ad60-dfef57cef6ff-maas-api-service-ca\") pod \"735a3c24-4bb5-41a9-ad60-dfef57cef6ff\" (UID: \"735a3c24-4bb5-41a9-ad60-dfef57cef6ff\") " Jul 17 21:39:57.742584 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:57.742562 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/735a3c24-4bb5-41a9-ad60-dfef57cef6ff-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "735a3c24-4bb5-41a9-ad60-dfef57cef6ff" (UID: "735a3c24-4bb5-41a9-ad60-dfef57cef6ff"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:39:57.843315 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:57.843289 2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/735a3c24-4bb5-41a9-ad60-dfef57cef6ff-maas-api-service-ca\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:39:58.609886 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:58.609855 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b28fb0-vmtzq" event={"ID":"735a3c24-4bb5-41a9-ad60-dfef57cef6ff","Type":"ContainerDied","Data":"270a0d5a120602b5b71d0ccf04d511ff6d672353ec9b87b7cb65f281945394dd"} Jul 17 21:39:58.609886 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:58.609875 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b28fb0-vmtzq" Jul 17 21:39:58.610162 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:39:58.609907 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="270a0d5a120602b5b71d0ccf04d511ff6d672353ec9b87b7cb65f281945394dd" Jul 17 21:40:10.521574 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:10.521536 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b28fb0-vmtzq"] Jul 17 21:40:10.524988 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:10.524961 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b28fb0-vmtzq"] Jul 17 21:40:11.857978 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:11.857934 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="735a3c24-4bb5-41a9-ad60-dfef57cef6ff" path="/var/lib/kubelet/pods/735a3c24-4bb5-41a9-ad60-dfef57cef6ff/volumes" Jul 17 21:40:17.375973 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:17.375934 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt"] Jul 17 21:40:17.376426 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:17.376212 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" podUID="2b64be2f-1e0d-44c0-8582-b05f97379f2d" containerName="istio-proxy" containerID="cri-o://fc4c12fcd6c1017a969ca22085843523a3dcfd0931e15197582a1910a67a2766" gracePeriod=30 Jul 17 21:40:18.684952 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:18.684915 2580 patch_prober.go:28] interesting pod/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 17 21:40:18.685330 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:18.684982 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" podUID="2b64be2f-1e0d-44c0-8582-b05f97379f2d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 17 21:40:22.640208 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.640126 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:40:22.754290 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.754253 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwp4z\" (UniqueName: \"kubernetes.io/projected/2b64be2f-1e0d-44c0-8582-b05f97379f2d-kube-api-access-xwp4z\") pod \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " Jul 17 21:40:22.754463 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.754317 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istio-podinfo\") pod \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " Jul 17 21:40:22.754463 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.754355 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istio-token\") pod \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " Jul 17 21:40:22.754463 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.754391 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-credential-socket\") pod \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " Jul 17 21:40:22.754463 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.754422 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-workload-certs\") pod \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " Jul 17 21:40:22.754698 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.754469 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istio-envoy\") pod \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " Jul 17 21:40:22.754698 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.754542 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istio-data\") pod \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " Jul 17 21:40:22.754698 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.754580 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istiod-ca-cert\") pod \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " Jul 17 21:40:22.754698 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.754637 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-workload-socket\") pod \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\" (UID: \"2b64be2f-1e0d-44c0-8582-b05f97379f2d\") " Jul 17 21:40:22.756104 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.755981 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2b64be2f-1e0d-44c0-8582-b05f97379f2d" (UID: "2b64be2f-1e0d-44c0-8582-b05f97379f2d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:40:22.756104 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.755991 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2b64be2f-1e0d-44c0-8582-b05f97379f2d" (UID: "2b64be2f-1e0d-44c0-8582-b05f97379f2d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:40:22.757026 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.756986 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2b64be2f-1e0d-44c0-8582-b05f97379f2d" (UID: "2b64be2f-1e0d-44c0-8582-b05f97379f2d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 21:40:22.757240 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.757128 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b64be2f-1e0d-44c0-8582-b05f97379f2d-kube-api-access-xwp4z" (OuterVolumeSpecName: "kube-api-access-xwp4z") pod "2b64be2f-1e0d-44c0-8582-b05f97379f2d" (UID: "2b64be2f-1e0d-44c0-8582-b05f97379f2d"). InnerVolumeSpecName "kube-api-access-xwp4z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:40:22.757532 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.757427 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2b64be2f-1e0d-44c0-8582-b05f97379f2d" (UID: "2b64be2f-1e0d-44c0-8582-b05f97379f2d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:40:22.758034 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.757968 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istio-data" (OuterVolumeSpecName: "istio-data") pod "2b64be2f-1e0d-44c0-8582-b05f97379f2d" (UID: "2b64be2f-1e0d-44c0-8582-b05f97379f2d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:40:22.758034 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.757989 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2b64be2f-1e0d-44c0-8582-b05f97379f2d" (UID: "2b64be2f-1e0d-44c0-8582-b05f97379f2d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:40:22.771048 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.758232 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2b64be2f-1e0d-44c0-8582-b05f97379f2d" (UID: "2b64be2f-1e0d-44c0-8582-b05f97379f2d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:40:22.771622 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.771575 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istio-token" (OuterVolumeSpecName: "istio-token") pod "2b64be2f-1e0d-44c0-8582-b05f97379f2d" (UID: "2b64be2f-1e0d-44c0-8582-b05f97379f2d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:40:22.776423 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.776393 2580 generic.go:356] "Generic (PLEG): container finished" podID="2b64be2f-1e0d-44c0-8582-b05f97379f2d" containerID="fc4c12fcd6c1017a969ca22085843523a3dcfd0931e15197582a1910a67a2766" exitCode=0 Jul 17 21:40:22.776518 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.776443 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" Jul 17 21:40:22.776518 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.776470 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" event={"ID":"2b64be2f-1e0d-44c0-8582-b05f97379f2d","Type":"ContainerDied","Data":"fc4c12fcd6c1017a969ca22085843523a3dcfd0931e15197582a1910a67a2766"} Jul 17 21:40:22.776595 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.776556 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt" event={"ID":"2b64be2f-1e0d-44c0-8582-b05f97379f2d","Type":"ContainerDied","Data":"292a97de7a9fbabf27a15900afb3e1c68c3ea981060c3d1aece475a334bce6e6"} Jul 17 21:40:22.776595 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.776585 2580 scope.go:117] "RemoveContainer" containerID="fc4c12fcd6c1017a969ca22085843523a3dcfd0931e15197582a1910a67a2766" Jul 17 21:40:22.786779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.786760 2580 scope.go:117] "RemoveContainer" containerID="c58f7056c681172683fbf4de9b7b0ee2174a7bb5eaca8eb911175577ce85265b" Jul 17 21:40:22.796823 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.796803 2580 scope.go:117] "RemoveContainer" containerID="fc4c12fcd6c1017a969ca22085843523a3dcfd0931e15197582a1910a67a2766" Jul 17 21:40:22.797122 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:40:22.797103 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc4c12fcd6c1017a969ca22085843523a3dcfd0931e15197582a1910a67a2766\": container with ID starting with fc4c12fcd6c1017a969ca22085843523a3dcfd0931e15197582a1910a67a2766 not found: ID does not exist" containerID="fc4c12fcd6c1017a969ca22085843523a3dcfd0931e15197582a1910a67a2766" Jul 17 21:40:22.797220 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.797133 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc4c12fcd6c1017a969ca22085843523a3dcfd0931e15197582a1910a67a2766"} err="failed to get container status \"fc4c12fcd6c1017a969ca22085843523a3dcfd0931e15197582a1910a67a2766\": rpc error: code = NotFound desc = could not find container \"fc4c12fcd6c1017a969ca22085843523a3dcfd0931e15197582a1910a67a2766\": container with ID starting with fc4c12fcd6c1017a969ca22085843523a3dcfd0931e15197582a1910a67a2766 not found: ID does not exist" Jul 17 21:40:22.797220 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.797156 2580 scope.go:117] "RemoveContainer" containerID="c58f7056c681172683fbf4de9b7b0ee2174a7bb5eaca8eb911175577ce85265b" Jul 17 21:40:22.797448 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:40:22.797420 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c58f7056c681172683fbf4de9b7b0ee2174a7bb5eaca8eb911175577ce85265b\": container with ID starting with c58f7056c681172683fbf4de9b7b0ee2174a7bb5eaca8eb911175577ce85265b not found: ID does not exist" containerID="c58f7056c681172683fbf4de9b7b0ee2174a7bb5eaca8eb911175577ce85265b" Jul 17 21:40:22.797508 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.797446 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c58f7056c681172683fbf4de9b7b0ee2174a7bb5eaca8eb911175577ce85265b"} err="failed to get container status \"c58f7056c681172683fbf4de9b7b0ee2174a7bb5eaca8eb911175577ce85265b\": rpc error: code = NotFound desc = could not find container \"c58f7056c681172683fbf4de9b7b0ee2174a7bb5eaca8eb911175577ce85265b\": container with ID starting with c58f7056c681172683fbf4de9b7b0ee2174a7bb5eaca8eb911175577ce85265b not found: ID does not exist" Jul 17 21:40:22.799141 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.799121 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt"] Jul 17 21:40:22.802918 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.802896 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-b28fb0-openshift-default-7b686fbd85-nn4rt"] Jul 17 21:40:22.857173 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.857154 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istio-podinfo\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:40:22.857173 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.857174 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istio-token\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:40:22.857305 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.857204 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-credential-socket\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:40:22.857305 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.857214 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-workload-certs\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:40:22.857305 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.857223 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istio-envoy\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:40:22.857305 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.857230 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istio-data\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:40:22.857305 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.857237 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b64be2f-1e0d-44c0-8582-b05f97379f2d-istiod-ca-cert\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:40:22.857305 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.857244 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b64be2f-1e0d-44c0-8582-b05f97379f2d-workload-socket\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:40:22.857305 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:22.857252 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwp4z\" (UniqueName: \"kubernetes.io/projected/2b64be2f-1e0d-44c0-8582-b05f97379f2d-kube-api-access-xwp4z\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:40:23.858217 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:23.858150 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b64be2f-1e0d-44c0-8582-b05f97379f2d" path="/var/lib/kubelet/pods/2b64be2f-1e0d-44c0-8582-b05f97379f2d/volumes" Jul 17 21:40:39.789363 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:39.789329 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52"] Jul 17 21:40:39.789903 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:39.789546 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" podUID="d7676a95-b974-4709-a99c-21459579b84f" containerName="istio-proxy" containerID="cri-o://3b9f9965f426747cc0ad6f3be2bf88f10db25d8dccae7ccca84ab06d09552b60" gracePeriod=30 Jul 17 21:40:40.667635 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.667603 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb"] Jul 17 21:40:40.667981 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.667968 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b64be2f-1e0d-44c0-8582-b05f97379f2d" containerName="istio-proxy" Jul 17 21:40:40.668036 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.667982 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b64be2f-1e0d-44c0-8582-b05f97379f2d" containerName="istio-proxy" Jul 17 21:40:40.668036 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.667993 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b64be2f-1e0d-44c0-8582-b05f97379f2d" containerName="istio-proxy" Jul 17 21:40:40.668036 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.667999 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b64be2f-1e0d-44c0-8582-b05f97379f2d" containerName="istio-proxy" Jul 17 21:40:40.668036 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.668008 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="735a3c24-4bb5-41a9-ad60-dfef57cef6ff" containerName="revoke-keys" Jul 17 21:40:40.668036 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.668014 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="735a3c24-4bb5-41a9-ad60-dfef57cef6ff" containerName="revoke-keys" Jul 17 21:40:40.668209 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.668078 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b64be2f-1e0d-44c0-8582-b05f97379f2d" containerName="istio-proxy" Jul 17 21:40:40.668209 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.668085 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b64be2f-1e0d-44c0-8582-b05f97379f2d" containerName="istio-proxy" Jul 17 21:40:40.668209 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.668097 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="735a3c24-4bb5-41a9-ad60-dfef57cef6ff" containerName="revoke-keys" Jul 17 21:40:40.671238 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.671220 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:40.673870 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.673849 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-08c323-openshift-default-dockercfg-kwzft\"" Jul 17 21:40:40.686919 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.686892 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb"] Jul 17 21:40:40.834425 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.834388 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istio-data\") pod \"e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:40.834787 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.834457 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istio-envoy\") pod \"e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:40.834787 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.834487 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istio-podinfo\") pod \"e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:40.834787 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.834509 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-workload-certs\") pod \"e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:40.834787 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.834536 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-credential-socket\") pod \"e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:40.834787 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.834606 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istiod-ca-cert\") pod \"e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:40.834787 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.834648 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istio-token\") pod \"e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:40.834787 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.834666 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-workload-socket\") pod \"e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:40.834787 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.834752 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxrkf\" (UniqueName: \"kubernetes.io/projected/f08bc908-e3ee-402e-b2a6-9b838224dbfe-kube-api-access-fxrkf\") pod \"e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:40.936245 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.936145 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istiod-ca-cert\") pod \"e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:40.936245 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.936209 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istio-token\") pod \"e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:40.936245 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.936229 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-workload-socket\") pod \"e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:40.936526 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.936280 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxrkf\" (UniqueName: \"kubernetes.io/projected/f08bc908-e3ee-402e-b2a6-9b838224dbfe-kube-api-access-fxrkf\") pod \"e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:40.936526 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.936451 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istio-data\") pod \"e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:40.936646 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.936528 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istio-envoy\") pod \"e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:40.936646 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.936558 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istio-podinfo\") pod \"e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:40.936646 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.936593 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-workload-certs\") pod \"e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:40.936646 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.936625 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-credential-socket\") pod \"e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:40.936845 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.936686 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-workload-socket\") pod \"e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:40.936845 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.936810 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istio-data\") pod \"e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:40.936965 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.936944 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-workload-certs\") pod \"e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:40.936965 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.936958 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-credential-socket\") pod \"e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:40.937044 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.936946 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istiod-ca-cert\") pod \"e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:40.938681 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.938655 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istio-envoy\") pod \"e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:40.939363 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.939341 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istio-podinfo\") pod \"e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:40.945821 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.945798 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istio-token\") pod \"e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:40.946034 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.946012 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxrkf\" (UniqueName: \"kubernetes.io/projected/f08bc908-e3ee-402e-b2a6-9b838224dbfe-kube-api-access-fxrkf\") pod \"e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:40.981759 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:40.981731 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:41.118952 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:41.118922 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb"] Jul 17 21:40:41.121308 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:40:41.121270 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf08bc908_e3ee_402e_b2a6_9b838224dbfe.slice/crio-82a8c49979b39a28a15eef763fb7e3a9baf455c486aabd5b04d815650eb54f4e WatchSource:0}: Error finding container 82a8c49979b39a28a15eef763fb7e3a9baf455c486aabd5b04d815650eb54f4e: Status 404 returned error can't find the container with id 82a8c49979b39a28a15eef763fb7e3a9baf455c486aabd5b04d815650eb54f4e Jul 17 21:40:41.123448 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:41.123415 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:40:41.123581 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:41.123477 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:40:41.123581 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:41.123518 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:40:41.888467 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:41.888429 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" event={"ID":"f08bc908-e3ee-402e-b2a6-9b838224dbfe","Type":"ContainerStarted","Data":"bb9382bbf4e43914716c4424854fcac4220de7108185aa64db94542d820beec9"} Jul 17 21:40:41.888907 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:41.888477 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" event={"ID":"f08bc908-e3ee-402e-b2a6-9b838224dbfe","Type":"ContainerStarted","Data":"82a8c49979b39a28a15eef763fb7e3a9baf455c486aabd5b04d815650eb54f4e"} Jul 17 21:40:41.914953 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:41.914897 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" podStartSLOduration=1.914882215 podStartE2EDuration="1.914882215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:40:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:40:41.912587043 +0000 UTC m=+2214.510269688" watchObservedRunningTime="2026-07-17 21:40:41.914882215 +0000 UTC m=+2214.512564936" Jul 17 21:40:41.982560 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:41.982523 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:42.987436 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:42.987400 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:43.901433 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:43.901396 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:43.902228 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:43.902209 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:40:44.908033 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:44.908007 2580 generic.go:356] "Generic (PLEG): container finished" podID="d7676a95-b974-4709-a99c-21459579b84f" containerID="3b9f9965f426747cc0ad6f3be2bf88f10db25d8dccae7ccca84ab06d09552b60" exitCode=0 Jul 17 21:40:44.908344 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:44.908070 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" event={"ID":"d7676a95-b974-4709-a99c-21459579b84f","Type":"ContainerDied","Data":"3b9f9965f426747cc0ad6f3be2bf88f10db25d8dccae7ccca84ab06d09552b60"} Jul 17 21:40:44.908344 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:44.908123 2580 scope.go:117] "RemoveContainer" containerID="79619b4f77f4bbb26a7657ec079a624e2a975fef219ee256f68ff1af5fe0eb11" Jul 17 21:40:45.048609 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.048585 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:40:45.068531 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.068347 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7676a95-b974-4709-a99c-21459579b84f-istio-token\") pod \"d7676a95-b974-4709-a99c-21459579b84f\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " Jul 17 21:40:45.068531 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.068404 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-istio-data\") pod \"d7676a95-b974-4709-a99c-21459579b84f\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " Jul 17 21:40:45.068531 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.068454 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-workload-certs\") pod \"d7676a95-b974-4709-a99c-21459579b84f\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " Jul 17 21:40:45.068531 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.068487 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-istio-envoy\") pod \"d7676a95-b974-4709-a99c-21459579b84f\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " Jul 17 21:40:45.068807 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.068547 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvmm7\" (UniqueName: \"kubernetes.io/projected/d7676a95-b974-4709-a99c-21459579b84f-kube-api-access-jvmm7\") pod \"d7676a95-b974-4709-a99c-21459579b84f\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " Jul 17 21:40:45.068807 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.068594 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7676a95-b974-4709-a99c-21459579b84f-istio-podinfo\") pod \"d7676a95-b974-4709-a99c-21459579b84f\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " Jul 17 21:40:45.068807 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.068647 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-workload-socket\") pod \"d7676a95-b974-4709-a99c-21459579b84f\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " Jul 17 21:40:45.068807 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.068677 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-credential-socket\") pod \"d7676a95-b974-4709-a99c-21459579b84f\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " Jul 17 21:40:45.068807 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.068729 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7676a95-b974-4709-a99c-21459579b84f-istiod-ca-cert\") pod \"d7676a95-b974-4709-a99c-21459579b84f\" (UID: \"d7676a95-b974-4709-a99c-21459579b84f\") " Jul 17 21:40:45.069636 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.069411 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-istio-data" (OuterVolumeSpecName: "istio-data") pod "d7676a95-b974-4709-a99c-21459579b84f" (UID: "d7676a95-b974-4709-a99c-21459579b84f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:40:45.069636 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.069420 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7676a95-b974-4709-a99c-21459579b84f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d7676a95-b974-4709-a99c-21459579b84f" (UID: "d7676a95-b974-4709-a99c-21459579b84f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:40:45.069788 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.069685 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d7676a95-b974-4709-a99c-21459579b84f" (UID: "d7676a95-b974-4709-a99c-21459579b84f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:40:45.069976 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.069932 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d7676a95-b974-4709-a99c-21459579b84f" (UID: "d7676a95-b974-4709-a99c-21459579b84f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:40:45.070792 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.070764 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d7676a95-b974-4709-a99c-21459579b84f" (UID: "d7676a95-b974-4709-a99c-21459579b84f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:40:45.071320 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.071283 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7676a95-b974-4709-a99c-21459579b84f-istio-token" (OuterVolumeSpecName: "istio-token") pod "d7676a95-b974-4709-a99c-21459579b84f" (UID: "d7676a95-b974-4709-a99c-21459579b84f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:40:45.071415 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.071332 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7676a95-b974-4709-a99c-21459579b84f-kube-api-access-jvmm7" (OuterVolumeSpecName: "kube-api-access-jvmm7") pod "d7676a95-b974-4709-a99c-21459579b84f" (UID: "d7676a95-b974-4709-a99c-21459579b84f"). InnerVolumeSpecName "kube-api-access-jvmm7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:40:45.071969 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.071945 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d7676a95-b974-4709-a99c-21459579b84f" (UID: "d7676a95-b974-4709-a99c-21459579b84f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:40:45.072591 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.072569 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d7676a95-b974-4709-a99c-21459579b84f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d7676a95-b974-4709-a99c-21459579b84f" (UID: "d7676a95-b974-4709-a99c-21459579b84f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 21:40:45.170543 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.170522 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-workload-certs\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:40:45.170543 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.170542 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-istio-envoy\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:40:45.170664 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.170552 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvmm7\" (UniqueName: \"kubernetes.io/projected/d7676a95-b974-4709-a99c-21459579b84f-kube-api-access-jvmm7\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:40:45.170664 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.170560 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7676a95-b974-4709-a99c-21459579b84f-istio-podinfo\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:40:45.170664 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.170572 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-workload-socket\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:40:45.170664 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.170580 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-credential-socket\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:40:45.170664 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.170589 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7676a95-b974-4709-a99c-21459579b84f-istiod-ca-cert\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:40:45.170664 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.170597 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7676a95-b974-4709-a99c-21459579b84f-istio-token\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:40:45.170664 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.170605 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7676a95-b974-4709-a99c-21459579b84f-istio-data\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:40:45.914303 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.914275 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" Jul 17 21:40:45.914651 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.914307 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52" event={"ID":"d7676a95-b974-4709-a99c-21459579b84f","Type":"ContainerDied","Data":"3fe9b9f777fbeaa72e05f35c9582a59fd93fe5e053863a6123155379163c4967"} Jul 17 21:40:45.914651 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.914360 2580 scope.go:117] "RemoveContainer" containerID="3b9f9965f426747cc0ad6f3be2bf88f10db25d8dccae7ccca84ab06d09552b60" Jul 17 21:40:45.932331 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.932299 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52"] Jul 17 21:40:45.938215 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:45.938179 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-c2706a-openshift-default-5f9fc89b9c-jjf52"] Jul 17 21:40:47.859047 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:47.859016 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7676a95-b974-4709-a99c-21459579b84f" path="/var/lib/kubelet/pods/d7676a95-b974-4709-a99c-21459579b84f/volumes" Jul 17 21:40:49.053052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.053018 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms"] Jul 17 21:40:49.053436 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.053414 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7676a95-b974-4709-a99c-21459579b84f" containerName="istio-proxy" Jul 17 21:40:49.053436 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.053427 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7676a95-b974-4709-a99c-21459579b84f" containerName="istio-proxy" Jul 17 21:40:49.053513 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.053437 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7676a95-b974-4709-a99c-21459579b84f" containerName="istio-proxy" Jul 17 21:40:49.053513 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.053444 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7676a95-b974-4709-a99c-21459579b84f" containerName="istio-proxy" Jul 17 21:40:49.053513 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.053505 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7676a95-b974-4709-a99c-21459579b84f" containerName="istio-proxy" Jul 17 21:40:49.053609 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.053515 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7676a95-b974-4709-a99c-21459579b84f" containerName="istio-proxy" Jul 17 21:40:49.058001 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.057984 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:49.060861 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.060839 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-5662f7-openshift-default-dockercfg-f7f7g\"" Jul 17 21:40:49.072229 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.072171 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms"] Jul 17 21:40:49.102493 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.102439 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-workload-certs\") pod \"e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:49.102622 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.102532 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istio-token\") pod \"e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:49.102622 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.102566 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-workload-socket\") pod \"e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:49.102622 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.102588 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istio-envoy\") pod \"e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:49.102787 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.102710 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n9kd\" (UniqueName: \"kubernetes.io/projected/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-kube-api-access-6n9kd\") pod \"e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:49.102787 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.102773 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istio-data\") pod \"e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:49.102948 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.102801 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-credential-socket\") pod \"e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:49.102948 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.102841 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istio-podinfo\") pod \"e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:49.102948 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.102924 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istiod-ca-cert\") pod \"e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:49.204308 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.204271 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n9kd\" (UniqueName: \"kubernetes.io/projected/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-kube-api-access-6n9kd\") pod \"e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:49.204507 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.204322 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istio-data\") pod \"e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:49.204507 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.204343 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-credential-socket\") pod \"e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:49.204507 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.204369 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istio-podinfo\") pod \"e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:49.204507 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.204401 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istiod-ca-cert\") pod \"e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:49.204507 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.204448 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-workload-certs\") pod \"e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:49.204507 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.204469 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istio-token\") pod \"e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:49.204825 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.204560 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-workload-socket\") pod \"e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:49.204825 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.204593 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istio-envoy\") pod \"e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:49.204825 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.204732 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istio-data\") pod \"e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:49.205050 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.205024 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-credential-socket\") pod \"e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:49.205050 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.205040 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-workload-socket\") pod \"e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:49.205214 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.205082 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-workload-certs\") pod \"e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:49.205380 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.205350 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istiod-ca-cert\") pod \"e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:49.206856 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.206838 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istio-envoy\") pod \"e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:49.207197 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.207161 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istio-podinfo\") pod \"e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:49.213806 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.213785 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istio-token\") pod \"e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:49.214068 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.214050 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n9kd\" (UniqueName: \"kubernetes.io/projected/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-kube-api-access-6n9kd\") pod \"e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:49.368387 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.368328 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:49.511403 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.511380 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms"] Jul 17 21:40:49.512774 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:40:49.512747 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50d5ba67_3fe9_4b52_81fa_50a7c97b5935.slice/crio-d95d0503ccdb5bfaab05ba65aa4fb61509c734d33e5a4a20a750f07044758923 WatchSource:0}: Error finding container d95d0503ccdb5bfaab05ba65aa4fb61509c734d33e5a4a20a750f07044758923: Status 404 returned error can't find the container with id d95d0503ccdb5bfaab05ba65aa4fb61509c734d33e5a4a20a750f07044758923 Jul 17 21:40:49.515011 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.514978 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:40:49.515074 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.515043 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:40:49.515113 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.515072 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:40:49.942083 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.940037 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" event={"ID":"50d5ba67-3fe9-4b52-81fa-50a7c97b5935","Type":"ContainerStarted","Data":"a9d31b3fe7834b39b24077dd1a5a1703c8959a29c2e21d073f3c88ebc30e7126"} Jul 17 21:40:49.942083 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.940107 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" event={"ID":"50d5ba67-3fe9-4b52-81fa-50a7c97b5935","Type":"ContainerStarted","Data":"d95d0503ccdb5bfaab05ba65aa4fb61509c734d33e5a4a20a750f07044758923"} Jul 17 21:40:49.967527 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:49.967466 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" podStartSLOduration=0.967445809 podStartE2EDuration="967.445809ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:40:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:40:49.963990031 +0000 UTC m=+2222.561672697" watchObservedRunningTime="2026-07-17 21:40:49.967445809 +0000 UTC m=+2222.565128454" Jul 17 21:40:50.369499 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:50.369469 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:50.374548 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:50.374516 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:50.945767 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:50.945734 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:50.946779 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:50.946759 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:40:59.071697 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:59.071164 2580 patch_prober.go:28] interesting pod/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": read tcp 10.133.0.2:40282->10.133.0.51:15021: read: connection reset by peer" start-of-body= Jul 17 21:40:59.071697 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:40:59.071245 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" podUID="f08bc908-e3ee-402e-b2a6-9b838224dbfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": read tcp 10.133.0.2:40282->10.133.0.51:15021: read: connection reset by peer" Jul 17 21:41:00.003307 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:00.003267 2580 generic.go:356] "Generic (PLEG): container finished" podID="f08bc908-e3ee-402e-b2a6-9b838224dbfe" containerID="bb9382bbf4e43914716c4424854fcac4220de7108185aa64db94542d820beec9" exitCode=0 Jul 17 21:41:00.003515 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:00.003342 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" event={"ID":"f08bc908-e3ee-402e-b2a6-9b838224dbfe","Type":"ContainerDied","Data":"bb9382bbf4e43914716c4424854fcac4220de7108185aa64db94542d820beec9"} Jul 17 21:41:00.003813 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:00.003800 2580 scope.go:117] "RemoveContainer" containerID="bb9382bbf4e43914716c4424854fcac4220de7108185aa64db94542d820beec9" Jul 17 21:41:00.004888 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:00.004858 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:41:00.004963 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:00.004947 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:41:00.005004 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:00.004986 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:41:01.011299 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:01.011248 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" event={"ID":"f08bc908-e3ee-402e-b2a6-9b838224dbfe","Type":"ContainerStarted","Data":"8fb39735227ccbd5d73ab958882871246a165dde04fbf7325eaf7f52793173fe"} Jul 17 21:41:01.982366 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:01.982326 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:41:01.982763 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:01.982673 2580 patch_prober.go:28] interesting pod/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 17 21:41:01.982934 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:01.982909 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" podUID="f08bc908-e3ee-402e-b2a6-9b838224dbfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 17 21:41:02.983780 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:02.983716 2580 patch_prober.go:28] interesting pod/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 17 21:41:02.986325 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:02.984383 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" podUID="f08bc908-e3ee-402e-b2a6-9b838224dbfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 17 21:41:03.983001 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:03.982962 2580 patch_prober.go:28] interesting pod/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 17 21:41:03.983307 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:03.983274 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" podUID="f08bc908-e3ee-402e-b2a6-9b838224dbfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 17 21:41:04.983014 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:04.982973 2580 patch_prober.go:28] interesting pod/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 17 21:41:04.983465 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:04.983031 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" podUID="f08bc908-e3ee-402e-b2a6-9b838224dbfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 17 21:41:05.986905 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:05.986870 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:41:05.987459 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:05.987218 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:41:05.987955 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:05.987934 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:41:06.988367 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:06.988319 2580 patch_prober.go:28] interesting pod/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 17 21:41:06.988894 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:06.988389 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" podUID="50d5ba67-3fe9-4b52-81fa-50a7c97b5935" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 17 21:41:08.054749 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:08.054719 2580 generic.go:356] "Generic (PLEG): container finished" podID="50d5ba67-3fe9-4b52-81fa-50a7c97b5935" containerID="a9d31b3fe7834b39b24077dd1a5a1703c8959a29c2e21d073f3c88ebc30e7126" exitCode=0 Jul 17 21:41:08.055164 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:08.054769 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" event={"ID":"50d5ba67-3fe9-4b52-81fa-50a7c97b5935","Type":"ContainerDied","Data":"a9d31b3fe7834b39b24077dd1a5a1703c8959a29c2e21d073f3c88ebc30e7126"} Jul 17 21:41:08.055236 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:08.055218 2580 scope.go:117] "RemoveContainer" containerID="a9d31b3fe7834b39b24077dd1a5a1703c8959a29c2e21d073f3c88ebc30e7126" Jul 17 21:41:08.056258 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:08.056227 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:41:08.056348 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:08.056322 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:41:08.056390 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:08.056360 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:41:09.064506 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:09.064466 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" event={"ID":"50d5ba67-3fe9-4b52-81fa-50a7c97b5935","Type":"ContainerStarted","Data":"b1e426c0cfb296d3cd58d0a2524fd707e50d24824aaee3058bccaa3edf56ae32"} Jul 17 21:41:09.369059 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:09.368968 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:41:09.369241 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:09.369070 2580 patch_prober.go:28] interesting pod/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 17 21:41:09.369241 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:09.369107 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" podUID="50d5ba67-3fe9-4b52-81fa-50a7c97b5935" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 17 21:41:10.369557 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:10.369468 2580 patch_prober.go:28] interesting pod/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 17 21:41:10.369557 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:10.369537 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" podUID="50d5ba67-3fe9-4b52-81fa-50a7c97b5935" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 17 21:41:11.369440 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:11.369395 2580 patch_prober.go:28] interesting pod/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 17 21:41:11.369701 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:11.369455 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" podUID="50d5ba67-3fe9-4b52-81fa-50a7c97b5935" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 17 21:41:12.369658 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:12.369618 2580 patch_prober.go:28] interesting pod/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 17 21:41:12.369857 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:12.369679 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" podUID="50d5ba67-3fe9-4b52-81fa-50a7c97b5935" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 17 21:41:13.372545 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:13.372514 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:41:13.372913 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:13.372892 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:41:13.373625 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:13.373603 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:41:31.530171 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:31.530137 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb"] Jul 17 21:41:31.530684 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:31.530392 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" podUID="f08bc908-e3ee-402e-b2a6-9b838224dbfe" containerName="istio-proxy" containerID="cri-o://8fb39735227ccbd5d73ab958882871246a165dde04fbf7325eaf7f52793173fe" gracePeriod=30 Jul 17 21:41:35.990265 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:35.990221 2580 patch_prober.go:28] interesting pod/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 17 21:41:35.990671 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:35.990313 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" podUID="f08bc908-e3ee-402e-b2a6-9b838224dbfe" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 17 21:41:36.789959 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:36.789929 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:41:36.884213 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:36.884147 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istiod-ca-cert\") pod \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " Jul 17 21:41:36.884443 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:36.884259 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istio-podinfo\") pod \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " Jul 17 21:41:36.884443 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:36.884282 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxrkf\" (UniqueName: \"kubernetes.io/projected/f08bc908-e3ee-402e-b2a6-9b838224dbfe-kube-api-access-fxrkf\") pod \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " Jul 17 21:41:36.884443 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:36.884335 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-credential-socket\") pod \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " Jul 17 21:41:36.884443 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:36.884353 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-workload-certs\") pod \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " Jul 17 21:41:36.884443 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:36.884386 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istio-envoy\") pod \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " Jul 17 21:41:36.884443 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:36.884421 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-workload-socket\") pod \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " Jul 17 21:41:36.884768 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:36.884451 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istio-token\") pod \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " Jul 17 21:41:36.884768 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:36.884516 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istio-data\") pod \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\" (UID: \"f08bc908-e3ee-402e-b2a6-9b838224dbfe\") " Jul 17 21:41:36.884768 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:36.884683 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f08bc908-e3ee-402e-b2a6-9b838224dbfe" (UID: "f08bc908-e3ee-402e-b2a6-9b838224dbfe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:41:36.884768 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:36.884688 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f08bc908-e3ee-402e-b2a6-9b838224dbfe" (UID: "f08bc908-e3ee-402e-b2a6-9b838224dbfe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:41:36.884768 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:36.884734 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f08bc908-e3ee-402e-b2a6-9b838224dbfe" (UID: "f08bc908-e3ee-402e-b2a6-9b838224dbfe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:41:36.885052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:36.884919 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f08bc908-e3ee-402e-b2a6-9b838224dbfe" (UID: "f08bc908-e3ee-402e-b2a6-9b838224dbfe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:41:36.885052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:36.884945 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-credential-socket\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:41:36.885052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:36.884966 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-workload-certs\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:41:36.885052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:36.884981 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istiod-ca-cert\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:41:36.885461 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:36.885440 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istio-data" (OuterVolumeSpecName: "istio-data") pod "f08bc908-e3ee-402e-b2a6-9b838224dbfe" (UID: "f08bc908-e3ee-402e-b2a6-9b838224dbfe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:41:36.886694 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:36.886668 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f08bc908-e3ee-402e-b2a6-9b838224dbfe-kube-api-access-fxrkf" (OuterVolumeSpecName: "kube-api-access-fxrkf") pod "f08bc908-e3ee-402e-b2a6-9b838224dbfe" (UID: "f08bc908-e3ee-402e-b2a6-9b838224dbfe"). InnerVolumeSpecName "kube-api-access-fxrkf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:41:36.886809 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:36.886717 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istio-token" (OuterVolumeSpecName: "istio-token") pod "f08bc908-e3ee-402e-b2a6-9b838224dbfe" (UID: "f08bc908-e3ee-402e-b2a6-9b838224dbfe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:41:36.887028 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:36.886999 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f08bc908-e3ee-402e-b2a6-9b838224dbfe" (UID: "f08bc908-e3ee-402e-b2a6-9b838224dbfe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:41:36.887028 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:36.887013 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f08bc908-e3ee-402e-b2a6-9b838224dbfe" (UID: "f08bc908-e3ee-402e-b2a6-9b838224dbfe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 21:41:36.985899 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:36.985851 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-workload-socket\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:41:36.985899 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:36.985889 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istio-token\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:41:36.985899 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:36.985905 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istio-data\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:41:36.986161 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:36.985916 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istio-podinfo\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:41:36.986161 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:36.985928 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxrkf\" (UniqueName: \"kubernetes.io/projected/f08bc908-e3ee-402e-b2a6-9b838224dbfe-kube-api-access-fxrkf\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:41:36.986161 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:36.985944 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f08bc908-e3ee-402e-b2a6-9b838224dbfe-istio-envoy\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:41:37.224865 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:37.224775 2580 generic.go:356] "Generic (PLEG): container finished" podID="f08bc908-e3ee-402e-b2a6-9b838224dbfe" containerID="8fb39735227ccbd5d73ab958882871246a165dde04fbf7325eaf7f52793173fe" exitCode=0 Jul 17 21:41:37.224865 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:37.224825 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" Jul 17 21:41:37.225463 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:37.224859 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" event={"ID":"f08bc908-e3ee-402e-b2a6-9b838224dbfe","Type":"ContainerDied","Data":"8fb39735227ccbd5d73ab958882871246a165dde04fbf7325eaf7f52793173fe"} Jul 17 21:41:37.225463 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:37.224930 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb" event={"ID":"f08bc908-e3ee-402e-b2a6-9b838224dbfe","Type":"ContainerDied","Data":"82a8c49979b39a28a15eef763fb7e3a9baf455c486aabd5b04d815650eb54f4e"} Jul 17 21:41:37.225463 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:37.224963 2580 scope.go:117] "RemoveContainer" containerID="8fb39735227ccbd5d73ab958882871246a165dde04fbf7325eaf7f52793173fe" Jul 17 21:41:37.235289 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:37.235274 2580 scope.go:117] "RemoveContainer" containerID="bb9382bbf4e43914716c4424854fcac4220de7108185aa64db94542d820beec9" Jul 17 21:41:37.244095 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:37.244074 2580 scope.go:117] "RemoveContainer" containerID="8fb39735227ccbd5d73ab958882871246a165dde04fbf7325eaf7f52793173fe" Jul 17 21:41:37.244386 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:41:37.244366 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fb39735227ccbd5d73ab958882871246a165dde04fbf7325eaf7f52793173fe\": container with ID starting with 8fb39735227ccbd5d73ab958882871246a165dde04fbf7325eaf7f52793173fe not found: ID does not exist" containerID="8fb39735227ccbd5d73ab958882871246a165dde04fbf7325eaf7f52793173fe" Jul 17 21:41:37.244442 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:37.244395 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fb39735227ccbd5d73ab958882871246a165dde04fbf7325eaf7f52793173fe"} err="failed to get container status \"8fb39735227ccbd5d73ab958882871246a165dde04fbf7325eaf7f52793173fe\": rpc error: code = NotFound desc = could not find container \"8fb39735227ccbd5d73ab958882871246a165dde04fbf7325eaf7f52793173fe\": container with ID starting with 8fb39735227ccbd5d73ab958882871246a165dde04fbf7325eaf7f52793173fe not found: ID does not exist" Jul 17 21:41:37.244442 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:37.244426 2580 scope.go:117] "RemoveContainer" containerID="bb9382bbf4e43914716c4424854fcac4220de7108185aa64db94542d820beec9" Jul 17 21:41:37.244672 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:41:37.244650 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb9382bbf4e43914716c4424854fcac4220de7108185aa64db94542d820beec9\": container with ID starting with bb9382bbf4e43914716c4424854fcac4220de7108185aa64db94542d820beec9 not found: ID does not exist" containerID="bb9382bbf4e43914716c4424854fcac4220de7108185aa64db94542d820beec9" Jul 17 21:41:37.244733 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:37.244683 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb9382bbf4e43914716c4424854fcac4220de7108185aa64db94542d820beec9"} err="failed to get container status \"bb9382bbf4e43914716c4424854fcac4220de7108185aa64db94542d820beec9\": rpc error: code = NotFound desc = could not find container \"bb9382bbf4e43914716c4424854fcac4220de7108185aa64db94542d820beec9\": container with ID starting with bb9382bbf4e43914716c4424854fcac4220de7108185aa64db94542d820beec9 not found: ID does not exist" Jul 17 21:41:37.249653 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:37.249627 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb"] Jul 17 21:41:37.253585 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:37.253562 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-08c323-openshift-default-cb9b796b5-vsnpb"] Jul 17 21:41:37.859280 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:37.859245 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f08bc908-e3ee-402e-b2a6-9b838224dbfe" path="/var/lib/kubelet/pods/f08bc908-e3ee-402e-b2a6-9b838224dbfe/volumes" Jul 17 21:41:58.760983 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:58.760949 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms"] Jul 17 21:41:58.761434 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:58.761231 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" podUID="50d5ba67-3fe9-4b52-81fa-50a7c97b5935" containerName="istio-proxy" containerID="cri-o://b1e426c0cfb296d3cd58d0a2524fd707e50d24824aaee3058bccaa3edf56ae32" gracePeriod=30 Jul 17 21:41:59.656394 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.656361 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8"] Jul 17 21:41:59.656810 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.656792 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f08bc908-e3ee-402e-b2a6-9b838224dbfe" containerName="istio-proxy" Jul 17 21:41:59.656911 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.656812 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f08bc908-e3ee-402e-b2a6-9b838224dbfe" containerName="istio-proxy" Jul 17 21:41:59.656911 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.656843 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f08bc908-e3ee-402e-b2a6-9b838224dbfe" containerName="istio-proxy" Jul 17 21:41:59.656911 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.656851 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f08bc908-e3ee-402e-b2a6-9b838224dbfe" containerName="istio-proxy" Jul 17 21:41:59.657073 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.656961 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f08bc908-e3ee-402e-b2a6-9b838224dbfe" containerName="istio-proxy" Jul 17 21:41:59.660323 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.660302 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:41:59.663069 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.663047 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-f631c8-openshift-default-dockercfg-8jhbq\"" Jul 17 21:41:59.672434 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.672408 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8"] Jul 17 21:41:59.702434 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.702411 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istiod-ca-cert\") pod \"e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:41:59.702538 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.702442 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-workload-socket\") pod \"e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:41:59.702538 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.702463 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgj2g\" (UniqueName: \"kubernetes.io/projected/b58c45ca-b55d-442f-af45-d8eb8d329aa6-kube-api-access-xgj2g\") pod \"e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:41:59.702620 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.702540 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istio-data\") pod \"e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:41:59.702620 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.702578 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-credential-socket\") pod \"e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:41:59.702620 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.702598 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-workload-certs\") pod \"e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:41:59.702768 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.702628 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istio-envoy\") pod \"e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:41:59.702768 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.702689 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istio-token\") pod \"e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:41:59.702768 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.702709 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istio-podinfo\") pod \"e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:41:59.804081 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.804051 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istio-token\") pod \"e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:41:59.804081 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.804083 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istio-podinfo\") pod \"e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:41:59.804575 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.804116 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istiod-ca-cert\") pod \"e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:41:59.804575 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.804136 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-workload-socket\") pod \"e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:41:59.804575 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.804251 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgj2g\" (UniqueName: \"kubernetes.io/projected/b58c45ca-b55d-442f-af45-d8eb8d329aa6-kube-api-access-xgj2g\") pod \"e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:41:59.804575 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.804334 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istio-data\") pod \"e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:41:59.804575 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.804381 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-credential-socket\") pod \"e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:41:59.804575 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.804411 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-workload-certs\") pod \"e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:41:59.804575 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.804453 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istio-envoy\") pod \"e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:41:59.804575 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.804509 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-workload-socket\") pod \"e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:41:59.804987 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.804772 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-credential-socket\") pod \"e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:41:59.804987 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.804839 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-workload-certs\") pod \"e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:41:59.804987 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.804867 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istiod-ca-cert\") pod \"e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:41:59.804987 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.804877 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istio-data\") pod \"e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:41:59.806660 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.806635 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istio-envoy\") pod \"e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:41:59.806768 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.806711 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istio-podinfo\") pod \"e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:41:59.812603 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.812584 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istio-token\") pod \"e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:41:59.812892 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.812871 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgj2g\" (UniqueName: \"kubernetes.io/projected/b58c45ca-b55d-442f-af45-d8eb8d329aa6-kube-api-access-xgj2g\") pod \"e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:41:59.971392 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:41:59.971332 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:42:00.114828 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:00.114801 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8"] Jul 17 21:42:00.116418 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:42:00.116390 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58c45ca_b55d_442f_af45_d8eb8d329aa6.slice/crio-68312e9e51b654be8c99fde47529f741be54ab7a5b97322c369ff88aba573ea6 WatchSource:0}: Error finding container 68312e9e51b654be8c99fde47529f741be54ab7a5b97322c369ff88aba573ea6: Status 404 returned error can't find the container with id 68312e9e51b654be8c99fde47529f741be54ab7a5b97322c369ff88aba573ea6 Jul 17 21:42:00.118533 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:00.118498 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:42:00.118609 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:00.118564 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:42:00.118609 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:00.118596 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:42:00.357441 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:00.357407 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" event={"ID":"b58c45ca-b55d-442f-af45-d8eb8d329aa6","Type":"ContainerStarted","Data":"0fa7e47804d520a14a6b089962bd2e105e63acf0c1fbe15ca90903efe695abbd"} Jul 17 21:42:00.357615 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:00.357471 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" event={"ID":"b58c45ca-b55d-442f-af45-d8eb8d329aa6","Type":"ContainerStarted","Data":"68312e9e51b654be8c99fde47529f741be54ab7a5b97322c369ff88aba573ea6"} Jul 17 21:42:00.384085 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:00.384037 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" podStartSLOduration=1.384020725 podStartE2EDuration="1.384020725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:41:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:42:00.381486092 +0000 UTC m=+2292.979168761" watchObservedRunningTime="2026-07-17 21:42:00.384020725 +0000 UTC m=+2292.981703367" Jul 17 21:42:00.971547 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:00.971514 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:42:01.977426 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:01.977391 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:42:02.369318 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:02.369285 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:42:02.369997 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:02.369980 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:42:04.006659 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.006633 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:42:04.047493 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.047406 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-workload-socket\") pod \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " Jul 17 21:42:04.047614 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.047530 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istio-data\") pod \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " Jul 17 21:42:04.047614 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.047602 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istio-podinfo\") pod \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " Jul 17 21:42:04.047614 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.047601 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "50d5ba67-3fe9-4b52-81fa-50a7c97b5935" (UID: "50d5ba67-3fe9-4b52-81fa-50a7c97b5935"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:42:04.047745 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.047618 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istiod-ca-cert\") pod \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " Jul 17 21:42:04.047745 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.047639 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istio-token\") pod \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " Jul 17 21:42:04.047745 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.047659 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6n9kd\" (UniqueName: \"kubernetes.io/projected/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-kube-api-access-6n9kd\") pod \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " Jul 17 21:42:04.047956 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.047794 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-credential-socket\") pod \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " Jul 17 21:42:04.047956 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.047843 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-workload-certs\") pod \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " Jul 17 21:42:04.047956 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.047887 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istio-envoy\") pod \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\" (UID: \"50d5ba67-3fe9-4b52-81fa-50a7c97b5935\") " Jul 17 21:42:04.048165 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.048142 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "50d5ba67-3fe9-4b52-81fa-50a7c97b5935" (UID: "50d5ba67-3fe9-4b52-81fa-50a7c97b5935"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:42:04.048253 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.048081 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "50d5ba67-3fe9-4b52-81fa-50a7c97b5935" (UID: "50d5ba67-3fe9-4b52-81fa-50a7c97b5935"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:42:04.048356 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.048309 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istiod-ca-cert\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:42:04.048431 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.048358 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-credential-socket\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:42:04.048431 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.048373 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-workload-socket\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:42:04.048431 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.048382 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "50d5ba67-3fe9-4b52-81fa-50a7c97b5935" (UID: "50d5ba67-3fe9-4b52-81fa-50a7c97b5935"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:42:04.048590 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.048503 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istio-data" (OuterVolumeSpecName: "istio-data") pod "50d5ba67-3fe9-4b52-81fa-50a7c97b5935" (UID: "50d5ba67-3fe9-4b52-81fa-50a7c97b5935"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:42:04.049850 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.049827 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-kube-api-access-6n9kd" (OuterVolumeSpecName: "kube-api-access-6n9kd") pod "50d5ba67-3fe9-4b52-81fa-50a7c97b5935" (UID: "50d5ba67-3fe9-4b52-81fa-50a7c97b5935"). InnerVolumeSpecName "kube-api-access-6n9kd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:42:04.049955 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.049936 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istio-token" (OuterVolumeSpecName: "istio-token") pod "50d5ba67-3fe9-4b52-81fa-50a7c97b5935" (UID: "50d5ba67-3fe9-4b52-81fa-50a7c97b5935"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:42:04.050050 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.050030 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "50d5ba67-3fe9-4b52-81fa-50a7c97b5935" (UID: "50d5ba67-3fe9-4b52-81fa-50a7c97b5935"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 21:42:04.050547 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.050525 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "50d5ba67-3fe9-4b52-81fa-50a7c97b5935" (UID: "50d5ba67-3fe9-4b52-81fa-50a7c97b5935"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:42:04.148754 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.148726 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istio-data\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:42:04.148754 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.148751 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istio-podinfo\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:42:04.148892 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.148764 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istio-token\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:42:04.148892 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.148776 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6n9kd\" (UniqueName: \"kubernetes.io/projected/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-kube-api-access-6n9kd\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:42:04.148892 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.148789 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-workload-certs\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:42:04.148892 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.148802 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50d5ba67-3fe9-4b52-81fa-50a7c97b5935-istio-envoy\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:42:04.383433 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.383373 2580 generic.go:356] "Generic (PLEG): container finished" podID="50d5ba67-3fe9-4b52-81fa-50a7c97b5935" containerID="b1e426c0cfb296d3cd58d0a2524fd707e50d24824aaee3058bccaa3edf56ae32" exitCode=0 Jul 17 21:42:04.383433 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.383415 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" Jul 17 21:42:04.383612 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.383469 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" event={"ID":"50d5ba67-3fe9-4b52-81fa-50a7c97b5935","Type":"ContainerDied","Data":"b1e426c0cfb296d3cd58d0a2524fd707e50d24824aaee3058bccaa3edf56ae32"} Jul 17 21:42:04.383612 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.383537 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms" event={"ID":"50d5ba67-3fe9-4b52-81fa-50a7c97b5935","Type":"ContainerDied","Data":"d95d0503ccdb5bfaab05ba65aa4fb61509c734d33e5a4a20a750f07044758923"} Jul 17 21:42:04.383612 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.383567 2580 scope.go:117] "RemoveContainer" containerID="b1e426c0cfb296d3cd58d0a2524fd707e50d24824aaee3058bccaa3edf56ae32" Jul 17 21:42:04.392746 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.392730 2580 scope.go:117] "RemoveContainer" containerID="a9d31b3fe7834b39b24077dd1a5a1703c8959a29c2e21d073f3c88ebc30e7126" Jul 17 21:42:04.400347 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.400315 2580 scope.go:117] "RemoveContainer" containerID="b1e426c0cfb296d3cd58d0a2524fd707e50d24824aaee3058bccaa3edf56ae32" Jul 17 21:42:04.400592 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:42:04.400568 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1e426c0cfb296d3cd58d0a2524fd707e50d24824aaee3058bccaa3edf56ae32\": container with ID starting with b1e426c0cfb296d3cd58d0a2524fd707e50d24824aaee3058bccaa3edf56ae32 not found: ID does not exist" containerID="b1e426c0cfb296d3cd58d0a2524fd707e50d24824aaee3058bccaa3edf56ae32" Jul 17 21:42:04.400680 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.400597 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1e426c0cfb296d3cd58d0a2524fd707e50d24824aaee3058bccaa3edf56ae32"} err="failed to get container status \"b1e426c0cfb296d3cd58d0a2524fd707e50d24824aaee3058bccaa3edf56ae32\": rpc error: code = NotFound desc = could not find container \"b1e426c0cfb296d3cd58d0a2524fd707e50d24824aaee3058bccaa3edf56ae32\": container with ID starting with b1e426c0cfb296d3cd58d0a2524fd707e50d24824aaee3058bccaa3edf56ae32 not found: ID does not exist" Jul 17 21:42:04.400680 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.400614 2580 scope.go:117] "RemoveContainer" containerID="a9d31b3fe7834b39b24077dd1a5a1703c8959a29c2e21d073f3c88ebc30e7126" Jul 17 21:42:04.400847 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:42:04.400830 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9d31b3fe7834b39b24077dd1a5a1703c8959a29c2e21d073f3c88ebc30e7126\": container with ID starting with a9d31b3fe7834b39b24077dd1a5a1703c8959a29c2e21d073f3c88ebc30e7126 not found: ID does not exist" containerID="a9d31b3fe7834b39b24077dd1a5a1703c8959a29c2e21d073f3c88ebc30e7126" Jul 17 21:42:04.400886 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.400851 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9d31b3fe7834b39b24077dd1a5a1703c8959a29c2e21d073f3c88ebc30e7126"} err="failed to get container status \"a9d31b3fe7834b39b24077dd1a5a1703c8959a29c2e21d073f3c88ebc30e7126\": rpc error: code = NotFound desc = could not find container \"a9d31b3fe7834b39b24077dd1a5a1703c8959a29c2e21d073f3c88ebc30e7126\": container with ID starting with a9d31b3fe7834b39b24077dd1a5a1703c8959a29c2e21d073f3c88ebc30e7126 not found: ID does not exist" Jul 17 21:42:04.406967 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.406948 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms"] Jul 17 21:42:04.412930 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:04.412909 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-5662f7-openshift-default-5989d8dc7c-vt2ms"] Jul 17 21:42:05.859936 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:05.859897 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50d5ba67-3fe9-4b52-81fa-50a7c97b5935" path="/var/lib/kubelet/pods/50d5ba67-3fe9-4b52-81fa-50a7c97b5935/volumes" Jul 17 21:42:07.573472 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.573415 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j"] Jul 17 21:42:07.573871 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.573836 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50d5ba67-3fe9-4b52-81fa-50a7c97b5935" containerName="istio-proxy" Jul 17 21:42:07.573871 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.573847 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="50d5ba67-3fe9-4b52-81fa-50a7c97b5935" containerName="istio-proxy" Jul 17 21:42:07.573871 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.573862 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50d5ba67-3fe9-4b52-81fa-50a7c97b5935" containerName="istio-proxy" Jul 17 21:42:07.573871 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.573867 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="50d5ba67-3fe9-4b52-81fa-50a7c97b5935" containerName="istio-proxy" Jul 17 21:42:07.574027 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.573927 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="50d5ba67-3fe9-4b52-81fa-50a7c97b5935" containerName="istio-proxy" Jul 17 21:42:07.574027 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.573934 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f08bc908-e3ee-402e-b2a6-9b838224dbfe" containerName="istio-proxy" Jul 17 21:42:07.574027 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.573945 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="50d5ba67-3fe9-4b52-81fa-50a7c97b5935" containerName="istio-proxy" Jul 17 21:42:07.578534 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.578511 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:07.581556 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.581533 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-d5e469-openshift-default-dockercfg-75qwn\"" Jul 17 21:42:07.594012 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.593989 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j"] Jul 17 21:42:07.682346 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.682306 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-credential-socket\") pod \"e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:07.682346 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.682350 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hghb2\" (UniqueName: \"kubernetes.io/projected/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-kube-api-access-hghb2\") pod \"e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:07.682584 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.682448 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-workload-socket\") pod \"e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:07.682584 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.682488 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istiod-ca-cert\") pod \"e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:07.682584 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.682519 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istio-data\") pod \"e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:07.682584 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.682552 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-workload-certs\") pod \"e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:07.682776 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.682642 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istio-envoy\") pod \"e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:07.682776 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.682676 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istio-token\") pod \"e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:07.682776 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.682729 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istio-podinfo\") pod \"e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:07.783294 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.783246 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-workload-certs\") pod \"e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:07.783506 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.783331 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istio-envoy\") pod \"e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:07.783506 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.783352 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istio-token\") pod \"e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:07.783506 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.783376 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istio-podinfo\") pod \"e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:07.783506 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.783412 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-credential-socket\") pod \"e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:07.783506 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.783449 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hghb2\" (UniqueName: \"kubernetes.io/projected/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-kube-api-access-hghb2\") pod \"e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:07.783805 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.783510 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-workload-socket\") pod \"e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:07.783805 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.783534 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istiod-ca-cert\") pod \"e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:07.783805 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.783560 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istio-data\") pod \"e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:07.783805 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.783634 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-workload-certs\") pod \"e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:07.783974 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.783848 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-credential-socket\") pod \"e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:07.784025 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.783997 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-workload-socket\") pod \"e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:07.784025 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.784009 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istio-data\") pod \"e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:07.784361 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.784338 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istiod-ca-cert\") pod \"e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:07.785739 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.785708 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istio-envoy\") pod \"e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:07.785924 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.785906 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istio-podinfo\") pod \"e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:07.794371 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.794344 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hghb2\" (UniqueName: \"kubernetes.io/projected/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-kube-api-access-hghb2\") pod \"e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:07.794494 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.794466 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istio-token\") pod \"e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:07.888494 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:07.888401 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:08.063016 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:08.062980 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j"] Jul 17 21:42:08.065758 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:42:08.065729 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e21828c_e4b2_468b_b66e_735a5f8bc5f6.slice/crio-60c316c4ca4fcc6a21191d0dbbdf06fb3ae332e5272091ea8d971d3241017ed4 WatchSource:0}: Error finding container 60c316c4ca4fcc6a21191d0dbbdf06fb3ae332e5272091ea8d971d3241017ed4: Status 404 returned error can't find the container with id 60c316c4ca4fcc6a21191d0dbbdf06fb3ae332e5272091ea8d971d3241017ed4 Jul 17 21:42:08.067824 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:08.067790 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:42:08.067899 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:08.067860 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:42:08.067899 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:08.067888 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:42:08.408224 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:08.408165 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" event={"ID":"1e21828c-e4b2-468b-b66e-735a5f8bc5f6","Type":"ContainerStarted","Data":"fc88e86f94fdb829941b67d152bc2f0b1810b2da4c7cb605afcc77e07aae6696"} Jul 17 21:42:08.408397 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:08.408240 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" event={"ID":"1e21828c-e4b2-468b-b66e-735a5f8bc5f6","Type":"ContainerStarted","Data":"60c316c4ca4fcc6a21191d0dbbdf06fb3ae332e5272091ea8d971d3241017ed4"} Jul 17 21:42:08.434239 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:08.434168 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" podStartSLOduration=1.434148068 podStartE2EDuration="1.434148068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:42:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:42:08.433581035 +0000 UTC m=+2301.031263679" watchObservedRunningTime="2026-07-17 21:42:08.434148068 +0000 UTC m=+2301.031830712" Jul 17 21:42:08.888998 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:08.888966 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:09.894055 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:09.894028 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:10.419253 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:10.419219 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:10.420279 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:10.420259 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:14.444671 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:14.444631 2580 generic.go:356] "Generic (PLEG): container finished" podID="b58c45ca-b55d-442f-af45-d8eb8d329aa6" containerID="0fa7e47804d520a14a6b089962bd2e105e63acf0c1fbe15ca90903efe695abbd" exitCode=0 Jul 17 21:42:14.445246 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:14.444700 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" event={"ID":"b58c45ca-b55d-442f-af45-d8eb8d329aa6","Type":"ContainerDied","Data":"0fa7e47804d520a14a6b089962bd2e105e63acf0c1fbe15ca90903efe695abbd"} Jul 17 21:42:14.445246 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:14.445228 2580 scope.go:117] "RemoveContainer" containerID="0fa7e47804d520a14a6b089962bd2e105e63acf0c1fbe15ca90903efe695abbd" Jul 17 21:42:14.446286 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:14.446255 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:42:14.446393 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:14.446342 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:42:14.446460 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:14.446393 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:42:15.459603 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:15.459559 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" event={"ID":"b58c45ca-b55d-442f-af45-d8eb8d329aa6","Type":"ContainerStarted","Data":"4712f318c48c351979fe86d5b233bcc62229fcf6a237ff84f172a639b6d29726"} Jul 17 21:42:15.972110 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:15.972077 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:42:15.973105 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:15.973078 2580 patch_prober.go:28] interesting pod/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 17 21:42:15.973241 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:15.973139 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" podUID="b58c45ca-b55d-442f-af45-d8eb8d329aa6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 17 21:42:16.971758 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:16.971717 2580 patch_prober.go:28] interesting pod/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 17 21:42:16.972213 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:16.971789 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" podUID="b58c45ca-b55d-442f-af45-d8eb8d329aa6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 17 21:42:17.369341 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:17.369310 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:42:17.972168 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:17.972127 2580 patch_prober.go:28] interesting pod/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 17 21:42:17.972571 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:17.972212 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" podUID="b58c45ca-b55d-442f-af45-d8eb8d329aa6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 17 21:42:18.972076 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:18.972012 2580 patch_prober.go:28] interesting pod/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 17 21:42:18.972311 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:18.972100 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" podUID="b58c45ca-b55d-442f-af45-d8eb8d329aa6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 17 21:42:19.975985 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:19.975947 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:42:19.976857 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:19.976839 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:42:25.420759 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:25.420733 2580 patch_prober.go:28] interesting pod/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 17 21:42:25.421080 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:25.420810 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" podUID="1e21828c-e4b2-468b-b66e-735a5f8bc5f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 17 21:42:25.519326 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:25.519296 2580 generic.go:356] "Generic (PLEG): container finished" podID="1e21828c-e4b2-468b-b66e-735a5f8bc5f6" containerID="fc88e86f94fdb829941b67d152bc2f0b1810b2da4c7cb605afcc77e07aae6696" exitCode=0 Jul 17 21:42:25.519441 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:25.519371 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" event={"ID":"1e21828c-e4b2-468b-b66e-735a5f8bc5f6","Type":"ContainerDied","Data":"fc88e86f94fdb829941b67d152bc2f0b1810b2da4c7cb605afcc77e07aae6696"} Jul 17 21:42:25.519773 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:25.519751 2580 scope.go:117] "RemoveContainer" containerID="fc88e86f94fdb829941b67d152bc2f0b1810b2da4c7cb605afcc77e07aae6696" Jul 17 21:42:25.520833 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:25.520801 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:42:25.520907 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:25.520887 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:42:25.520946 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:25.520934 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 21:42:26.527077 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:26.527039 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" event={"ID":"1e21828c-e4b2-468b-b66e-735a5f8bc5f6","Type":"ContainerStarted","Data":"f95b5da1df6520d0a5f486fddcf138291a48a74dd4eee88784286b30f4bbe8da"} Jul 17 21:42:26.889129 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:26.889094 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:26.889342 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:26.889319 2580 patch_prober.go:28] interesting pod/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 17 21:42:26.889394 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:26.889366 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" podUID="1e21828c-e4b2-468b-b66e-735a5f8bc5f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 17 21:42:27.889496 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:27.889458 2580 patch_prober.go:28] interesting pod/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 17 21:42:27.889872 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:27.889513 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" podUID="1e21828c-e4b2-468b-b66e-735a5f8bc5f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 17 21:42:28.889486 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:28.889446 2580 patch_prober.go:28] interesting pod/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 17 21:42:28.889670 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:28.889501 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" podUID="1e21828c-e4b2-468b-b66e-735a5f8bc5f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 17 21:42:29.889340 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:29.889301 2580 patch_prober.go:28] interesting pod/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Jul 17 21:42:29.889551 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:29.889376 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" podUID="1e21828c-e4b2-468b-b66e-735a5f8bc5f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Jul 17 21:42:30.893082 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:30.893045 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:30.893543 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:30.893456 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:30.894346 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:30.894318 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:42:48.109046 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:42:48.108976 2580 scope.go:117] "RemoveContainer" containerID="ca78128b0e7c067c4f654aeb1c18136574540942aa4df846dd95cd85e0e19ea8" Jul 17 21:43:48.072414 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:43:48.072387 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bk9fq_c7148bac-9a70-453b-a952-2a7a5e4a0ea6/console-operator/1.log" Jul 17 21:43:48.078242 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:43:48.078222 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lj5lm_6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd/ovn-acl-logging/0.log" Jul 17 21:43:48.080084 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:43:48.080063 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bk9fq_c7148bac-9a70-453b-a952-2a7a5e4a0ea6/console-operator/1.log" Jul 17 21:43:48.085614 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:43:48.085595 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lj5lm_6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd/ovn-acl-logging/0.log" Jul 17 21:45:00.140728 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:45:00.140693 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738745-l56mf"] Jul 17 21:45:00.145270 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:45:00.145247 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f631c8-29738745-fc24w"] Jul 17 21:45:00.145409 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:45:00.145371 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738745-l56mf" Jul 17 21:45:00.147921 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:45:00.147901 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-km5xb\"" Jul 17 21:45:00.148491 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:45:00.148474 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f631c8-29738745-fc24w" Jul 17 21:45:00.153094 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:45:00.153071 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738745-l56mf"] Jul 17 21:45:00.159691 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:45:00.159662 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738745-l56mf" Jul 17 21:45:00.160099 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:45:00.160071 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f631c8-29738745-fc24w"] Jul 17 21:45:00.170523 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:45:00.170500 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f631c8-29738745-fc24w" Jul 17 21:45:00.331612 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:45:00.331576 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f631c8-29738745-fc24w"] Jul 17 21:45:00.333137 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:45:00.333108 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d58f99f_402d_40f8_b9c2_8e0beca943e4.slice/crio-2ec82d00570c6a0dbe76536733c9d900e3318d64db52578f06917283336999bd WatchSource:0}: Error finding container 2ec82d00570c6a0dbe76536733c9d900e3318d64db52578f06917283336999bd: Status 404 returned error can't find the container with id 2ec82d00570c6a0dbe76536733c9d900e3318d64db52578f06917283336999bd Jul 17 21:45:00.356417 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:45:00.356397 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738745-l56mf"] Jul 17 21:45:00.357553 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:45:00.357525 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod207414bc_5666_4a84_8707_174333e753f5.slice/crio-4eadd303a899c389853391245bb1f3523740489c59e2b3cc793ec2808e9f3b8c WatchSource:0}: Error finding container 4eadd303a899c389853391245bb1f3523740489c59e2b3cc793ec2808e9f3b8c: Status 404 returned error can't find the container with id 4eadd303a899c389853391245bb1f3523740489c59e2b3cc793ec2808e9f3b8c Jul 17 21:45:00.366481 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:45:00.366442 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f631c8-29738745-fc24w" event={"ID":"0d58f99f-402d-40f8-b9c2-8e0beca943e4","Type":"ContainerStarted","Data":"2ec82d00570c6a0dbe76536733c9d900e3318d64db52578f06917283336999bd"} Jul 17 21:45:00.367563 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:45:00.367535 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738745-l56mf" event={"ID":"207414bc-5666-4a84-8707-174333e753f5","Type":"ContainerStarted","Data":"4eadd303a899c389853391245bb1f3523740489c59e2b3cc793ec2808e9f3b8c"} Jul 17 21:45:01.374648 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:45:01.374623 2580 generic.go:356] "Generic (PLEG): container finished" podID="0d58f99f-402d-40f8-b9c2-8e0beca943e4" containerID="0b0d9b7e7b285cfa505d355e601197e33c20dcdd54fe5bf481157639c63f598a" exitCode=0 Jul 17 21:45:01.374965 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:45:01.374709 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f631c8-29738745-fc24w" event={"ID":"0d58f99f-402d-40f8-b9c2-8e0beca943e4","Type":"ContainerDied","Data":"0b0d9b7e7b285cfa505d355e601197e33c20dcdd54fe5bf481157639c63f598a"} Jul 17 21:45:01.376175 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:45:01.376155 2580 generic.go:356] "Generic (PLEG): container finished" podID="207414bc-5666-4a84-8707-174333e753f5" containerID="3e1c8a4da241c92599cf4ec56e01df261d6ed59f45096984d8941794ac24ebe3" exitCode=0 Jul 17 21:45:01.376280 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:45:01.376197 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738745-l56mf" event={"ID":"207414bc-5666-4a84-8707-174333e753f5","Type":"ContainerDied","Data":"3e1c8a4da241c92599cf4ec56e01df261d6ed59f45096984d8941794ac24ebe3"} Jul 17 21:45:02.521943 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:45:02.521913 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738745-l56mf" Jul 17 21:45:02.524736 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:45:02.524718 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f631c8-29738745-fc24w" Jul 17 21:45:03.387539 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:45:03.387512 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f631c8-29738745-fc24w" Jul 17 21:45:03.387539 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:45:03.387531 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f631c8-29738745-fc24w" event={"ID":"0d58f99f-402d-40f8-b9c2-8e0beca943e4","Type":"ContainerDied","Data":"2ec82d00570c6a0dbe76536733c9d900e3318d64db52578f06917283336999bd"} Jul 17 21:45:03.387755 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:45:03.387575 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ec82d00570c6a0dbe76536733c9d900e3318d64db52578f06917283336999bd" Jul 17 21:45:03.388756 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:45:03.388738 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738745-l56mf" Jul 17 21:45:03.388889 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:45:03.388786 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738745-l56mf" event={"ID":"207414bc-5666-4a84-8707-174333e753f5","Type":"ContainerDied","Data":"4eadd303a899c389853391245bb1f3523740489c59e2b3cc793ec2808e9f3b8c"} Jul 17 21:45:03.388889 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:45:03.388830 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4eadd303a899c389853391245bb1f3523740489c59e2b3cc793ec2808e9f3b8c" Jul 17 21:46:48.159057 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:46:48.159026 2580 scope.go:117] "RemoveContainer" containerID="541cc1358ab46b559b11e00ba6c5114580d6724fcdfb969c8da5ad211a63360b" Jul 17 21:47:46.504058 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:47:46.504021 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f631c8-29738745-fc24w"] Jul 17 21:47:46.506507 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:47:46.506367 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f631c8-29738745-fc24w"] Jul 17 21:47:47.858833 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:47:47.858798 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d58f99f-402d-40f8-b9c2-8e0beca943e4" path="/var/lib/kubelet/pods/0d58f99f-402d-40f8-b9c2-8e0beca943e4/volumes" Jul 17 21:47:57.991811 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:47:57.991777 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8"] Jul 17 21:47:57.992404 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:47:57.992004 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" podUID="b58c45ca-b55d-442f-af45-d8eb8d329aa6" containerName="istio-proxy" containerID="cri-o://4712f318c48c351979fe86d5b233bcc62229fcf6a237ff84f172a639b6d29726" gracePeriod=30 Jul 17 21:48:03.239100 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.239075 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:48:03.281818 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.281746 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istiod-ca-cert\") pod \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " Jul 17 21:48:03.281818 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.281787 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istio-data\") pod \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " Jul 17 21:48:03.281818 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.281815 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-workload-socket\") pod \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " Jul 17 21:48:03.282075 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.281855 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-credential-socket\") pod \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " Jul 17 21:48:03.282075 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.281917 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgj2g\" (UniqueName: \"kubernetes.io/projected/b58c45ca-b55d-442f-af45-d8eb8d329aa6-kube-api-access-xgj2g\") pod \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " Jul 17 21:48:03.282075 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.281941 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-workload-certs\") pod \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " Jul 17 21:48:03.282075 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.281980 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istio-envoy\") pod \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " Jul 17 21:48:03.282075 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.281998 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istio-token\") pod \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " Jul 17 21:48:03.282075 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.282057 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istio-podinfo\") pod \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\" (UID: \"b58c45ca-b55d-442f-af45-d8eb8d329aa6\") " Jul 17 21:48:03.282405 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.282155 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b58c45ca-b55d-442f-af45-d8eb8d329aa6" (UID: "b58c45ca-b55d-442f-af45-d8eb8d329aa6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:48:03.282405 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.282169 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b58c45ca-b55d-442f-af45-d8eb8d329aa6" (UID: "b58c45ca-b55d-442f-af45-d8eb8d329aa6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:48:03.282405 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.282206 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b58c45ca-b55d-442f-af45-d8eb8d329aa6" (UID: "b58c45ca-b55d-442f-af45-d8eb8d329aa6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:48:03.282555 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.282406 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b58c45ca-b55d-442f-af45-d8eb8d329aa6" (UID: "b58c45ca-b55d-442f-af45-d8eb8d329aa6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:48:03.282555 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.282470 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istiod-ca-cert\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:48:03.282555 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.282488 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-workload-socket\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:48:03.282555 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.282501 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-credential-socket\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:48:03.282876 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.282852 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istio-data" (OuterVolumeSpecName: "istio-data") pod "b58c45ca-b55d-442f-af45-d8eb8d329aa6" (UID: "b58c45ca-b55d-442f-af45-d8eb8d329aa6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:48:03.284410 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.284382 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istio-token" (OuterVolumeSpecName: "istio-token") pod "b58c45ca-b55d-442f-af45-d8eb8d329aa6" (UID: "b58c45ca-b55d-442f-af45-d8eb8d329aa6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:48:03.284668 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.284648 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b58c45ca-b55d-442f-af45-d8eb8d329aa6" (UID: "b58c45ca-b55d-442f-af45-d8eb8d329aa6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:48:03.284747 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.284708 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b58c45ca-b55d-442f-af45-d8eb8d329aa6-kube-api-access-xgj2g" (OuterVolumeSpecName: "kube-api-access-xgj2g") pod "b58c45ca-b55d-442f-af45-d8eb8d329aa6" (UID: "b58c45ca-b55d-442f-af45-d8eb8d329aa6"). InnerVolumeSpecName "kube-api-access-xgj2g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:48:03.284813 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.284796 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b58c45ca-b55d-442f-af45-d8eb8d329aa6" (UID: "b58c45ca-b55d-442f-af45-d8eb8d329aa6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 21:48:03.365109 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.365084 2580 generic.go:356] "Generic (PLEG): container finished" podID="b58c45ca-b55d-442f-af45-d8eb8d329aa6" containerID="4712f318c48c351979fe86d5b233bcc62229fcf6a237ff84f172a639b6d29726" exitCode=0 Jul 17 21:48:03.365264 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.365115 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" event={"ID":"b58c45ca-b55d-442f-af45-d8eb8d329aa6","Type":"ContainerDied","Data":"4712f318c48c351979fe86d5b233bcc62229fcf6a237ff84f172a639b6d29726"} Jul 17 21:48:03.365264 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.365138 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" Jul 17 21:48:03.365264 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.365155 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8" event={"ID":"b58c45ca-b55d-442f-af45-d8eb8d329aa6","Type":"ContainerDied","Data":"68312e9e51b654be8c99fde47529f741be54ab7a5b97322c369ff88aba573ea6"} Jul 17 21:48:03.365264 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.365176 2580 scope.go:117] "RemoveContainer" containerID="4712f318c48c351979fe86d5b233bcc62229fcf6a237ff84f172a639b6d29726" Jul 17 21:48:03.374305 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.374288 2580 scope.go:117] "RemoveContainer" containerID="0fa7e47804d520a14a6b089962bd2e105e63acf0c1fbe15ca90903efe695abbd" Jul 17 21:48:03.382388 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.382372 2580 scope.go:117] "RemoveContainer" containerID="4712f318c48c351979fe86d5b233bcc62229fcf6a237ff84f172a639b6d29726" Jul 17 21:48:03.382648 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:48:03.382621 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4712f318c48c351979fe86d5b233bcc62229fcf6a237ff84f172a639b6d29726\": container with ID starting with 4712f318c48c351979fe86d5b233bcc62229fcf6a237ff84f172a639b6d29726 not found: ID does not exist" containerID="4712f318c48c351979fe86d5b233bcc62229fcf6a237ff84f172a639b6d29726" Jul 17 21:48:03.382755 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.382653 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4712f318c48c351979fe86d5b233bcc62229fcf6a237ff84f172a639b6d29726"} err="failed to get container status \"4712f318c48c351979fe86d5b233bcc62229fcf6a237ff84f172a639b6d29726\": rpc error: code = NotFound desc = could not find container \"4712f318c48c351979fe86d5b233bcc62229fcf6a237ff84f172a639b6d29726\": container with ID starting with 4712f318c48c351979fe86d5b233bcc62229fcf6a237ff84f172a639b6d29726 not found: ID does not exist" Jul 17 21:48:03.382755 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.382670 2580 scope.go:117] "RemoveContainer" containerID="0fa7e47804d520a14a6b089962bd2e105e63acf0c1fbe15ca90903efe695abbd" Jul 17 21:48:03.382927 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:48:03.382909 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fa7e47804d520a14a6b089962bd2e105e63acf0c1fbe15ca90903efe695abbd\": container with ID starting with 0fa7e47804d520a14a6b089962bd2e105e63acf0c1fbe15ca90903efe695abbd not found: ID does not exist" containerID="0fa7e47804d520a14a6b089962bd2e105e63acf0c1fbe15ca90903efe695abbd" Jul 17 21:48:03.382972 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.382926 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgj2g\" (UniqueName: \"kubernetes.io/projected/b58c45ca-b55d-442f-af45-d8eb8d329aa6-kube-api-access-xgj2g\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:48:03.382972 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.382931 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fa7e47804d520a14a6b089962bd2e105e63acf0c1fbe15ca90903efe695abbd"} err="failed to get container status \"0fa7e47804d520a14a6b089962bd2e105e63acf0c1fbe15ca90903efe695abbd\": rpc error: code = NotFound desc = could not find container \"0fa7e47804d520a14a6b089962bd2e105e63acf0c1fbe15ca90903efe695abbd\": container with ID starting with 0fa7e47804d520a14a6b089962bd2e105e63acf0c1fbe15ca90903efe695abbd not found: ID does not exist" Jul 17 21:48:03.382972 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.382942 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-workload-certs\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:48:03.382972 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.382952 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istio-envoy\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:48:03.382972 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.382961 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istio-token\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:48:03.382972 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.382968 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istio-podinfo\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:48:03.383162 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.382976 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b58c45ca-b55d-442f-af45-d8eb8d329aa6-istio-data\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:48:03.387605 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.387584 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8"] Jul 17 21:48:03.395493 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.395460 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-f631c8-openshift-default-748fd88c9f-jtkj8"] Jul 17 21:48:03.857800 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:03.857763 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b58c45ca-b55d-442f-af45-d8eb8d329aa6" path="/var/lib/kubelet/pods/b58c45ca-b55d-442f-af45-d8eb8d329aa6/volumes" Jul 17 21:48:20.158202 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:20.158159 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j"] Jul 17 21:48:20.158613 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:20.158412 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" podUID="1e21828c-e4b2-468b-b66e-735a5f8bc5f6" containerName="istio-proxy" containerID="cri-o://f95b5da1df6520d0a5f486fddcf138291a48a74dd4eee88784286b30f4bbe8da" gracePeriod=30 Jul 17 21:48:25.404139 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.404109 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:48:25.490725 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.490650 2580 generic.go:356] "Generic (PLEG): container finished" podID="1e21828c-e4b2-468b-b66e-735a5f8bc5f6" containerID="f95b5da1df6520d0a5f486fddcf138291a48a74dd4eee88784286b30f4bbe8da" exitCode=0 Jul 17 21:48:25.490725 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.490702 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" Jul 17 21:48:25.490895 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.490726 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" event={"ID":"1e21828c-e4b2-468b-b66e-735a5f8bc5f6","Type":"ContainerDied","Data":"f95b5da1df6520d0a5f486fddcf138291a48a74dd4eee88784286b30f4bbe8da"} Jul 17 21:48:25.490895 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.490807 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j" event={"ID":"1e21828c-e4b2-468b-b66e-735a5f8bc5f6","Type":"ContainerDied","Data":"60c316c4ca4fcc6a21191d0dbbdf06fb3ae332e5272091ea8d971d3241017ed4"} Jul 17 21:48:25.490895 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.490833 2580 scope.go:117] "RemoveContainer" containerID="f95b5da1df6520d0a5f486fddcf138291a48a74dd4eee88784286b30f4bbe8da" Jul 17 21:48:25.499598 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.499581 2580 scope.go:117] "RemoveContainer" containerID="fc88e86f94fdb829941b67d152bc2f0b1810b2da4c7cb605afcc77e07aae6696" Jul 17 21:48:25.508233 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.508210 2580 scope.go:117] "RemoveContainer" containerID="f95b5da1df6520d0a5f486fddcf138291a48a74dd4eee88784286b30f4bbe8da" Jul 17 21:48:25.508495 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:48:25.508475 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f95b5da1df6520d0a5f486fddcf138291a48a74dd4eee88784286b30f4bbe8da\": container with ID starting with f95b5da1df6520d0a5f486fddcf138291a48a74dd4eee88784286b30f4bbe8da not found: ID does not exist" containerID="f95b5da1df6520d0a5f486fddcf138291a48a74dd4eee88784286b30f4bbe8da" Jul 17 21:48:25.508547 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.508504 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f95b5da1df6520d0a5f486fddcf138291a48a74dd4eee88784286b30f4bbe8da"} err="failed to get container status \"f95b5da1df6520d0a5f486fddcf138291a48a74dd4eee88784286b30f4bbe8da\": rpc error: code = NotFound desc = could not find container \"f95b5da1df6520d0a5f486fddcf138291a48a74dd4eee88784286b30f4bbe8da\": container with ID starting with f95b5da1df6520d0a5f486fddcf138291a48a74dd4eee88784286b30f4bbe8da not found: ID does not exist" Jul 17 21:48:25.508547 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.508521 2580 scope.go:117] "RemoveContainer" containerID="fc88e86f94fdb829941b67d152bc2f0b1810b2da4c7cb605afcc77e07aae6696" Jul 17 21:48:25.508736 ip-10-0-132-253 kubenswrapper[2580]: E0717 21:48:25.508717 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc88e86f94fdb829941b67d152bc2f0b1810b2da4c7cb605afcc77e07aae6696\": container with ID starting with fc88e86f94fdb829941b67d152bc2f0b1810b2da4c7cb605afcc77e07aae6696 not found: ID does not exist" containerID="fc88e86f94fdb829941b67d152bc2f0b1810b2da4c7cb605afcc77e07aae6696" Jul 17 21:48:25.508776 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.508745 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc88e86f94fdb829941b67d152bc2f0b1810b2da4c7cb605afcc77e07aae6696"} err="failed to get container status \"fc88e86f94fdb829941b67d152bc2f0b1810b2da4c7cb605afcc77e07aae6696\": rpc error: code = NotFound desc = could not find container \"fc88e86f94fdb829941b67d152bc2f0b1810b2da4c7cb605afcc77e07aae6696\": container with ID starting with fc88e86f94fdb829941b67d152bc2f0b1810b2da4c7cb605afcc77e07aae6696 not found: ID does not exist" Jul 17 21:48:25.589249 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.589223 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istio-podinfo\") pod \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " Jul 17 21:48:25.589359 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.589261 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istio-envoy\") pod \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " Jul 17 21:48:25.589359 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.589311 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hghb2\" (UniqueName: \"kubernetes.io/projected/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-kube-api-access-hghb2\") pod \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " Jul 17 21:48:25.589359 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.589345 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istio-data\") pod \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " Jul 17 21:48:25.589516 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.589375 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-workload-socket\") pod \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " Jul 17 21:48:25.589516 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.589411 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-credential-socket\") pod \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " Jul 17 21:48:25.589516 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.589444 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istiod-ca-cert\") pod \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " Jul 17 21:48:25.589516 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.589463 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istio-token\") pod \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " Jul 17 21:48:25.589516 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.589490 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-workload-certs\") pod \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\" (UID: \"1e21828c-e4b2-468b-b66e-735a5f8bc5f6\") " Jul 17 21:48:25.589781 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.589674 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1e21828c-e4b2-468b-b66e-735a5f8bc5f6" (UID: "1e21828c-e4b2-468b-b66e-735a5f8bc5f6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:48:25.589851 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.589831 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-credential-socket\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:48:25.589902 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.589852 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1e21828c-e4b2-468b-b66e-735a5f8bc5f6" (UID: "1e21828c-e4b2-468b-b66e-735a5f8bc5f6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:48:25.589959 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.589919 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1e21828c-e4b2-468b-b66e-735a5f8bc5f6" (UID: "1e21828c-e4b2-468b-b66e-735a5f8bc5f6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 21:48:25.590094 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.590069 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1e21828c-e4b2-468b-b66e-735a5f8bc5f6" (UID: "1e21828c-e4b2-468b-b66e-735a5f8bc5f6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:48:25.590259 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.590234 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istio-data" (OuterVolumeSpecName: "istio-data") pod "1e21828c-e4b2-468b-b66e-735a5f8bc5f6" (UID: "1e21828c-e4b2-468b-b66e-735a5f8bc5f6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:48:25.591494 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.591457 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1e21828c-e4b2-468b-b66e-735a5f8bc5f6" (UID: "1e21828c-e4b2-468b-b66e-735a5f8bc5f6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 21:48:25.591655 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.591633 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istio-token" (OuterVolumeSpecName: "istio-token") pod "1e21828c-e4b2-468b-b66e-735a5f8bc5f6" (UID: "1e21828c-e4b2-468b-b66e-735a5f8bc5f6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:48:25.591814 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.591792 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1e21828c-e4b2-468b-b66e-735a5f8bc5f6" (UID: "1e21828c-e4b2-468b-b66e-735a5f8bc5f6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 21:48:25.591814 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.591802 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-kube-api-access-hghb2" (OuterVolumeSpecName: "kube-api-access-hghb2") pod "1e21828c-e4b2-468b-b66e-735a5f8bc5f6" (UID: "1e21828c-e4b2-468b-b66e-735a5f8bc5f6"). InnerVolumeSpecName "kube-api-access-hghb2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 21:48:25.691070 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.691046 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istiod-ca-cert\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:48:25.691070 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.691068 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istio-token\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:48:25.691221 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.691076 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-workload-certs\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:48:25.691221 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.691084 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istio-podinfo\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:48:25.691221 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.691092 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istio-envoy\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:48:25.691221 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.691100 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hghb2\" (UniqueName: \"kubernetes.io/projected/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-kube-api-access-hghb2\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:48:25.691221 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.691109 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-istio-data\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:48:25.691221 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.691117 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e21828c-e4b2-468b-b66e-735a5f8bc5f6-workload-socket\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jul 17 21:48:25.813888 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.813867 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j"] Jul 17 21:48:25.819449 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.819416 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-d5e469-openshift-default-56dc4fc975-t4s8j"] Jul 17 21:48:25.858091 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:25.858063 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e21828c-e4b2-468b-b66e-735a5f8bc5f6" path="/var/lib/kubelet/pods/1e21828c-e4b2-468b-b66e-735a5f8bc5f6/volumes" Jul 17 21:48:27.174443 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:27.174404 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6_4bfea361-5929-41c8-a517-c35229590b33/copy-manifests/0.log" Jul 17 21:48:27.183135 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:27.183102 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6_4bfea361-5929-41c8-a517-c35229590b33/manager/0.log" Jul 17 21:48:27.779989 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:27.779960 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29738715-gbhzc_1af75215-7a01-4201-8768-45ce84b3d204/cleanup/0.log" Jul 17 21:48:27.895864 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:27.895833 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29738730-tttwx_721dea68-316f-4d26-8b4c-40e85a38f7ea/cleanup/0.log" Jul 17 21:48:28.010458 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:28.010431 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29738745-l56mf_207414bc-5666-4a84-8707-174333e753f5/cleanup/0.log" Jul 17 21:48:28.953282 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:28.953250 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2_0a332ed8-c80f-4e41-94e8-5bfa7169c4b6/pull/0.log" Jul 17 21:48:28.959425 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:28.959400 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2_0a332ed8-c80f-4e41-94e8-5bfa7169c4b6/extract/0.log" Jul 17 21:48:28.964897 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:28.964878 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2_0a332ed8-c80f-4e41-94e8-5bfa7169c4b6/util/0.log" Jul 17 21:48:29.092149 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:29.092120 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk_bd522c17-0387-460d-a61a-c988ef4d0496/util/0.log" Jul 17 21:48:29.097910 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:29.097886 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk_bd522c17-0387-460d-a61a-c988ef4d0496/pull/0.log" Jul 17 21:48:29.103375 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:29.103357 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk_bd522c17-0387-460d-a61a-c988ef4d0496/extract/0.log" Jul 17 21:48:29.221107 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:29.221032 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn_7a1a358a-046b-4ec2-8fb4-977974c2caa7/pull/0.log" Jul 17 21:48:29.227210 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:29.227171 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn_7a1a358a-046b-4ec2-8fb4-977974c2caa7/extract/0.log" Jul 17 21:48:29.232342 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:29.232326 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn_7a1a358a-046b-4ec2-8fb4-977974c2caa7/util/0.log" Jul 17 21:48:29.346886 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:29.346863 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6_ef5acc2a-487c-4f8d-82f5-9958951821ec/util/0.log" Jul 17 21:48:29.354305 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:29.354287 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6_ef5acc2a-487c-4f8d-82f5-9958951821ec/pull/0.log" Jul 17 21:48:29.360104 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:29.360088 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6_ef5acc2a-487c-4f8d-82f5-9958951821ec/extract/0.log" Jul 17 21:48:30.696666 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:30.696629 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678wgvnm_d553ae0c-64a6-4338-8003-3425c4a1acdd/istio-proxy/0.log" Jul 17 21:48:30.817174 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:30.817146 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jv4hz_34919c79-0ccb-4fcb-9fe2-8f8ce2e16571/discovery/0.log" Jul 17 21:48:31.193684 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:31.193656 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-vpj7v_ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df/istio-proxy/1.log" Jul 17 21:48:31.971120 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:31.971090 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-2gz7c_3f6ab25c-f3ae-4e3e-a77b-83cca3b77ae7/main/0.log" Jul 17 21:48:32.091756 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:32.091725 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-4x8qf_fc119d62-7896-4f95-93e9-79e9dbabab94/main/0.log" Jul 17 21:48:41.351484 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:41.351388 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rwxkq_a4e45558-98a1-423e-8184-3cd1848415f3/global-pull-secret-syncer/0.log" Jul 17 21:48:41.427832 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:41.427799 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-r9wzc_bba97561-0dcd-43f6-ac53-876925d16126/konnectivity-agent/0.log" Jul 17 21:48:41.508333 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:41.508300 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-253.ec2.internal_8f24a48751c3182921e8a0c236d6d9a6/haproxy/0.log" Jul 17 21:48:45.927978 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:45.927943 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2_0a332ed8-c80f-4e41-94e8-5bfa7169c4b6/extract/0.log" Jul 17 21:48:45.947944 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:45.947921 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2_0a332ed8-c80f-4e41-94e8-5bfa7169c4b6/util/0.log" Jul 17 21:48:45.967620 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:45.967599 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mrtj2_0a332ed8-c80f-4e41-94e8-5bfa7169c4b6/pull/0.log" Jul 17 21:48:45.999013 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:45.998992 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk_bd522c17-0387-460d-a61a-c988ef4d0496/extract/0.log" Jul 17 21:48:46.020248 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:46.020227 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk_bd522c17-0387-460d-a61a-c988ef4d0496/util/0.log" Jul 17 21:48:46.039596 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:46.039574 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06rrnk_bd522c17-0387-460d-a61a-c988ef4d0496/pull/0.log" Jul 17 21:48:46.063906 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:46.063886 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn_7a1a358a-046b-4ec2-8fb4-977974c2caa7/extract/0.log" Jul 17 21:48:46.088983 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:46.088963 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn_7a1a358a-046b-4ec2-8fb4-977974c2caa7/util/0.log" Jul 17 21:48:46.111668 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:46.111644 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d7shn_7a1a358a-046b-4ec2-8fb4-977974c2caa7/pull/0.log" Jul 17 21:48:46.160774 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:46.160754 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6_ef5acc2a-487c-4f8d-82f5-9958951821ec/extract/0.log" Jul 17 21:48:46.185380 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:46.185328 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6_ef5acc2a-487c-4f8d-82f5-9958951821ec/util/0.log" Jul 17 21:48:46.204606 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:46.204586 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdxl6_ef5acc2a-487c-4f8d-82f5-9958951821ec/pull/0.log" Jul 17 21:48:48.115304 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:48.115275 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bk9fq_c7148bac-9a70-453b-a952-2a7a5e4a0ea6/console-operator/1.log" Jul 17 21:48:48.121385 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:48.121360 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lj5lm_6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd/ovn-acl-logging/0.log" Jul 17 21:48:48.123507 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:48.123482 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bk9fq_c7148bac-9a70-453b-a952-2a7a5e4a0ea6/console-operator/1.log" Jul 17 21:48:48.129455 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:48.129440 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lj5lm_6f3e6b5c-d932-4a7c-957b-7f0cf8991dfd/ovn-acl-logging/0.log" Jul 17 21:48:48.761344 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:48.761293 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_07b44646-f5a4-40a4-a793-1d3775cdef0a/alertmanager/0.log" Jul 17 21:48:48.782251 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:48.782212 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_07b44646-f5a4-40a4-a793-1d3775cdef0a/config-reloader/0.log" Jul 17 21:48:48.801906 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:48.801878 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_07b44646-f5a4-40a4-a793-1d3775cdef0a/kube-rbac-proxy-web/0.log" Jul 17 21:48:48.823393 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:48.823364 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_07b44646-f5a4-40a4-a793-1d3775cdef0a/kube-rbac-proxy/0.log" Jul 17 21:48:48.846981 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:48.846947 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_07b44646-f5a4-40a4-a793-1d3775cdef0a/kube-rbac-proxy-metric/0.log" Jul 17 21:48:48.868268 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:48.868238 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_07b44646-f5a4-40a4-a793-1d3775cdef0a/prom-label-proxy/0.log" Jul 17 21:48:48.889703 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:48.889665 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_07b44646-f5a4-40a4-a793-1d3775cdef0a/init-config-reloader/0.log" Jul 17 21:48:49.166178 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:49.166148 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fth8c_d6bc6797-d295-4113-8218-46191bff08cf/node-exporter/0.log" Jul 17 21:48:49.184454 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:49.184435 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fth8c_d6bc6797-d295-4113-8218-46191bff08cf/kube-rbac-proxy/0.log" Jul 17 21:48:49.203005 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:49.202988 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fth8c_d6bc6797-d295-4113-8218-46191bff08cf/init-textfile/0.log" Jul 17 21:48:49.717709 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:49.717677 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b4d5bb96f-l987w_40396164-92a4-4c00-a566-36e39d60a3fa/telemeter-client/0.log" Jul 17 21:48:49.738604 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:49.738574 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b4d5bb96f-l987w_40396164-92a4-4c00-a566-36e39d60a3fa/reload/0.log" Jul 17 21:48:49.760564 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:49.760526 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b4d5bb96f-l987w_40396164-92a4-4c00-a566-36e39d60a3fa/kube-rbac-proxy/0.log" Jul 17 21:48:49.789291 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:49.789266 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6556dd96cc-xgdz8_5b3ec31d-83c0-4764-8594-b219aa21a06d/thanos-query/0.log" Jul 17 21:48:49.807399 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:49.807375 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6556dd96cc-xgdz8_5b3ec31d-83c0-4764-8594-b219aa21a06d/kube-rbac-proxy-web/0.log" Jul 17 21:48:49.828763 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:49.828739 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6556dd96cc-xgdz8_5b3ec31d-83c0-4764-8594-b219aa21a06d/kube-rbac-proxy/0.log" Jul 17 21:48:49.848041 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:49.848017 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6556dd96cc-xgdz8_5b3ec31d-83c0-4764-8594-b219aa21a06d/prom-label-proxy/0.log" Jul 17 21:48:49.867496 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:49.867472 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6556dd96cc-xgdz8_5b3ec31d-83c0-4764-8594-b219aa21a06d/kube-rbac-proxy-rules/0.log" Jul 17 21:48:49.887559 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:49.887533 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6556dd96cc-xgdz8_5b3ec31d-83c0-4764-8594-b219aa21a06d/kube-rbac-proxy-metrics/0.log" Jul 17 21:48:50.993568 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:50.993534 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jqx7f/perf-node-gather-daemonset-szg2n"] Jul 17 21:48:50.994257 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:50.994036 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d58f99f-402d-40f8-b9c2-8e0beca943e4" containerName="cleanup" Jul 17 21:48:50.994257 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:50.994054 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d58f99f-402d-40f8-b9c2-8e0beca943e4" containerName="cleanup" Jul 17 21:48:50.994257 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:50.994069 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e21828c-e4b2-468b-b66e-735a5f8bc5f6" containerName="istio-proxy" Jul 17 21:48:50.994257 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:50.994078 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e21828c-e4b2-468b-b66e-735a5f8bc5f6" containerName="istio-proxy" Jul 17 21:48:50.994257 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:50.994090 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b58c45ca-b55d-442f-af45-d8eb8d329aa6" containerName="istio-proxy" Jul 17 21:48:50.994257 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:50.994096 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b58c45ca-b55d-442f-af45-d8eb8d329aa6" containerName="istio-proxy" Jul 17 21:48:50.994257 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:50.994109 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="207414bc-5666-4a84-8707-174333e753f5" containerName="cleanup" Jul 17 21:48:50.994257 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:50.994115 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="207414bc-5666-4a84-8707-174333e753f5" containerName="cleanup" Jul 17 21:48:50.994257 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:50.994130 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b58c45ca-b55d-442f-af45-d8eb8d329aa6" containerName="istio-proxy" Jul 17 21:48:50.994257 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:50.994135 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b58c45ca-b55d-442f-af45-d8eb8d329aa6" containerName="istio-proxy" Jul 17 21:48:50.994257 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:50.994218 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e21828c-e4b2-468b-b66e-735a5f8bc5f6" containerName="istio-proxy" Jul 17 21:48:50.994257 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:50.994229 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d58f99f-402d-40f8-b9c2-8e0beca943e4" containerName="cleanup" Jul 17 21:48:50.994257 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:50.994240 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b58c45ca-b55d-442f-af45-d8eb8d329aa6" containerName="istio-proxy" Jul 17 21:48:50.994257 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:50.994248 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b58c45ca-b55d-442f-af45-d8eb8d329aa6" containerName="istio-proxy" Jul 17 21:48:50.994257 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:50.994255 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e21828c-e4b2-468b-b66e-735a5f8bc5f6" containerName="istio-proxy" Jul 17 21:48:50.994257 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:50.994261 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="207414bc-5666-4a84-8707-174333e753f5" containerName="cleanup" Jul 17 21:48:50.998566 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:50.998549 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-szg2n" Jul 17 21:48:51.000926 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:51.000906 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jqx7f\"/\"openshift-service-ca.crt\"" Jul 17 21:48:51.001043 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:51.000925 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jqx7f\"/\"default-dockercfg-vtgzk\"" Jul 17 21:48:51.001845 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:51.001827 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jqx7f\"/\"kube-root-ca.crt\"" Jul 17 21:48:51.007666 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:51.007642 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jqx7f/perf-node-gather-daemonset-szg2n"] Jul 17 21:48:51.022592 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:51.022556 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-fbbbr_f28acb2e-e11c-4f4d-8ce8-4f7bd26457d8/networking-console-plugin/0.log" Jul 17 21:48:51.088052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:51.088014 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdjpt\" (UniqueName: \"kubernetes.io/projected/4ccec6af-51ef-46f4-b4d8-56f448229352-kube-api-access-qdjpt\") pod \"perf-node-gather-daemonset-szg2n\" (UID: \"4ccec6af-51ef-46f4-b4d8-56f448229352\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-szg2n" Jul 17 21:48:51.088052 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:51.088051 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ccec6af-51ef-46f4-b4d8-56f448229352-lib-modules\") pod \"perf-node-gather-daemonset-szg2n\" (UID: \"4ccec6af-51ef-46f4-b4d8-56f448229352\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-szg2n" Jul 17 21:48:51.088334 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:51.088071 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ccec6af-51ef-46f4-b4d8-56f448229352-sys\") pod \"perf-node-gather-daemonset-szg2n\" (UID: \"4ccec6af-51ef-46f4-b4d8-56f448229352\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-szg2n" Jul 17 21:48:51.088334 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:51.088098 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4ccec6af-51ef-46f4-b4d8-56f448229352-proc\") pod \"perf-node-gather-daemonset-szg2n\" (UID: \"4ccec6af-51ef-46f4-b4d8-56f448229352\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-szg2n" Jul 17 21:48:51.088334 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:51.088254 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4ccec6af-51ef-46f4-b4d8-56f448229352-podres\") pod \"perf-node-gather-daemonset-szg2n\" (UID: \"4ccec6af-51ef-46f4-b4d8-56f448229352\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-szg2n" Jul 17 21:48:51.189486 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:51.189453 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdjpt\" (UniqueName: \"kubernetes.io/projected/4ccec6af-51ef-46f4-b4d8-56f448229352-kube-api-access-qdjpt\") pod \"perf-node-gather-daemonset-szg2n\" (UID: \"4ccec6af-51ef-46f4-b4d8-56f448229352\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-szg2n" Jul 17 21:48:51.189486 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:51.189489 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ccec6af-51ef-46f4-b4d8-56f448229352-lib-modules\") pod \"perf-node-gather-daemonset-szg2n\" (UID: \"4ccec6af-51ef-46f4-b4d8-56f448229352\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-szg2n" Jul 17 21:48:51.189704 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:51.189511 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ccec6af-51ef-46f4-b4d8-56f448229352-sys\") pod \"perf-node-gather-daemonset-szg2n\" (UID: \"4ccec6af-51ef-46f4-b4d8-56f448229352\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-szg2n" Jul 17 21:48:51.189704 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:51.189577 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ccec6af-51ef-46f4-b4d8-56f448229352-sys\") pod \"perf-node-gather-daemonset-szg2n\" (UID: \"4ccec6af-51ef-46f4-b4d8-56f448229352\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-szg2n" Jul 17 21:48:51.189704 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:51.189620 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4ccec6af-51ef-46f4-b4d8-56f448229352-proc\") pod \"perf-node-gather-daemonset-szg2n\" (UID: \"4ccec6af-51ef-46f4-b4d8-56f448229352\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-szg2n" Jul 17 21:48:51.189704 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:51.189648 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ccec6af-51ef-46f4-b4d8-56f448229352-lib-modules\") pod \"perf-node-gather-daemonset-szg2n\" (UID: \"4ccec6af-51ef-46f4-b4d8-56f448229352\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-szg2n" Jul 17 21:48:51.189871 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:51.189707 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4ccec6af-51ef-46f4-b4d8-56f448229352-proc\") pod \"perf-node-gather-daemonset-szg2n\" (UID: \"4ccec6af-51ef-46f4-b4d8-56f448229352\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-szg2n" Jul 17 21:48:51.189871 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:51.189740 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4ccec6af-51ef-46f4-b4d8-56f448229352-podres\") pod \"perf-node-gather-daemonset-szg2n\" (UID: \"4ccec6af-51ef-46f4-b4d8-56f448229352\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-szg2n" Jul 17 21:48:51.189970 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:51.189911 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4ccec6af-51ef-46f4-b4d8-56f448229352-podres\") pod \"perf-node-gather-daemonset-szg2n\" (UID: \"4ccec6af-51ef-46f4-b4d8-56f448229352\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-szg2n" Jul 17 21:48:51.196980 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:51.196948 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdjpt\" (UniqueName: \"kubernetes.io/projected/4ccec6af-51ef-46f4-b4d8-56f448229352-kube-api-access-qdjpt\") pod \"perf-node-gather-daemonset-szg2n\" (UID: \"4ccec6af-51ef-46f4-b4d8-56f448229352\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-szg2n" Jul 17 21:48:51.309322 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:51.309296 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-szg2n" Jul 17 21:48:51.440106 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:51.440076 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jqx7f/perf-node-gather-daemonset-szg2n"] Jul 17 21:48:51.441820 ip-10-0-132-253 kubenswrapper[2580]: W0717 21:48:51.441790 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4ccec6af_51ef_46f4_b4d8_56f448229352.slice/crio-3658f0e8068f30725398c6ed78b4964a9b948e31de360722880707ba150870e9 WatchSource:0}: Error finding container 3658f0e8068f30725398c6ed78b4964a9b948e31de360722880707ba150870e9: Status 404 returned error can't find the container with id 3658f0e8068f30725398c6ed78b4964a9b948e31de360722880707ba150870e9 Jul 17 21:48:51.634227 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:51.634111 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-szg2n" event={"ID":"4ccec6af-51ef-46f4-b4d8-56f448229352","Type":"ContainerStarted","Data":"1ef4b896a68753805d8a52d100637dc24e48da1ff712420fda7c5a62d1acdb0c"} Jul 17 21:48:51.634227 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:51.634172 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-szg2n" event={"ID":"4ccec6af-51ef-46f4-b4d8-56f448229352","Type":"ContainerStarted","Data":"3658f0e8068f30725398c6ed78b4964a9b948e31de360722880707ba150870e9"} Jul 17 21:48:51.634227 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:51.634226 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-szg2n" Jul 17 21:48:51.653897 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:51.653842 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-szg2n" podStartSLOduration=1.65382687 podStartE2EDuration="1.65382687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:48:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:48:51.651558514 +0000 UTC m=+2704.249241159" watchObservedRunningTime="2026-07-17 21:48:51.65382687 +0000 UTC m=+2704.251509513" Jul 17 21:48:51.728008 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:51.727980 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bk9fq_c7148bac-9a70-453b-a952-2a7a5e4a0ea6/console-operator/1.log" Jul 17 21:48:51.732717 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:51.732695 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bk9fq_c7148bac-9a70-453b-a952-2a7a5e4a0ea6/console-operator/2.log" Jul 17 21:48:52.220056 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:52.220025 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-x5bnf_0b7d88bd-9c02-4c36-94a2-365b49da41c8/download-server/0.log" Jul 17 21:48:52.774195 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:52.774156 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-s6nd9_9d5f3a68-9243-4c4d-967c-d43498c8a1e9/volume-data-source-validator/0.log" Jul 17 21:48:53.799636 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:53.799602 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-975kn_caf45719-aa88-4cd5-be7b-59181000ebc4/dns/0.log" Jul 17 21:48:53.817669 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:53.817638 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-975kn_caf45719-aa88-4cd5-be7b-59181000ebc4/kube-rbac-proxy/0.log" Jul 17 21:48:53.913854 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:53.913828 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jkpqn_ebc23e94-e431-4530-a0d3-4ecd7f6e81f1/dns-node-resolver/0.log" Jul 17 21:48:54.438103 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:54.438070 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7b4d7d85db-nh59d_3d4abcde-7882-4519-a2ee-4b8f666acce1/registry/0.log" Jul 17 21:48:54.480148 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:54.480120 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cxh8j_243ec811-8044-4a40-94a4-12034fff80c7/node-ca/0.log" Jul 17 21:48:55.430350 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:55.430316 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678wgvnm_d553ae0c-64a6-4338-8003-3425c4a1acdd/istio-proxy/0.log" Jul 17 21:48:55.550621 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:55.550593 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jv4hz_34919c79-0ccb-4fcb-9fe2-8f8ce2e16571/discovery/0.log" Jul 17 21:48:55.624681 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:55.624646 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-vpj7v_ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df/istio-proxy/0.log" Jul 17 21:48:55.653637 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:55.653608 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-vpj7v_ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df/istio-proxy/1.log" Jul 17 21:48:56.416622 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:56.416588 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-82mmq_27b81838-ea05-4402-8c37-3538241228db/serve-healthcheck-canary/0.log" Jul 17 21:48:56.899753 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:56.899719 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-jww4g_804719d7-515b-43b2-b9c3-06ca4f9108c0/insights-operator/0.log" Jul 17 21:48:56.900390 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:56.900371 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-jww4g_804719d7-515b-43b2-b9c3-06ca4f9108c0/insights-operator/1.log" Jul 17 21:48:57.040652 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:57.040623 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wm82f_964ecc7c-8a78-4114-acd1-7bbe2489934f/kube-rbac-proxy/0.log" Jul 17 21:48:57.060285 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:57.060263 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wm82f_964ecc7c-8a78-4114-acd1-7bbe2489934f/exporter/0.log" Jul 17 21:48:57.079989 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:57.079968 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wm82f_964ecc7c-8a78-4114-acd1-7bbe2489934f/extractor/0.log" Jul 17 21:48:57.650677 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:57.650645 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-szg2n" Jul 17 21:48:59.739999 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:59.739968 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6_4bfea361-5929-41c8-a517-c35229590b33/manager/0.log" Jul 17 21:48:59.758928 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:48:59.758907 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dd64c6cb8-fjbq6_4bfea361-5929-41c8-a517-c35229590b33/copy-manifests/0.log" Jul 17 21:49:01.090095 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:49:01.090060 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678wgvnm_d553ae0c-64a6-4338-8003-3425c4a1acdd/istio-proxy/0.log" Jul 17 21:49:01.191423 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:49:01.191392 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-c8db86df9-c4vtt_dfd88280-ce24-4179-b885-8cd622fc0dd8/manager/0.log" Jul 17 21:49:01.227348 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:49:01.227285 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jv4hz_34919c79-0ccb-4fcb-9fe2-8f8ce2e16571/discovery/0.log" Jul 17 21:49:01.269363 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:49:01.269336 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-vpj7v_ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df/istio-proxy/0.log" Jul 17 21:49:01.297661 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:49:01.297635 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-vpj7v_ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df/istio-proxy/1.log" Jul 17 21:49:02.507289 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:49:02.507260 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678wgvnm_d553ae0c-64a6-4338-8003-3425c4a1acdd/istio-proxy/0.log" Jul 17 21:49:02.623217 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:49:02.623177 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jv4hz_34919c79-0ccb-4fcb-9fe2-8f8ce2e16571/discovery/0.log" Jul 17 21:49:02.667226 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:49:02.667153 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-vpj7v_ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df/istio-proxy/0.log" Jul 17 21:49:02.699132 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:49:02.699111 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-vpj7v_ddb75bb9-5a3e-47e1-b7fe-94cdc060d9df/istio-proxy/1.log" Jul 17 21:49:06.288071 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:49:06.288036 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-tlfvd_c9ee56af-87eb-42ae-bf0b-96477c5a90cb/kube-storage-version-migrator-operator/1.log" Jul 17 21:49:06.288935 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:49:06.288911 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-tlfvd_c9ee56af-87eb-42ae-bf0b-96477c5a90cb/kube-storage-version-migrator-operator/0.log" Jul 17 21:49:07.268352 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:49:07.268320 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-68t46_22bb795e-5fc2-4387-93a0-c177879fddd7/kube-multus/0.log" Jul 17 21:49:07.440322 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:49:07.440291 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8gbd6_547aa59b-bc0d-4eb0-9c28-1635fc1d925c/kube-multus-additional-cni-plugins/0.log" Jul 17 21:49:07.460543 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:49:07.460514 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8gbd6_547aa59b-bc0d-4eb0-9c28-1635fc1d925c/egress-router-binary-copy/0.log" Jul 17 21:49:07.479754 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:49:07.479730 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8gbd6_547aa59b-bc0d-4eb0-9c28-1635fc1d925c/cni-plugins/0.log" Jul 17 21:49:07.498891 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:49:07.498870 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8gbd6_547aa59b-bc0d-4eb0-9c28-1635fc1d925c/bond-cni-plugin/0.log" Jul 17 21:49:07.522915 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:49:07.522864 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8gbd6_547aa59b-bc0d-4eb0-9c28-1635fc1d925c/routeoverride-cni/0.log" Jul 17 21:49:07.549297 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:49:07.549275 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8gbd6_547aa59b-bc0d-4eb0-9c28-1635fc1d925c/whereabouts-cni-bincopy/0.log" Jul 17 21:49:07.569355 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:49:07.569334 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8gbd6_547aa59b-bc0d-4eb0-9c28-1635fc1d925c/whereabouts-cni/0.log" Jul 17 21:49:07.859707 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:49:07.859683 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7z4zp_c55f0556-d46b-468c-922b-364681e608cc/network-metrics-daemon/0.log" Jul 17 21:49:07.877579 ip-10-0-132-253 kubenswrapper[2580]: I0717 21:49:07.877556 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7z4zp_c55f0556-d46b-468c-922b-364681e608cc/kube-rbac-proxy/0.log"