Jul 06 17:49:30.634434 ip-10-0-130-37 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 17:49:30.634443 ip-10-0-130-37 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 17:49:30.634468 ip-10-0-130-37 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 17:49:30.634685 ip-10-0-130-37 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 17:49:40.678378 ip-10-0-130-37 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 17:49:40.678393 ip-10-0-130-37 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 847f258c1a6b4c27a2338ecdc7dc646d -- Jul 06 17:51:19.197302 ip-10-0-130-37 systemd[1]: Starting Kubernetes Kubelet... Jul 06 17:51:19.638614 ip-10-0-130-37 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 17:51:19.638614 ip-10-0-130-37 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 17:51:19.638614 ip-10-0-130-37 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 17:51:19.638614 ip-10-0-130-37 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 17:51:19.638614 ip-10-0-130-37 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 17:51:19.638614 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.622574 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 17:51:19.638614 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627515 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 17:51:19.638614 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627526 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 17:51:19.638614 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627530 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 17:51:19.638614 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627534 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 17:51:19.638614 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627536 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 17:51:19.638614 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627539 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 17:51:19.638614 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627542 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 17:51:19.638614 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627545 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 17:51:19.653212 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627547 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 17:51:19.653212 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627550 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 17:51:19.653212 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627553 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 17:51:19.653212 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627555 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 17:51:19.653212 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627563 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 17:51:19.653212 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627565 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 17:51:19.653212 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627568 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 17:51:19.653212 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627571 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 17:51:19.653212 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627573 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 17:51:19.653212 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627576 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 17:51:19.653212 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627578 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 17:51:19.653212 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627581 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 17:51:19.653212 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627584 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 17:51:19.653212 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627587 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 17:51:19.653212 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627590 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 17:51:19.653212 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627592 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 17:51:19.653212 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627595 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 17:51:19.653212 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627598 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 17:51:19.653212 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627600 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 17:51:19.653212 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627603 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 17:51:19.657435 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627605 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 17:51:19.657435 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627608 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 17:51:19.657435 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627610 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 17:51:19.657435 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627613 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 17:51:19.657435 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627615 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 17:51:19.657435 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627618 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 17:51:19.657435 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627620 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 17:51:19.657435 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627623 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 17:51:19.657435 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627626 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 17:51:19.657435 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627628 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 17:51:19.657435 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627630 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 17:51:19.657435 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627633 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 17:51:19.657435 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627635 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 17:51:19.657435 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627638 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 17:51:19.657435 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627640 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 17:51:19.657435 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627642 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 17:51:19.657435 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627645 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 17:51:19.657435 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627648 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 17:51:19.657435 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627650 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 17:51:19.657435 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627653 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 17:51:19.659772 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627655 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 17:51:19.659772 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627658 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 17:51:19.659772 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627660 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 17:51:19.659772 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627662 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 17:51:19.659772 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627665 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 17:51:19.659772 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627668 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 06 17:51:19.659772 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627671 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 17:51:19.659772 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627674 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 17:51:19.659772 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627676 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 17:51:19.659772 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627681 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 17:51:19.659772 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627685 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 17:51:19.659772 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627688 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 17:51:19.659772 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627691 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 17:51:19.659772 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627694 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 17:51:19.659772 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627696 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 17:51:19.659772 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627699 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 17:51:19.659772 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627702 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 17:51:19.659772 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627704 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 17:51:19.659772 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627707 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 17:51:19.659772 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627709 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 17:51:19.663895 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627712 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 17:51:19.663895 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627716 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 17:51:19.663895 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627719 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 17:51:19.663895 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627722 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 17:51:19.663895 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627725 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 17:51:19.663895 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627728 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 17:51:19.663895 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627731 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 17:51:19.663895 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627734 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 17:51:19.663895 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627737 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 17:51:19.663895 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627739 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 17:51:19.663895 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627742 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 17:51:19.663895 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627744 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 17:51:19.663895 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627747 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 17:51:19.663895 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627750 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 17:51:19.663895 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627752 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 17:51:19.663895 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627754 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 17:51:19.663895 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627757 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 17:51:19.663895 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627762 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 17:51:19.663895 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627765 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 17:51:19.666316 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627768 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 17:51:19.666316 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627771 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 17:51:19.666316 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627775 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 17:51:19.666316 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627777 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 17:51:19.666316 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627780 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 17:51:19.666316 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627783 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 17:51:19.666316 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627785 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 17:51:19.666316 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627788 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 17:51:19.666316 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627790 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 17:51:19.666316 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627793 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 17:51:19.666316 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627796 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 17:51:19.666316 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.627799 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 17:51:19.666316 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628489 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 17:51:19.666316 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628496 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 17:51:19.666316 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628500 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 17:51:19.666316 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628503 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 17:51:19.666316 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628506 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 17:51:19.666316 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628508 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 17:51:19.666316 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628511 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 17:51:19.666316 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628514 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 17:51:19.670408 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628517 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 17:51:19.670408 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628519 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 17:51:19.670408 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628522 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 17:51:19.670408 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628526 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 17:51:19.670408 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628529 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 17:51:19.670408 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628532 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 17:51:19.670408 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628535 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 17:51:19.670408 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628538 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 17:51:19.670408 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628540 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 17:51:19.670408 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628543 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 17:51:19.670408 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628546 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 17:51:19.670408 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628548 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 17:51:19.670408 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628551 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 17:51:19.670408 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628553 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 17:51:19.670408 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628556 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 17:51:19.670408 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628559 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 17:51:19.670408 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628561 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 17:51:19.670408 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628564 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 17:51:19.670408 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628566 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 17:51:19.670408 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628569 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 17:51:19.673004 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628571 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 17:51:19.673004 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628574 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 17:51:19.673004 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628578 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 17:51:19.673004 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628582 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 17:51:19.673004 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628584 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 17:51:19.673004 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628587 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 17:51:19.673004 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628590 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 17:51:19.673004 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628592 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 17:51:19.673004 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628594 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 17:51:19.673004 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628597 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 17:51:19.673004 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628599 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 17:51:19.673004 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628602 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 17:51:19.673004 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628604 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 17:51:19.673004 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628607 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 17:51:19.673004 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628609 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 17:51:19.673004 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628612 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 17:51:19.673004 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628615 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 17:51:19.673004 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628618 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 17:51:19.673004 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628620 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 17:51:19.677916 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628623 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 17:51:19.677916 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628625 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 17:51:19.677916 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628628 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 17:51:19.677916 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628633 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 17:51:19.677916 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628635 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 17:51:19.677916 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628637 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 06 17:51:19.677916 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628640 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 17:51:19.677916 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628642 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 17:51:19.677916 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628645 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 17:51:19.677916 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628648 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 17:51:19.677916 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628651 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 17:51:19.677916 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628653 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 17:51:19.677916 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628655 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 17:51:19.677916 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628658 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 17:51:19.677916 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628660 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 17:51:19.677916 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628663 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 17:51:19.677916 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628665 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 17:51:19.677916 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628668 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 17:51:19.677916 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628671 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 17:51:19.677916 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628673 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 17:51:19.681129 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628675 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 17:51:19.681129 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628678 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 17:51:19.681129 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628680 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 17:51:19.681129 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628683 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 17:51:19.681129 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628685 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 17:51:19.681129 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628687 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 17:51:19.681129 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628690 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 17:51:19.681129 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628693 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 17:51:19.681129 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628695 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 17:51:19.681129 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628698 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 17:51:19.681129 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628700 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 17:51:19.681129 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628702 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 17:51:19.681129 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628705 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 17:51:19.681129 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628707 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 17:51:19.681129 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628710 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 17:51:19.681129 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628714 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 17:51:19.681129 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628718 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 17:51:19.681129 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628720 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 17:51:19.681129 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628723 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 17:51:19.685617 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628725 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 17:51:19.685617 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628728 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 17:51:19.685617 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628731 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 17:51:19.685617 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628733 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 17:51:19.685617 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628737 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 17:51:19.685617 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628740 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 17:51:19.685617 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628743 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 17:51:19.685617 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628746 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 17:51:19.685617 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628749 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 17:51:19.685617 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628751 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 17:51:19.685617 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628754 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 17:51:19.685617 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628757 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 17:51:19.685617 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.628760 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 17:51:19.685617 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629122 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 17:51:19.685617 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629127 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 17:51:19.685617 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629130 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 17:51:19.685617 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629132 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 17:51:19.685617 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629136 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 17:51:19.685617 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629140 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 17:51:19.688153 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629143 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 17:51:19.688153 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629147 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 17:51:19.688153 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629150 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 17:51:19.688153 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629152 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 17:51:19.688153 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629155 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 17:51:19.688153 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629157 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 17:51:19.688153 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629160 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 17:51:19.688153 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629162 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 17:51:19.688153 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629165 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 17:51:19.688153 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629169 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 17:51:19.688153 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629172 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 17:51:19.688153 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629175 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 17:51:19.688153 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629177 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 17:51:19.688153 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629179 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 17:51:19.688153 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629182 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 17:51:19.688153 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629184 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 17:51:19.688153 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629187 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 17:51:19.688153 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629189 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 17:51:19.688153 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629191 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 17:51:19.692261 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629194 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 17:51:19.692261 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629197 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 17:51:19.692261 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629200 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 17:51:19.692261 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629203 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 17:51:19.692261 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629205 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 17:51:19.692261 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629208 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 17:51:19.692261 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629211 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 17:51:19.692261 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629213 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 17:51:19.692261 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629215 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 17:51:19.692261 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629218 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 17:51:19.692261 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629220 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 17:51:19.692261 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629223 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 17:51:19.692261 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629225 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 17:51:19.692261 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629228 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 17:51:19.692261 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629233 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 17:51:19.692261 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629236 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 17:51:19.692261 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629239 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 17:51:19.692261 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629241 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 17:51:19.692261 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629244 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 17:51:19.701313 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629247 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 17:51:19.701313 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629249 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 17:51:19.701313 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629252 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 17:51:19.701313 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629255 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 17:51:19.701313 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629258 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 17:51:19.701313 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629260 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 17:51:19.701313 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629263 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 17:51:19.701313 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629265 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 17:51:19.701313 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629268 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 17:51:19.701313 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629270 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 17:51:19.701313 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629273 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 17:51:19.701313 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629275 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 17:51:19.701313 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629294 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 17:51:19.701313 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629298 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 17:51:19.701313 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629301 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 17:51:19.701313 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629304 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 17:51:19.701313 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629306 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 17:51:19.701313 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629309 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 17:51:19.701313 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629312 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 17:51:19.701313 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629318 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 17:51:19.705519 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629321 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 17:51:19.705519 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629324 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 17:51:19.705519 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629326 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 17:51:19.705519 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629329 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 17:51:19.705519 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629331 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 17:51:19.705519 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629333 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 17:51:19.705519 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629336 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 17:51:19.705519 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629339 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 17:51:19.705519 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629342 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 17:51:19.705519 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629344 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 17:51:19.705519 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629347 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 06 17:51:19.705519 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629349 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 17:51:19.705519 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629352 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 17:51:19.705519 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629354 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 17:51:19.705519 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629357 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 17:51:19.705519 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629362 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 17:51:19.705519 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629364 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 17:51:19.705519 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629367 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 17:51:19.705519 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629371 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 17:51:19.705519 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629373 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 17:51:19.723226 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629376 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 17:51:19.723226 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629378 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 17:51:19.723226 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629381 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 17:51:19.723226 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629384 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 17:51:19.723226 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629386 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 17:51:19.723226 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629389 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 17:51:19.723226 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629391 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 17:51:19.723226 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629395 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 17:51:19.723226 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629398 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 17:51:19.723226 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629400 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 17:51:19.723226 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629403 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 17:51:19.723226 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629405 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 17:51:19.723226 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629408 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 17:51:19.723226 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629410 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 17:51:19.723226 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.629413 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 17:51:19.723226 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629477 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 17:51:19.723226 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629483 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 17:51:19.723226 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629493 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 17:51:19.723226 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629497 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 17:51:19.723226 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629501 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 17:51:19.723226 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629504 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 17:51:19.706539 ip-10-0-130-37 systemd[1]: Started Kubernetes Kubelet. Jul 06 17:51:19.727684 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629508 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 17:51:19.727684 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629512 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 17:51:19.727684 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629515 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 17:51:19.727684 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629518 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 17:51:19.727684 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629521 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 17:51:19.727684 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629524 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 17:51:19.727684 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629529 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 17:51:19.727684 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629532 2578 flags.go:64] FLAG: --cgroup-root="" Jul 06 17:51:19.727684 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629534 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 17:51:19.727684 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629537 2578 flags.go:64] FLAG: --client-ca-file="" Jul 06 17:51:19.727684 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629540 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 06 17:51:19.727684 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629543 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 17:51:19.727684 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629547 2578 flags.go:64] FLAG: --cluster-domain="" Jul 06 17:51:19.727684 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629550 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 17:51:19.727684 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629553 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 17:51:19.727684 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629556 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 17:51:19.727684 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629559 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 17:51:19.727684 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629562 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 17:51:19.727684 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629567 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 17:51:19.727684 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629570 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 17:51:19.727684 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629573 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 17:51:19.727684 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629576 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 06 17:51:19.727684 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629578 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 17:51:19.727684 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629581 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 17:51:19.753779 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629586 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 17:51:19.753779 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629589 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 17:51:19.753779 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629593 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 17:51:19.753779 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629603 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 17:51:19.753779 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629607 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 17:51:19.753779 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629610 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 17:51:19.753779 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629613 2578 flags.go:64] FLAG: --enable-server="true" Jul 06 17:51:19.753779 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629616 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 17:51:19.753779 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629620 2578 flags.go:64] FLAG: --event-burst="100" Jul 06 17:51:19.753779 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629623 2578 flags.go:64] FLAG: --event-qps="50" Jul 06 17:51:19.753779 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629626 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 17:51:19.753779 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629629 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 17:51:19.753779 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629632 2578 flags.go:64] FLAG: --eviction-hard="" Jul 06 17:51:19.753779 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629659 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 17:51:19.753779 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629663 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 17:51:19.753779 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629666 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 17:51:19.753779 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629669 2578 flags.go:64] FLAG: --eviction-soft="" Jul 06 17:51:19.753779 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629672 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 17:51:19.753779 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629675 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 17:51:19.753779 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629678 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 17:51:19.753779 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629681 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 17:51:19.753779 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629684 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 17:51:19.753779 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629687 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 17:51:19.753779 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629689 2578 flags.go:64] FLAG: --feature-gates="" Jul 06 17:51:19.753779 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629693 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 17:51:19.758755 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629696 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 17:51:19.758755 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629700 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 17:51:19.758755 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629704 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 17:51:19.758755 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629707 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 06 17:51:19.758755 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629709 2578 flags.go:64] FLAG: --help="false" Jul 06 17:51:19.758755 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629712 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-130-37.ec2.internal" Jul 06 17:51:19.758755 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629715 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 17:51:19.758755 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629718 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 17:51:19.758755 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629722 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 17:51:19.758755 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629725 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 17:51:19.758755 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629729 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 17:51:19.758755 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629731 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 17:51:19.758755 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629734 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 17:51:19.758755 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629737 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 17:51:19.758755 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629740 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 17:51:19.758755 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629742 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 17:51:19.758755 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629745 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 17:51:19.758755 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629748 2578 flags.go:64] FLAG: --kube-reserved="" Jul 06 17:51:19.758755 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629751 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 17:51:19.758755 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629754 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 17:51:19.758755 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629757 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 17:51:19.758755 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629761 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 17:51:19.758755 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629764 2578 flags.go:64] FLAG: --lock-file="" Jul 06 17:51:19.758755 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629766 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 17:51:19.764370 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629769 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 17:51:19.764370 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629772 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 17:51:19.764370 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629777 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 17:51:19.764370 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629780 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 17:51:19.764370 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629783 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 17:51:19.764370 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629785 2578 flags.go:64] FLAG: --logging-format="text" Jul 06 17:51:19.764370 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629788 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 17:51:19.764370 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629791 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 17:51:19.764370 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629794 2578 flags.go:64] FLAG: --manifest-url="" Jul 06 17:51:19.764370 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629798 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 06 17:51:19.764370 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629803 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 17:51:19.764370 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629806 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 17:51:19.764370 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629809 2578 flags.go:64] FLAG: --max-pods="110" Jul 06 17:51:19.764370 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629813 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 17:51:19.764370 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629816 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 17:51:19.764370 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629818 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 17:51:19.764370 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629821 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 17:51:19.764370 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629825 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 17:51:19.764370 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629828 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 17:51:19.764370 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629831 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 17:51:19.764370 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629838 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 17:51:19.764370 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629842 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 17:51:19.764370 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629845 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 17:51:19.764370 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629848 2578 flags.go:64] FLAG: --pod-cidr="" Jul 06 17:51:19.765324 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629851 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 17:51:19.765324 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629856 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 17:51:19.765324 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629859 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 17:51:19.765324 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629862 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 06 17:51:19.765324 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629865 2578 flags.go:64] FLAG: --port="10250" Jul 06 17:51:19.765324 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629868 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 17:51:19.765324 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629872 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d4491272677e7734" Jul 06 17:51:19.765324 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629875 2578 flags.go:64] FLAG: --qos-reserved="" Jul 06 17:51:19.765324 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629878 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 06 17:51:19.765324 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629881 2578 flags.go:64] FLAG: --register-node="true" Jul 06 17:51:19.765324 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629884 2578 flags.go:64] FLAG: --register-with-taints="" Jul 06 17:51:19.765324 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629887 2578 flags.go:64] FLAG: --registry-burst="10" Jul 06 17:51:19.765324 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629890 2578 flags.go:64] FLAG: --registry-qps="5" Jul 06 17:51:19.765324 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629892 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 06 17:51:19.765324 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629895 2578 flags.go:64] FLAG: --reserved-memory="" Jul 06 17:51:19.765324 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629899 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 17:51:19.765324 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629902 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 17:51:19.765324 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629906 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 17:51:19.765324 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629909 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 17:51:19.765324 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629911 2578 flags.go:64] FLAG: --runonce="false" Jul 06 17:51:19.765324 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629915 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 17:51:19.765324 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629917 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 17:51:19.765324 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629920 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 06 17:51:19.765324 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629923 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 17:51:19.765324 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629926 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 17:51:19.925715 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629929 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 17:51:19.925715 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629932 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 17:51:19.925715 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629935 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 17:51:19.925715 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629938 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 17:51:19.925715 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629940 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 17:51:19.925715 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629943 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 17:51:19.925715 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629946 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 17:51:19.925715 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629949 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 17:51:19.925715 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629952 2578 flags.go:64] FLAG: --system-cgroups="" Jul 06 17:51:19.925715 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629954 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 17:51:19.925715 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629959 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 17:51:19.925715 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629962 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 06 17:51:19.925715 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629965 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 17:51:19.925715 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629969 2578 flags.go:64] FLAG: --tls-min-version="" Jul 06 17:51:19.925715 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629972 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 17:51:19.925715 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629975 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 17:51:19.925715 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629977 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 17:51:19.925715 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629980 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 17:51:19.925715 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629983 2578 flags.go:64] FLAG: --v="2" Jul 06 17:51:19.925715 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629987 2578 flags.go:64] FLAG: --version="false" Jul 06 17:51:19.925715 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629991 2578 flags.go:64] FLAG: --vmodule="" Jul 06 17:51:19.925715 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629995 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 17:51:19.925715 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.629998 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 17:51:19.925715 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630126 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 17:51:19.928952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630132 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 17:51:19.928952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630136 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 17:51:19.928952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630139 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 17:51:19.928952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630142 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 17:51:19.928952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630144 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 17:51:19.928952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630147 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 17:51:19.928952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630149 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 17:51:19.928952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630152 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 17:51:19.928952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630155 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 17:51:19.928952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630157 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 17:51:19.928952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630160 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 17:51:19.928952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630163 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 17:51:19.928952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630165 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 17:51:19.928952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630168 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 17:51:19.928952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630170 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 17:51:19.928952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630173 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 06 17:51:19.928952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630175 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 17:51:19.928952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630178 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 17:51:19.928952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630180 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 17:51:19.928952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630183 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 17:51:19.929720 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630185 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 17:51:19.929720 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630189 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 17:51:19.929720 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630192 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 17:51:19.929720 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630194 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 17:51:19.929720 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630197 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 17:51:19.929720 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630199 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 17:51:19.929720 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630202 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 17:51:19.929720 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630205 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 17:51:19.929720 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630208 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 17:51:19.929720 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630210 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 17:51:19.929720 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630213 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 17:51:19.929720 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630216 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 17:51:19.929720 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630219 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 17:51:19.929720 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630222 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 17:51:19.929720 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630224 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 17:51:19.929720 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630227 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 17:51:19.929720 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630229 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 17:51:19.929720 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630232 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 17:51:19.929720 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630234 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 17:51:19.929720 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630237 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 17:51:19.930665 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630240 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 17:51:19.930665 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630242 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 17:51:19.930665 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630245 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 17:51:19.930665 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630248 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 17:51:19.930665 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630250 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 17:51:19.930665 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630253 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 17:51:19.930665 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630256 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 17:51:19.930665 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630258 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 17:51:19.930665 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630261 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 17:51:19.930665 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630264 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 17:51:19.930665 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630266 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 17:51:19.930665 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630268 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 17:51:19.930665 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630271 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 17:51:19.930665 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630275 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 17:51:19.930665 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630277 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 17:51:19.930665 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630280 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 17:51:19.930665 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630283 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 17:51:19.930665 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630285 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 17:51:19.930665 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630287 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 17:51:19.930665 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630290 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 17:51:19.931651 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630292 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 17:51:19.931651 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630295 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 17:51:19.931651 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630297 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 17:51:19.931651 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630300 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 17:51:19.931651 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630306 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 17:51:19.931651 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630309 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 17:51:19.931651 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630312 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 17:51:19.931651 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630315 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 17:51:19.931651 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630317 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 17:51:19.931651 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630320 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 17:51:19.931651 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630323 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 17:51:19.931651 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630326 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 17:51:19.931651 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630329 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 17:51:19.931651 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630331 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 17:51:19.931651 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630335 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 17:51:19.931651 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630339 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 17:51:19.931651 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630342 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 17:51:19.931651 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630345 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 17:51:19.931651 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630348 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 17:51:19.936717 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630350 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 17:51:19.936717 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630353 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 17:51:19.936717 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630356 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 17:51:19.936717 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630358 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 17:51:19.936717 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630360 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 17:51:19.936717 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630363 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 17:51:19.936717 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630367 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 17:51:19.936717 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630370 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 17:51:19.936717 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630372 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 17:51:19.936717 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630375 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 17:51:19.936717 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630377 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 17:51:19.936717 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630380 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 17:51:19.936717 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630383 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 17:51:19.936717 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630385 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 17:51:19.936717 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630388 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 17:51:19.936717 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630390 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 17:51:19.936717 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630392 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 17:51:19.936717 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630397 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 17:51:19.936717 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.630399 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 17:51:19.955699 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.631125 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 17:51:19.955699 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.645254 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 17:51:19.955699 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.645269 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 17:51:19.955699 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.646184 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 17:51:19.955699 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.646193 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 17:51:19.955699 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646258 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 17:51:19.955699 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646263 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 17:51:19.955699 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646267 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 17:51:19.955699 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646271 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 17:51:19.955699 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646275 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 17:51:19.955699 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646277 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 17:51:19.955699 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646280 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 17:51:19.955699 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646283 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 17:51:19.955699 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646286 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 17:51:19.955699 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646289 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 17:51:19.957302 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646291 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 17:51:19.957302 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646294 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 17:51:19.957302 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646296 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 17:51:19.957302 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646299 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 17:51:19.957302 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646303 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 17:51:19.957302 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646307 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 17:51:19.957302 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646310 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 17:51:19.957302 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646312 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 17:51:19.957302 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646315 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 17:51:19.957302 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646318 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 17:51:19.957302 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646320 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 17:51:19.957302 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646323 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 17:51:19.957302 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646325 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 17:51:19.957302 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646328 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 17:51:19.957302 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646331 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 17:51:19.957302 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646333 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 17:51:19.957302 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646336 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 17:51:19.957302 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646339 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 17:51:19.957302 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646343 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 17:51:19.958274 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646346 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 17:51:19.958274 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646349 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 17:51:19.958274 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646352 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 17:51:19.958274 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646355 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 17:51:19.958274 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646357 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 17:51:19.958274 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646360 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 17:51:19.958274 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646363 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 17:51:19.958274 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646365 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 17:51:19.958274 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646368 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 17:51:19.958274 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646370 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 17:51:19.958274 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646373 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 17:51:19.958274 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646375 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 17:51:19.958274 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646378 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 17:51:19.958274 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646381 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 17:51:19.958274 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646384 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 17:51:19.958274 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646386 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 17:51:19.958274 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646389 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 17:51:19.958274 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646391 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 17:51:19.958274 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646394 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 17:51:19.958274 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646396 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 17:51:19.960010 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646399 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 17:51:19.960010 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646401 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 17:51:19.960010 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646404 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 17:51:19.960010 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646407 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 17:51:19.960010 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646409 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 17:51:19.960010 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646411 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 17:51:19.960010 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646414 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 17:51:19.960010 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646416 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 17:51:19.960010 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646419 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 17:51:19.960010 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646421 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 17:51:19.960010 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646424 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 17:51:19.960010 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646427 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 17:51:19.960010 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646430 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 17:51:19.960010 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646433 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 06 17:51:19.960010 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646436 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 17:51:19.960010 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646438 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 17:51:19.960010 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646441 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 17:51:19.960010 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646444 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 17:51:19.960010 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646446 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 17:51:19.960010 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646450 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 17:51:19.960774 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646452 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 17:51:19.960774 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646454 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 17:51:19.960774 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646457 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 17:51:19.960774 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646460 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 17:51:19.960774 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646462 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 17:51:19.960774 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646465 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 17:51:19.960774 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646467 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 17:51:19.960774 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646470 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 17:51:19.960774 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646472 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 17:51:19.960774 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646475 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 17:51:19.960774 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646484 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 17:51:19.960774 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646486 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 17:51:19.960774 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646489 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 17:51:19.960774 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646492 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 17:51:19.960774 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646494 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 17:51:19.960774 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646497 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 17:51:19.960774 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646499 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 17:51:19.960774 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646502 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 17:51:19.960774 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646504 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 17:51:19.960774 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646507 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 17:51:19.962205 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646510 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 17:51:19.962205 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646514 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 17:51:19.962205 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646517 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 17:51:19.962205 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646522 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 17:51:19.962205 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646525 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 17:51:19.962205 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646528 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 17:51:19.962205 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646533 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 17:51:19.962205 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646536 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 17:51:19.962205 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646539 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 17:51:19.962205 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646542 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 17:51:19.962205 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.646547 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 17:51:19.962205 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646662 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 17:51:19.962205 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646668 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 17:51:19.962205 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646670 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 17:51:19.962989 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646673 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 17:51:19.962989 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646676 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 17:51:19.962989 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646679 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 17:51:19.962989 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646682 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 17:51:19.962989 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646684 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 17:51:19.962989 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646687 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 17:51:19.962989 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646689 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 17:51:19.962989 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646692 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 17:51:19.962989 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646694 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 17:51:19.962989 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646703 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 17:51:19.962989 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646706 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 17:51:19.962989 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646708 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 17:51:19.962989 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646711 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 17:51:19.962989 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646713 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 17:51:19.962989 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646716 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 17:51:19.962989 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646718 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 17:51:19.962989 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646721 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 17:51:19.962989 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646723 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 17:51:19.962989 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646726 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 17:51:19.962989 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646728 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 17:51:19.965112 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646731 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 17:51:19.965112 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646733 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 17:51:19.965112 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646737 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 17:51:19.965112 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646739 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 17:51:19.965112 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646743 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 17:51:19.965112 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646746 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 17:51:19.965112 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646748 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 17:51:19.965112 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646751 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 17:51:19.965112 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646753 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 17:51:19.965112 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646756 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 17:51:19.965112 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646758 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 17:51:19.965112 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646761 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 17:51:19.965112 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646764 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 17:51:19.965112 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646766 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 17:51:19.965112 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646770 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 17:51:19.965112 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646774 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 17:51:19.965112 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646777 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 06 17:51:19.965112 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646780 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 17:51:19.965112 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646783 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 17:51:19.965112 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646785 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 17:51:19.965952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646788 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 17:51:19.965952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646791 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 17:51:19.965952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646799 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 17:51:19.965952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646802 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 17:51:19.965952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646805 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 17:51:19.965952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646808 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 17:51:19.965952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646823 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 17:51:19.965952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646826 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 17:51:19.965952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646829 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 17:51:19.965952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646831 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 17:51:19.965952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646834 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 17:51:19.965952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646837 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 17:51:19.965952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646840 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 17:51:19.965952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646843 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 17:51:19.965952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646846 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 17:51:19.965952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646849 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 17:51:19.965952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646853 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 17:51:19.965952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646856 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 17:51:19.965952 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646858 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 17:51:19.968962 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646861 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 17:51:19.968962 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646863 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 17:51:19.968962 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646865 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 17:51:19.968962 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646868 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 17:51:19.968962 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646870 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 17:51:19.968962 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646873 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 17:51:19.968962 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646875 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 17:51:19.968962 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646878 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 17:51:19.968962 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646880 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 17:51:19.968962 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646882 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 17:51:19.968962 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646885 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 17:51:19.968962 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646889 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 17:51:19.968962 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646892 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 17:51:19.968962 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646894 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 17:51:19.968962 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646897 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 17:51:19.968962 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646900 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 17:51:19.968962 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646908 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 17:51:19.968962 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646911 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 17:51:19.968962 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646914 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 17:51:19.968962 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646916 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 17:51:19.969840 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646919 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 17:51:19.969840 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646921 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 17:51:19.969840 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646924 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 17:51:19.969840 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646926 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 17:51:19.969840 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646929 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 17:51:19.969840 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646931 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 17:51:19.969840 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646934 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 17:51:19.969840 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646936 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 17:51:19.969840 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646939 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 17:51:19.969840 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646943 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 17:51:19.969840 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646946 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 17:51:19.969840 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646948 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 17:51:19.969840 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646951 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 17:51:19.969840 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646953 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 17:51:19.969840 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646956 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 17:51:19.969840 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646960 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 17:51:19.969840 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:19.646962 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 17:51:19.970708 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.646967 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 17:51:19.970708 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.647120 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 17:51:19.970708 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.651165 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 17:51:19.970708 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.652671 2578 server.go:1019] "Starting client certificate rotation" Jul 06 17:51:19.970708 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.652780 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 17:51:19.970708 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.652825 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 17:51:19.970708 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.655240 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 17:51:19.970708 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.656513 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 17:51:19.970708 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.667277 2578 log.go:25] "Validated CRI v1 runtime API" Jul 06 17:51:19.970708 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.671335 2578 log.go:25] "Validated CRI v1 image API" Jul 06 17:51:19.970708 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.672091 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 17:51:19.970708 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.675190 2578 fs.go:135] Filesystem UUIDs: map[4f84131b-f181-4b41-8837-91ec3b119132:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ca4ba122-74ab-4955-858d-b309baee4446:/dev/nvme0n1p4] Jul 06 17:51:19.971141 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.675209 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 17:51:19.972440 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.682374 2578 manager.go:216] Machine: {Timestamp:2026-07-06 17:51:19.680888301 +0000 UTC m=+0.365495267 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097008 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26eefbfddbd0c85bff969f919a03ad SystemUUID:ec26eefb-fddb-d0c8-5bff-969f919a03ad BootID:847f258c-1a6b-4c27-a233-8ecdc7dc646d Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ce:ce:ce:f3:e9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ce:ce:ce:f3:e9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:93:a1:1c:7b:5d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 17:51:19.972440 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.682516 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 17:51:19.972440 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.682626 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 17:51:19.972440 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.686047 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 17:51:19.972440 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.687425 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 17:51:19.972440 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.687634 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-37.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 17:51:19.972440 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.688967 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.688977 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.688984 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.689611 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.690973 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.693989 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.694122 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.694150 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.694160 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.694174 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.694183 2578 kubelet.go:398] "Adding apiserver pod source" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.694191 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.694557 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.694576 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.698082 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.700251 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.700277 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.701347 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.701362 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.701370 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.701381 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.701394 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.701401 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.701409 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.701414 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.701420 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.701427 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.701436 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.701446 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.702869 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.702878 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.705806 2578 server.go:1268] "Started kubelet" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.705885 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.705922 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.706038 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.707805 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.707840 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:19.708648 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:19.708711 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-37.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.711323 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-37.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 17:51:19.972842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.713705 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.713716 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.716565 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.716582 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.716689 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.716769 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.716776 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:19.720331 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-37.ec2.internal\" not found" Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.723820 2578 factory.go:153] Registering CRI-O factory Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.723836 2578 factory.go:223] Registration of the crio container factory successfully Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.723907 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.723916 2578 factory.go:55] Registering systemd factory Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.723924 2578 factory.go:223] Registration of the systemd container factory successfully Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.723944 2578 factory.go:103] Registering Raw factory Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.723956 2578 manager.go:1196] Started watching for new ooms in manager Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:19.724017 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.727690 2578 manager.go:349] Starting recovery of all containers Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:19.728019 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:19.728087 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-37.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:19.728006 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-37.ec2.internal.18bfc4b9ca677bf1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-37.ec2.internal,UID:ip-10-0-130-37.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-37.ec2.internal,},FirstTimestamp:2026-07-06 17:51:19.705779185 +0000 UTC m=+0.390386149,LastTimestamp:2026-07-06 17:51:19.705779185 +0000 UTC m=+0.390386149,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-37.ec2.internal,}" Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.739012 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nxkhj" Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.740159 2578 manager.go:354] Recovery completed Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.745404 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.747161 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nxkhj" Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.748559 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-37.ec2.internal" event="NodeHasSufficientMemory" Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.748589 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.748605 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-37.ec2.internal" event="NodeHasSufficientPID" Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.750647 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.750660 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.750670 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 17:51:19.975038 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.750679 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 06 17:51:19.975884 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:19.750672 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-37.ec2.internal.18bfc4b9ccf477d9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-37.ec2.internal,UID:ip-10-0-130-37.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-37.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-37.ec2.internal,},FirstTimestamp:2026-07-06 17:51:19.748573145 +0000 UTC m=+0.433180114,LastTimestamp:2026-07-06 17:51:19.748573145 +0000 UTC m=+0.433180114,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-37.ec2.internal,}" Jul 06 17:51:19.975884 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.751419 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-37.ec2.internal" event="NodeHasSufficientMemory" Jul 06 17:51:19.975884 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.751446 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 17:51:19.975884 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.751456 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-37.ec2.internal" event="NodeHasSufficientPID" Jul 06 17:51:19.975884 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.756038 2578 policy_none.go:49] "None policy: Start" Jul 06 17:51:19.975884 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.756053 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 17:51:19.975884 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.756071 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 17:51:19.975884 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.759292 2578 policy_none.go:47] "Start" Jul 06 17:51:19.975884 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.789592 2578 manager.go:337] "Starting Device Plugin manager" Jul 06 17:51:19.975884 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:19.789634 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 17:51:19.975884 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.789647 2578 server.go:87] "Starting device plugin registration server" Jul 06 17:51:19.975884 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.789887 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 17:51:19.975884 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.789913 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 17:51:19.975884 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.789998 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 17:51:19.975884 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.790090 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 17:51:19.975884 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.790099 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 17:51:19.975884 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:19.790602 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 17:51:19.975884 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:19.790655 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-37.ec2.internal\" not found" Jul 06 17:51:19.975884 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.890748 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 17:51:19.975884 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.891693 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-37.ec2.internal" event="NodeHasSufficientMemory" Jul 06 17:51:19.975884 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.891721 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 17:51:19.975884 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.891731 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-37.ec2.internal" event="NodeHasSufficientPID" Jul 06 17:51:19.975884 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.891757 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-37.ec2.internal" Jul 06 17:51:19.975884 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:19.901812 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-37.ec2.internal" Jul 06 17:51:19.975884 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:19.901831 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-37.ec2.internal\": node \"ip-10-0-130-37.ec2.internal\" not found" Jul 06 17:51:19.975884 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:19.928723 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-37.ec2.internal\" not found" Jul 06 17:51:20.095348 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:20.029542 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-37.ec2.internal\" not found" Jul 06 17:51:20.218435 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:20.129856 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-37.ec2.internal\" not found" Jul 06 17:51:20.236956 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:20.230168 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-37.ec2.internal\" not found" Jul 06 17:51:20.353823 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:20.330473 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-37.ec2.internal\" not found" Jul 06 17:51:20.488889 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:20.430801 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-37.ec2.internal\" not found" Jul 06 17:51:20.612829 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:20.531098 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-37.ec2.internal\" not found" Jul 06 17:51:20.734856 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:20.631839 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-37.ec2.internal\" not found" Jul 06 17:51:20.734856 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:20.732274 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-37.ec2.internal\" not found" Jul 06 17:51:20.826876 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:20.826833 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 17:46:20 +0000 UTC" deadline="2027-12-12 17:33:10.985424863 +0000 UTC" Jul 06 17:51:20.826876 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:20.826872 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12575h41m50.158558332s" Jul 06 17:51:20.827082 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:20.826886 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 17:51:20.832358 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:20.832336 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-37.ec2.internal\" not found" Jul 06 17:51:20.847929 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:20.847906 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 17:51:20.927016 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:20.926988 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 17:51:20.927169 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:20.927003 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 17:51:20.928548 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:20.928525 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 17:51:20.928650 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:20.928579 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 17:51:20.928650 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:20.928604 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 17:51:20.928650 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:20.928644 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 17:51:20.931122 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:20.931082 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 17:51:21.029811 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.029716 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-37.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-37.ec2.internal"] Jul 06 17:51:21.034490 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.034469 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-37.ec2.internal" Jul 06 17:51:21.035478 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.035457 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-37.ec2.internal" Jul 06 17:51:21.053664 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.053645 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-37.ec2.internal" Jul 06 17:51:21.058272 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.058259 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-37.ec2.internal" Jul 06 17:51:21.068488 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.068475 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 17:51:21.072441 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.072419 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 17:51:21.127921 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.127899 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/88cc1f4e97892cc43b170f4401e7dc5f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-37.ec2.internal\" (UID: \"88cc1f4e97892cc43b170f4401e7dc5f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-37.ec2.internal" Jul 06 17:51:21.127991 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.127928 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88cc1f4e97892cc43b170f4401e7dc5f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-37.ec2.internal\" (UID: \"88cc1f4e97892cc43b170f4401e7dc5f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-37.ec2.internal" Jul 06 17:51:21.127991 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.127946 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5dd462233376de3e85db0937786544c4-config\") pod \"kube-apiserver-proxy-ip-10-0-130-37.ec2.internal\" (UID: \"5dd462233376de3e85db0937786544c4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-37.ec2.internal" Jul 06 17:51:21.228526 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.228449 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/88cc1f4e97892cc43b170f4401e7dc5f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-37.ec2.internal\" (UID: \"88cc1f4e97892cc43b170f4401e7dc5f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-37.ec2.internal" Jul 06 17:51:21.228526 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.228523 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88cc1f4e97892cc43b170f4401e7dc5f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-37.ec2.internal\" (UID: \"88cc1f4e97892cc43b170f4401e7dc5f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-37.ec2.internal" Jul 06 17:51:21.228747 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.228542 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5dd462233376de3e85db0937786544c4-config\") pod \"kube-apiserver-proxy-ip-10-0-130-37.ec2.internal\" (UID: \"5dd462233376de3e85db0937786544c4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-37.ec2.internal" Jul 06 17:51:21.228747 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.228564 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88cc1f4e97892cc43b170f4401e7dc5f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-37.ec2.internal\" (UID: \"88cc1f4e97892cc43b170f4401e7dc5f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-37.ec2.internal" Jul 06 17:51:21.228747 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.228592 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5dd462233376de3e85db0937786544c4-config\") pod \"kube-apiserver-proxy-ip-10-0-130-37.ec2.internal\" (UID: \"5dd462233376de3e85db0937786544c4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-37.ec2.internal" Jul 06 17:51:21.228747 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.228563 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/88cc1f4e97892cc43b170f4401e7dc5f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-37.ec2.internal\" (UID: \"88cc1f4e97892cc43b170f4401e7dc5f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-37.ec2.internal" Jul 06 17:51:21.373904 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.373832 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-37.ec2.internal" Jul 06 17:51:21.376159 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.376116 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-37.ec2.internal" Jul 06 17:51:21.827286 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.827203 2578 apiserver.go:52] "Watching apiserver" Jul 06 17:51:21.827286 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.827238 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 17:51:21.830284 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.830265 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 17:51:21.837911 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.837889 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 17:51:21.838322 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.838303 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 17:51:21.839987 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.839966 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-2fsf2","kube-system/kube-apiserver-proxy-ip-10-0-130-37.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjhn2","openshift-cluster-node-tuning-operator/tuned-6qbmw","openshift-dns/node-resolver-g89hv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-37.ec2.internal","openshift-network-diagnostics/network-check-target-nvnv9","openshift-ovn-kubernetes/ovnkube-node-l4xhs","kube-system/konnectivity-agent-vg7jb","openshift-image-registry/node-ca-d69n6","openshift-multus/multus-additional-cni-plugins-r7nfr","openshift-multus/multus-tv84v","openshift-multus/network-metrics-daemon-gslrl","openshift-network-operator/iptables-alerter-h248v"] Jul 06 17:51:21.841446 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.841430 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:51:21.841522 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:21.841503 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvnv9" podUID="5900d925-dd5e-42a4-9d0f-5bd224512165" Jul 06 17:51:21.842647 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.842630 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:21.842714 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:21.842697 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gslrl" podUID="bc43abe6-169b-482f-8d32-088a668e1820" Jul 06 17:51:21.843987 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.843971 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjhn2" Jul 06 17:51:21.845410 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.845388 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:21.846408 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.846387 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6lm29\"" Jul 06 17:51:21.846559 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.846416 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 17:51:21.846962 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.846629 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 17:51:21.846962 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.846653 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-g89hv" Jul 06 17:51:21.846962 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.846846 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 17:51:21.847635 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.847617 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 17:51:21.847744 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.847726 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 17:51:21.847791 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.847742 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-t89xh\"" Jul 06 17:51:21.848622 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.848608 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h248v" Jul 06 17:51:21.849183 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.849168 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 17:51:21.849744 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.849728 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 17:51:21.849819 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.849728 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-22mbk\"" Jul 06 17:51:21.850275 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.850255 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vg7jb" Jul 06 17:51:21.850937 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.850922 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 17:51:21.850998 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.850961 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 17:51:21.851101 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.851089 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 17:51:21.851152 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.851139 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vnths\"" Jul 06 17:51:21.851736 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.851719 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:21.851817 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:21.851796 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fsf2" podUID="3c9b8055-863b-43b0-8f1c-594c43656713" Jul 06 17:51:21.852489 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.852454 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 17:51:21.852665 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.852651 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mxs8f\"" Jul 06 17:51:21.853075 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.853058 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 17:51:21.853433 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.853419 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:21.855279 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.855258 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d69n6" Jul 06 17:51:21.855723 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.855701 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-47kvm\"" Jul 06 17:51:21.855973 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.855957 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 17:51:21.856065 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.855971 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 17:51:21.856065 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.855965 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 17:51:21.856392 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.856357 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 17:51:21.856392 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.856363 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 17:51:21.856657 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.856642 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 17:51:21.857334 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.857317 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r7nfr" Jul 06 17:51:21.857730 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.857705 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 17:51:21.857880 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.857852 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 17:51:21.857961 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.857909 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4txcc\"" Jul 06 17:51:21.858026 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.858000 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 17:51:21.858991 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.858972 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tv84v" Jul 06 17:51:21.859953 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.859933 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 17:51:21.860079 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.859978 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 17:51:21.860079 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.859988 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 17:51:21.860258 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.860240 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-v4v74\"" Jul 06 17:51:21.860336 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.860320 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 17:51:21.860401 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.860385 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 17:51:21.861548 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.861530 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 17:51:21.861796 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.861780 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hqfj2\"" Jul 06 17:51:21.918230 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.918207 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 17:51:21.931052 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.931022 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-cnibin\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:21.931173 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.931093 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-host-var-lib-kubelet\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:21.931241 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.931165 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/555137f2-da9f-4814-a9b9-91b82e0bf677-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r7nfr\" (UID: \"555137f2-da9f-4814-a9b9-91b82e0bf677\") " pod="openshift-multus/multus-additional-cni-plugins-r7nfr" Jul 06 17:51:21.931241 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.931209 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj2k7\" (UniqueName: \"kubernetes.io/projected/a4728752-6c91-40e4-9673-bc1f893d8fb2-kube-api-access-mj2k7\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:21.931241 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.931233 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bdf6bc9-0fd5-4579-98af-ab7b066fa383-tmp-dir\") pod \"node-resolver-g89hv\" (UID: \"0bdf6bc9-0fd5-4579-98af-ab7b066fa383\") " pod="openshift-dns/node-resolver-g89hv" Jul 06 17:51:21.931393 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.931263 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/555137f2-da9f-4814-a9b9-91b82e0bf677-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r7nfr\" (UID: \"555137f2-da9f-4814-a9b9-91b82e0bf677\") " pod="openshift-multus/multus-additional-cni-plugins-r7nfr" Jul 06 17:51:21.931393 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.931283 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-systemd-units\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:21.931393 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.931309 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-etc-openvswitch\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:21.931393 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.931352 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-host-run-k8s-cni-cncf-io\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:21.931393 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.931369 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/555137f2-da9f-4814-a9b9-91b82e0bf677-os-release\") pod \"multus-additional-cni-plugins-r7nfr\" (UID: \"555137f2-da9f-4814-a9b9-91b82e0bf677\") " pod="openshift-multus/multus-additional-cni-plugins-r7nfr" Jul 06 17:51:21.931635 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.931450 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a4728752-6c91-40e4-9673-bc1f893d8fb2-etc-tuned\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:21.931635 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.931489 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-host-run-multus-certs\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:21.931635 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.931518 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-host-run-netns\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:21.931635 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.931543 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-log-socket\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:21.931635 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.931589 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/186d6dfb-0592-4ff7-8587-bdddd2d55c98-ovnkube-script-lib\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:21.931819 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.931631 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-etc-kubernetes\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:21.931819 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.931660 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/675bfef8-48e9-4a87-826f-d49b0f97d176-registration-dir\") pod \"aws-ebs-csi-driver-node-tjhn2\" (UID: \"675bfef8-48e9-4a87-826f-d49b0f97d176\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjhn2" Jul 06 17:51:21.931819 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.931690 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/675bfef8-48e9-4a87-826f-d49b0f97d176-sys-fs\") pod \"aws-ebs-csi-driver-node-tjhn2\" (UID: \"675bfef8-48e9-4a87-826f-d49b0f97d176\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjhn2" Jul 06 17:51:21.931819 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.931718 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-run-ovn\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:21.931819 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.931741 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/675bfef8-48e9-4a87-826f-d49b0f97d176-socket-dir\") pod \"aws-ebs-csi-driver-node-tjhn2\" (UID: \"675bfef8-48e9-4a87-826f-d49b0f97d176\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjhn2" Jul 06 17:51:21.931819 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.931767 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/186d6dfb-0592-4ff7-8587-bdddd2d55c98-ovn-node-metrics-cert\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:21.931819 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.931794 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-system-cni-dir\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:21.932070 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.931840 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-multus-conf-dir\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:21.932070 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.931882 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-multus-daemon-config\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:21.932070 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.931908 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/675bfef8-48e9-4a87-826f-d49b0f97d176-etc-selinux\") pod \"aws-ebs-csi-driver-node-tjhn2\" (UID: \"675bfef8-48e9-4a87-826f-d49b0f97d176\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjhn2" Jul 06 17:51:21.932070 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.931932 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3c9b8055-863b-43b0-8f1c-594c43656713-dbus\") pod \"global-pull-secret-syncer-2fsf2\" (UID: \"3c9b8055-863b-43b0-8f1c-594c43656713\") " pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:21.932070 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.931958 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c9b8055-863b-43b0-8f1c-594c43656713-original-pull-secret\") pod \"global-pull-secret-syncer-2fsf2\" (UID: \"3c9b8055-863b-43b0-8f1c-594c43656713\") " pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:21.932070 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.931987 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/186d6dfb-0592-4ff7-8587-bdddd2d55c98-env-overrides\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:21.932070 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932013 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-host-run-netns\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:21.932070 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932038 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-etc-kubernetes\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:21.932453 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932088 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/040449c9-0499-40a7-b0e9-0e070b07932b-iptables-alerter-script\") pod \"iptables-alerter-h248v\" (UID: \"040449c9-0499-40a7-b0e9-0e070b07932b\") " pod="openshift-network-operator/iptables-alerter-h248v" Jul 06 17:51:21.932453 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932115 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:21.932453 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932158 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-host-var-lib-cni-bin\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:21.932453 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932184 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ed64f8b7-31b6-4d4b-9ca7-59783916ed57-serviceca\") pod \"node-ca-d69n6\" (UID: \"ed64f8b7-31b6-4d4b-9ca7-59783916ed57\") " pod="openshift-image-registry/node-ca-d69n6" Jul 06 17:51:21.932453 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932207 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-etc-sysconfig\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:21.932453 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932230 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ba941728-b986-47c7-b4d9-468ccf455c1f-agent-certs\") pod \"konnectivity-agent-vg7jb\" (UID: \"ba941728-b986-47c7-b4d9-468ccf455c1f\") " pod="kube-system/konnectivity-agent-vg7jb" Jul 06 17:51:21.932453 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932254 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed64f8b7-31b6-4d4b-9ca7-59783916ed57-host\") pod \"node-ca-d69n6\" (UID: \"ed64f8b7-31b6-4d4b-9ca7-59783916ed57\") " pod="openshift-image-registry/node-ca-d69n6" Jul 06 17:51:21.932453 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932295 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/555137f2-da9f-4814-a9b9-91b82e0bf677-system-cni-dir\") pod \"multus-additional-cni-plugins-r7nfr\" (UID: \"555137f2-da9f-4814-a9b9-91b82e0bf677\") " pod="openshift-multus/multus-additional-cni-plugins-r7nfr" Jul 06 17:51:21.932453 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932327 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/555137f2-da9f-4814-a9b9-91b82e0bf677-cnibin\") pod \"multus-additional-cni-plugins-r7nfr\" (UID: \"555137f2-da9f-4814-a9b9-91b82e0bf677\") " pod="openshift-multus/multus-additional-cni-plugins-r7nfr" Jul 06 17:51:21.932453 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932353 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-etc-sysctl-conf\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:21.932453 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932381 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-etc-systemd\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:21.932453 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932407 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0bdf6bc9-0fd5-4579-98af-ab7b066fa383-hosts-file\") pod \"node-resolver-g89hv\" (UID: \"0bdf6bc9-0fd5-4579-98af-ab7b066fa383\") " pod="openshift-dns/node-resolver-g89hv" Jul 06 17:51:21.932453 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932430 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-host-cni-netd\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:21.932453 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932454 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdc6z\" (UniqueName: \"kubernetes.io/projected/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-kube-api-access-tdc6z\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:21.933161 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932478 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg95r\" (UniqueName: \"kubernetes.io/projected/675bfef8-48e9-4a87-826f-d49b0f97d176-kube-api-access-tg95r\") pod \"aws-ebs-csi-driver-node-tjhn2\" (UID: \"675bfef8-48e9-4a87-826f-d49b0f97d176\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjhn2" Jul 06 17:51:21.933161 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932506 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-var-lib-kubelet\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:21.933161 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932529 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szdzz\" (UniqueName: \"kubernetes.io/projected/0bdf6bc9-0fd5-4579-98af-ab7b066fa383-kube-api-access-szdzz\") pod \"node-resolver-g89hv\" (UID: \"0bdf6bc9-0fd5-4579-98af-ab7b066fa383\") " pod="openshift-dns/node-resolver-g89hv" Jul 06 17:51:21.933161 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932558 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-var-lib-openvswitch\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:21.933161 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932603 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-host-cni-bin\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:21.933161 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932628 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-os-release\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:21.933161 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932653 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-host-var-lib-cni-multus\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:21.933161 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932677 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-hostroot\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:21.933161 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932702 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/675bfef8-48e9-4a87-826f-d49b0f97d176-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tjhn2\" (UID: \"675bfef8-48e9-4a87-826f-d49b0f97d176\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjhn2" Jul 06 17:51:21.933161 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932727 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-lib-modules\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:21.933161 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932759 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-host-kubelet\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:21.933161 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932783 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-host-slash\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:21.933161 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932809 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-cni-binary-copy\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:21.933161 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932834 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-multus-socket-dir-parent\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:21.933723 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932858 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ba941728-b986-47c7-b4d9-468ccf455c1f-konnectivity-ca\") pod \"konnectivity-agent-vg7jb\" (UID: \"ba941728-b986-47c7-b4d9-468ccf455c1f\") " pod="kube-system/konnectivity-agent-vg7jb" Jul 06 17:51:21.933723 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932885 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzspk\" (UniqueName: \"kubernetes.io/projected/040449c9-0499-40a7-b0e9-0e070b07932b-kube-api-access-rzspk\") pod \"iptables-alerter-h248v\" (UID: \"040449c9-0499-40a7-b0e9-0e070b07932b\") " pod="openshift-network-operator/iptables-alerter-h248v" Jul 06 17:51:21.933723 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932909 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-multus-cni-dir\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:21.933723 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932956 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/675bfef8-48e9-4a87-826f-d49b0f97d176-device-dir\") pod \"aws-ebs-csi-driver-node-tjhn2\" (UID: \"675bfef8-48e9-4a87-826f-d49b0f97d176\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjhn2" Jul 06 17:51:21.933723 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.932984 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3c9b8055-863b-43b0-8f1c-594c43656713-kubelet-config\") pod \"global-pull-secret-syncer-2fsf2\" (UID: \"3c9b8055-863b-43b0-8f1c-594c43656713\") " pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:21.933723 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.933008 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/555137f2-da9f-4814-a9b9-91b82e0bf677-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r7nfr\" (UID: \"555137f2-da9f-4814-a9b9-91b82e0bf677\") " pod="openshift-multus/multus-additional-cni-plugins-r7nfr" Jul 06 17:51:21.933723 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.933040 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc43abe6-169b-482f-8d32-088a668e1820-metrics-certs\") pod \"network-metrics-daemon-gslrl\" (UID: \"bc43abe6-169b-482f-8d32-088a668e1820\") " pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:21.933723 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.933067 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbxgq\" (UniqueName: \"kubernetes.io/projected/bc43abe6-169b-482f-8d32-088a668e1820-kube-api-access-sbxgq\") pod \"network-metrics-daemon-gslrl\" (UID: \"bc43abe6-169b-482f-8d32-088a668e1820\") " pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:21.933723 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.933114 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-etc-modprobe-d\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:21.933723 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.933162 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-etc-sysctl-d\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:21.933723 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.933185 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-run\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:21.933723 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.933210 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-run-openvswitch\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:21.933723 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.933235 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-node-log\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:21.934127 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.933260 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-host-run-ovn-kubernetes\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:21.934127 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.933295 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-host\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:21.934127 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.933324 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/040449c9-0499-40a7-b0e9-0e070b07932b-host-slash\") pod \"iptables-alerter-h248v\" (UID: \"040449c9-0499-40a7-b0e9-0e070b07932b\") " pod="openshift-network-operator/iptables-alerter-h248v" Jul 06 17:51:21.934127 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.933348 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfnc4\" (UniqueName: \"kubernetes.io/projected/186d6dfb-0592-4ff7-8587-bdddd2d55c98-kube-api-access-dfnc4\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:21.934127 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.933366 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9pnh\" (UniqueName: \"kubernetes.io/projected/5900d925-dd5e-42a4-9d0f-5bd224512165-kube-api-access-c9pnh\") pod \"network-check-target-nvnv9\" (UID: \"5900d925-dd5e-42a4-9d0f-5bd224512165\") " pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:51:21.934127 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.933381 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jwzc\" (UniqueName: \"kubernetes.io/projected/ed64f8b7-31b6-4d4b-9ca7-59783916ed57-kube-api-access-9jwzc\") pod \"node-ca-d69n6\" (UID: \"ed64f8b7-31b6-4d4b-9ca7-59783916ed57\") " pod="openshift-image-registry/node-ca-d69n6" Jul 06 17:51:21.934127 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.933399 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/555137f2-da9f-4814-a9b9-91b82e0bf677-cni-binary-copy\") pod \"multus-additional-cni-plugins-r7nfr\" (UID: \"555137f2-da9f-4814-a9b9-91b82e0bf677\") " pod="openshift-multus/multus-additional-cni-plugins-r7nfr" Jul 06 17:51:21.934127 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.933422 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqnq5\" (UniqueName: \"kubernetes.io/projected/555137f2-da9f-4814-a9b9-91b82e0bf677-kube-api-access-pqnq5\") pod \"multus-additional-cni-plugins-r7nfr\" (UID: \"555137f2-da9f-4814-a9b9-91b82e0bf677\") " pod="openshift-multus/multus-additional-cni-plugins-r7nfr" Jul 06 17:51:21.934127 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.933438 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-sys\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:21.934127 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.933453 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4728752-6c91-40e4-9673-bc1f893d8fb2-tmp\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:21.934127 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.933468 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-run-systemd\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:21.934127 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.933491 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/186d6dfb-0592-4ff7-8587-bdddd2d55c98-ovnkube-config\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:21.954547 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.954520 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5kdn7" Jul 06 17:51:21.961592 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:21.961570 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5kdn7" Jul 06 17:51:22.007646 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:22.007609 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dd462233376de3e85db0937786544c4.slice/crio-3b4b382072183ec08b0e458316a60a7457b84aac20add5e26a1fdf4a781004a2 WatchSource:0}: Error finding container 3b4b382072183ec08b0e458316a60a7457b84aac20add5e26a1fdf4a781004a2: Status 404 returned error can't find the container with id 3b4b382072183ec08b0e458316a60a7457b84aac20add5e26a1fdf4a781004a2 Jul 06 17:51:22.008239 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:22.008217 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88cc1f4e97892cc43b170f4401e7dc5f.slice/crio-f88396a4c6fbdc2369dbdf1d2422f381c367ad82853ab3ebde4ff9c5c5dcf124 WatchSource:0}: Error finding container f88396a4c6fbdc2369dbdf1d2422f381c367ad82853ab3ebde4ff9c5c5dcf124: Status 404 returned error can't find the container with id f88396a4c6fbdc2369dbdf1d2422f381c367ad82853ab3ebde4ff9c5c5dcf124 Jul 06 17:51:22.012234 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.012216 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 17:51:22.034006 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.033981 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/555137f2-da9f-4814-a9b9-91b82e0bf677-os-release\") pod \"multus-additional-cni-plugins-r7nfr\" (UID: \"555137f2-da9f-4814-a9b9-91b82e0bf677\") " pod="openshift-multus/multus-additional-cni-plugins-r7nfr" Jul 06 17:51:22.034118 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.034011 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a4728752-6c91-40e4-9673-bc1f893d8fb2-etc-tuned\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:22.034118 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.034031 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-host-run-multus-certs\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.034118 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.034059 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-host-run-netns\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.034118 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.034110 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-host-run-netns\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.034299 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.034142 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-log-socket\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.034299 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.034141 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/555137f2-da9f-4814-a9b9-91b82e0bf677-os-release\") pod \"multus-additional-cni-plugins-r7nfr\" (UID: \"555137f2-da9f-4814-a9b9-91b82e0bf677\") " pod="openshift-multus/multus-additional-cni-plugins-r7nfr" Jul 06 17:51:22.034299 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.034158 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/186d6dfb-0592-4ff7-8587-bdddd2d55c98-ovnkube-script-lib\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.034299 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.034141 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-host-run-multus-certs\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.034299 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.034176 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-etc-kubernetes\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.034299 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.034217 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-etc-kubernetes\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.034299 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.034217 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-log-socket\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.034636 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.034329 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 17:51:22.034636 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.034392 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/675bfef8-48e9-4a87-826f-d49b0f97d176-registration-dir\") pod \"aws-ebs-csi-driver-node-tjhn2\" (UID: \"675bfef8-48e9-4a87-826f-d49b0f97d176\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjhn2" Jul 06 17:51:22.034636 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.034337 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/675bfef8-48e9-4a87-826f-d49b0f97d176-registration-dir\") pod \"aws-ebs-csi-driver-node-tjhn2\" (UID: \"675bfef8-48e9-4a87-826f-d49b0f97d176\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjhn2" Jul 06 17:51:22.034636 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.034450 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/675bfef8-48e9-4a87-826f-d49b0f97d176-sys-fs\") pod \"aws-ebs-csi-driver-node-tjhn2\" (UID: \"675bfef8-48e9-4a87-826f-d49b0f97d176\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjhn2" Jul 06 17:51:22.034636 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.034477 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-run-ovn\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.034636 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.034503 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/675bfef8-48e9-4a87-826f-d49b0f97d176-socket-dir\") pod \"aws-ebs-csi-driver-node-tjhn2\" (UID: \"675bfef8-48e9-4a87-826f-d49b0f97d176\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjhn2" Jul 06 17:51:22.034915 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.034862 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/675bfef8-48e9-4a87-826f-d49b0f97d176-sys-fs\") pod \"aws-ebs-csi-driver-node-tjhn2\" (UID: \"675bfef8-48e9-4a87-826f-d49b0f97d176\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjhn2" Jul 06 17:51:22.034971 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.034893 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/675bfef8-48e9-4a87-826f-d49b0f97d176-socket-dir\") pod \"aws-ebs-csi-driver-node-tjhn2\" (UID: \"675bfef8-48e9-4a87-826f-d49b0f97d176\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjhn2" Jul 06 17:51:22.034971 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.034942 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/186d6dfb-0592-4ff7-8587-bdddd2d55c98-ovn-node-metrics-cert\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.035079 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.035011 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-system-cni-dir\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.035079 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.035024 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-run-ovn\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.035079 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.035064 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-multus-conf-dir\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.035251 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.035135 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-multus-conf-dir\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.035251 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.035160 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-system-cni-dir\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.035251 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.035204 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/186d6dfb-0592-4ff7-8587-bdddd2d55c98-ovnkube-script-lib\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.037840 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.037815 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-multus-daemon-config\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.037953 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.037867 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/675bfef8-48e9-4a87-826f-d49b0f97d176-etc-selinux\") pod \"aws-ebs-csi-driver-node-tjhn2\" (UID: \"675bfef8-48e9-4a87-826f-d49b0f97d176\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjhn2" Jul 06 17:51:22.037953 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.037899 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3c9b8055-863b-43b0-8f1c-594c43656713-dbus\") pod \"global-pull-secret-syncer-2fsf2\" (UID: \"3c9b8055-863b-43b0-8f1c-594c43656713\") " pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:22.037953 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.037930 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c9b8055-863b-43b0-8f1c-594c43656713-original-pull-secret\") pod \"global-pull-secret-syncer-2fsf2\" (UID: \"3c9b8055-863b-43b0-8f1c-594c43656713\") " pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:22.038144 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.037956 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/186d6dfb-0592-4ff7-8587-bdddd2d55c98-env-overrides\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.038144 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.037986 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-host-run-netns\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.038144 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.038038 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/675bfef8-48e9-4a87-826f-d49b0f97d176-etc-selinux\") pod \"aws-ebs-csi-driver-node-tjhn2\" (UID: \"675bfef8-48e9-4a87-826f-d49b0f97d176\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjhn2" Jul 06 17:51:22.038144 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.038070 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-etc-kubernetes\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:22.038144 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:22.038114 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 17:51:22.038144 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.038134 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/040449c9-0499-40a7-b0e9-0e070b07932b-iptables-alerter-script\") pod \"iptables-alerter-h248v\" (UID: \"040449c9-0499-40a7-b0e9-0e070b07932b\") " pod="openshift-network-operator/iptables-alerter-h248v" Jul 06 17:51:22.038454 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.038171 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.038454 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:22.038253 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c9b8055-863b-43b0-8f1c-594c43656713-original-pull-secret podName:3c9b8055-863b-43b0-8f1c-594c43656713 nodeName:}" failed. No retries permitted until 2026-07-06 17:51:22.538183877 +0000 UTC m=+3.222790849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3c9b8055-863b-43b0-8f1c-594c43656713-original-pull-secret") pod "global-pull-secret-syncer-2fsf2" (UID: "3c9b8055-863b-43b0-8f1c-594c43656713") : object "kube-system"/"original-pull-secret" not registered Jul 06 17:51:22.038454 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.038290 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-etc-kubernetes\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:22.038454 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.038296 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-host-var-lib-cni-bin\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.038454 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.038353 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ed64f8b7-31b6-4d4b-9ca7-59783916ed57-serviceca\") pod \"node-ca-d69n6\" (UID: \"ed64f8b7-31b6-4d4b-9ca7-59783916ed57\") " pod="openshift-image-registry/node-ca-d69n6" Jul 06 17:51:22.038454 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.038372 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3c9b8055-863b-43b0-8f1c-594c43656713-dbus\") pod \"global-pull-secret-syncer-2fsf2\" (UID: \"3c9b8055-863b-43b0-8f1c-594c43656713\") " pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:22.038454 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.038426 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.038842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.038497 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-etc-sysconfig\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:22.038842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.038545 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-host-var-lib-cni-bin\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.038842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.038631 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-etc-sysconfig\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:22.038842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.038681 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ba941728-b986-47c7-b4d9-468ccf455c1f-agent-certs\") pod \"konnectivity-agent-vg7jb\" (UID: \"ba941728-b986-47c7-b4d9-468ccf455c1f\") " pod="kube-system/konnectivity-agent-vg7jb" Jul 06 17:51:22.038842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.038714 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed64f8b7-31b6-4d4b-9ca7-59783916ed57-host\") pod \"node-ca-d69n6\" (UID: \"ed64f8b7-31b6-4d4b-9ca7-59783916ed57\") " pod="openshift-image-registry/node-ca-d69n6" Jul 06 17:51:22.038842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.038742 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/555137f2-da9f-4814-a9b9-91b82e0bf677-system-cni-dir\") pod \"multus-additional-cni-plugins-r7nfr\" (UID: \"555137f2-da9f-4814-a9b9-91b82e0bf677\") " pod="openshift-multus/multus-additional-cni-plugins-r7nfr" Jul 06 17:51:22.038842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.038796 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/040449c9-0499-40a7-b0e9-0e070b07932b-iptables-alerter-script\") pod \"iptables-alerter-h248v\" (UID: \"040449c9-0499-40a7-b0e9-0e070b07932b\") " pod="openshift-network-operator/iptables-alerter-h248v" Jul 06 17:51:22.038842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.038837 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-host-run-netns\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.039352 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.038838 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/555137f2-da9f-4814-a9b9-91b82e0bf677-system-cni-dir\") pod \"multus-additional-cni-plugins-r7nfr\" (UID: \"555137f2-da9f-4814-a9b9-91b82e0bf677\") " pod="openshift-multus/multus-additional-cni-plugins-r7nfr" Jul 06 17:51:22.039352 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.038872 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/555137f2-da9f-4814-a9b9-91b82e0bf677-cnibin\") pod \"multus-additional-cni-plugins-r7nfr\" (UID: \"555137f2-da9f-4814-a9b9-91b82e0bf677\") " pod="openshift-multus/multus-additional-cni-plugins-r7nfr" Jul 06 17:51:22.039352 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.038897 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-etc-sysctl-conf\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:22.039352 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.038917 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-etc-systemd\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:22.039352 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.038939 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0bdf6bc9-0fd5-4579-98af-ab7b066fa383-hosts-file\") pod \"node-resolver-g89hv\" (UID: \"0bdf6bc9-0fd5-4579-98af-ab7b066fa383\") " pod="openshift-dns/node-resolver-g89hv" Jul 06 17:51:22.039352 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.038983 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-multus-daemon-config\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.039352 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039002 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0bdf6bc9-0fd5-4579-98af-ab7b066fa383-hosts-file\") pod \"node-resolver-g89hv\" (UID: \"0bdf6bc9-0fd5-4579-98af-ab7b066fa383\") " pod="openshift-dns/node-resolver-g89hv" Jul 06 17:51:22.039352 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039037 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/555137f2-da9f-4814-a9b9-91b82e0bf677-cnibin\") pod \"multus-additional-cni-plugins-r7nfr\" (UID: \"555137f2-da9f-4814-a9b9-91b82e0bf677\") " pod="openshift-multus/multus-additional-cni-plugins-r7nfr" Jul 06 17:51:22.039352 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039048 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-host-cni-netd\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.039352 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039064 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ed64f8b7-31b6-4d4b-9ca7-59783916ed57-serviceca\") pod \"node-ca-d69n6\" (UID: \"ed64f8b7-31b6-4d4b-9ca7-59783916ed57\") " pod="openshift-image-registry/node-ca-d69n6" Jul 06 17:51:22.039352 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039087 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdc6z\" (UniqueName: \"kubernetes.io/projected/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-kube-api-access-tdc6z\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.039352 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039115 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg95r\" (UniqueName: \"kubernetes.io/projected/675bfef8-48e9-4a87-826f-d49b0f97d176-kube-api-access-tg95r\") pod \"aws-ebs-csi-driver-node-tjhn2\" (UID: \"675bfef8-48e9-4a87-826f-d49b0f97d176\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjhn2" Jul 06 17:51:22.039352 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039166 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-etc-systemd\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:22.039352 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039174 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-etc-sysctl-conf\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:22.039352 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039202 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-var-lib-kubelet\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:22.040112 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039245 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-var-lib-kubelet\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:22.040112 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039269 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szdzz\" (UniqueName: \"kubernetes.io/projected/0bdf6bc9-0fd5-4579-98af-ab7b066fa383-kube-api-access-szdzz\") pod \"node-resolver-g89hv\" (UID: \"0bdf6bc9-0fd5-4579-98af-ab7b066fa383\") " pod="openshift-dns/node-resolver-g89hv" Jul 06 17:51:22.040112 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039303 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-var-lib-openvswitch\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.040112 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039323 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed64f8b7-31b6-4d4b-9ca7-59783916ed57-host\") pod \"node-ca-d69n6\" (UID: \"ed64f8b7-31b6-4d4b-9ca7-59783916ed57\") " pod="openshift-image-registry/node-ca-d69n6" Jul 06 17:51:22.040112 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039336 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-host-cni-bin\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.040112 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039369 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-os-release\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.040112 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039427 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-var-lib-openvswitch\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.040112 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039440 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-os-release\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.040112 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039466 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-host-var-lib-cni-multus\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.040112 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039487 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-host-cni-netd\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.040112 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039506 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-hostroot\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.040112 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039535 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-host-var-lib-cni-multus\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.040112 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039546 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/675bfef8-48e9-4a87-826f-d49b0f97d176-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tjhn2\" (UID: \"675bfef8-48e9-4a87-826f-d49b0f97d176\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjhn2" Jul 06 17:51:22.040112 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039558 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-hostroot\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.040112 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039493 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-host-cni-bin\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.040900 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039591 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-lib-modules\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:22.040900 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039607 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/675bfef8-48e9-4a87-826f-d49b0f97d176-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tjhn2\" (UID: \"675bfef8-48e9-4a87-826f-d49b0f97d176\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjhn2" Jul 06 17:51:22.040900 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039626 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-host-kubelet\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.040900 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039666 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-host-slash\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.040900 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039711 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-lib-modules\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:22.040900 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039749 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-host-kubelet\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.040900 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039734 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-cni-binary-copy\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.040900 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039791 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-host-slash\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.040900 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039800 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-multus-socket-dir-parent\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.040900 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039838 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ba941728-b986-47c7-b4d9-468ccf455c1f-konnectivity-ca\") pod \"konnectivity-agent-vg7jb\" (UID: \"ba941728-b986-47c7-b4d9-468ccf455c1f\") " pod="kube-system/konnectivity-agent-vg7jb" Jul 06 17:51:22.040900 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039918 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzspk\" (UniqueName: \"kubernetes.io/projected/040449c9-0499-40a7-b0e9-0e070b07932b-kube-api-access-rzspk\") pod \"iptables-alerter-h248v\" (UID: \"040449c9-0499-40a7-b0e9-0e070b07932b\") " pod="openshift-network-operator/iptables-alerter-h248v" Jul 06 17:51:22.040900 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039962 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-multus-cni-dir\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.040900 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.039997 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/186d6dfb-0592-4ff7-8587-bdddd2d55c98-env-overrides\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.040900 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040001 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/675bfef8-48e9-4a87-826f-d49b0f97d176-device-dir\") pod \"aws-ebs-csi-driver-node-tjhn2\" (UID: \"675bfef8-48e9-4a87-826f-d49b0f97d176\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjhn2" Jul 06 17:51:22.040900 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040102 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3c9b8055-863b-43b0-8f1c-594c43656713-kubelet-config\") pod \"global-pull-secret-syncer-2fsf2\" (UID: \"3c9b8055-863b-43b0-8f1c-594c43656713\") " pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:22.041695 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040134 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/555137f2-da9f-4814-a9b9-91b82e0bf677-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r7nfr\" (UID: \"555137f2-da9f-4814-a9b9-91b82e0bf677\") " pod="openshift-multus/multus-additional-cni-plugins-r7nfr" Jul 06 17:51:22.041695 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040170 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc43abe6-169b-482f-8d32-088a668e1820-metrics-certs\") pod \"network-metrics-daemon-gslrl\" (UID: \"bc43abe6-169b-482f-8d32-088a668e1820\") " pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:22.041695 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040211 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-multus-socket-dir-parent\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.041695 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040209 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbxgq\" (UniqueName: \"kubernetes.io/projected/bc43abe6-169b-482f-8d32-088a668e1820-kube-api-access-sbxgq\") pod \"network-metrics-daemon-gslrl\" (UID: \"bc43abe6-169b-482f-8d32-088a668e1820\") " pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:22.041695 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040253 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/186d6dfb-0592-4ff7-8587-bdddd2d55c98-ovn-node-metrics-cert\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.041695 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040260 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-etc-modprobe-d\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:22.041695 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040307 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-etc-sysctl-d\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:22.041695 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040340 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-run\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:22.041695 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040353 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-etc-modprobe-d\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:22.041695 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040375 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-run-openvswitch\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.041695 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040418 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-node-log\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.041695 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040421 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-run-openvswitch\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.041695 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040456 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-host-run-ovn-kubernetes\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.041695 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040470 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a4728752-6c91-40e4-9673-bc1f893d8fb2-etc-tuned\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:22.042439 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040490 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-host\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:22.042439 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040469 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-cni-binary-copy\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.042439 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040518 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/040449c9-0499-40a7-b0e9-0e070b07932b-host-slash\") pod \"iptables-alerter-h248v\" (UID: \"040449c9-0499-40a7-b0e9-0e070b07932b\") " pod="openshift-network-operator/iptables-alerter-h248v" Jul 06 17:51:22.042439 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040526 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-etc-sysctl-d\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:22.042439 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040542 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/675bfef8-48e9-4a87-826f-d49b0f97d176-device-dir\") pod \"aws-ebs-csi-driver-node-tjhn2\" (UID: \"675bfef8-48e9-4a87-826f-d49b0f97d176\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjhn2" Jul 06 17:51:22.042439 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040588 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-host-run-ovn-kubernetes\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.042439 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040604 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-run\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:22.042439 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040658 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfnc4\" (UniqueName: \"kubernetes.io/projected/186d6dfb-0592-4ff7-8587-bdddd2d55c98-kube-api-access-dfnc4\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.042439 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040652 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-multus-cni-dir\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.042439 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040714 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9pnh\" (UniqueName: \"kubernetes.io/projected/5900d925-dd5e-42a4-9d0f-5bd224512165-kube-api-access-c9pnh\") pod \"network-check-target-nvnv9\" (UID: \"5900d925-dd5e-42a4-9d0f-5bd224512165\") " pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:51:22.042439 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040751 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jwzc\" (UniqueName: \"kubernetes.io/projected/ed64f8b7-31b6-4d4b-9ca7-59783916ed57-kube-api-access-9jwzc\") pod \"node-ca-d69n6\" (UID: \"ed64f8b7-31b6-4d4b-9ca7-59783916ed57\") " pod="openshift-image-registry/node-ca-d69n6" Jul 06 17:51:22.042439 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040779 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/555137f2-da9f-4814-a9b9-91b82e0bf677-cni-binary-copy\") pod \"multus-additional-cni-plugins-r7nfr\" (UID: \"555137f2-da9f-4814-a9b9-91b82e0bf677\") " pod="openshift-multus/multus-additional-cni-plugins-r7nfr" Jul 06 17:51:22.042439 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040817 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqnq5\" (UniqueName: \"kubernetes.io/projected/555137f2-da9f-4814-a9b9-91b82e0bf677-kube-api-access-pqnq5\") pod \"multus-additional-cni-plugins-r7nfr\" (UID: \"555137f2-da9f-4814-a9b9-91b82e0bf677\") " pod="openshift-multus/multus-additional-cni-plugins-r7nfr" Jul 06 17:51:22.042439 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040853 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-sys\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:22.042439 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040883 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4728752-6c91-40e4-9673-bc1f893d8fb2-tmp\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:22.043133 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.041152 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-run-systemd\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.043133 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.041195 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/186d6dfb-0592-4ff7-8587-bdddd2d55c98-ovnkube-config\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.043133 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.040632 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-host\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:22.043133 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.041222 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-cnibin\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.043133 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.041264 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-host-var-lib-kubelet\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.043133 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.041301 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/555137f2-da9f-4814-a9b9-91b82e0bf677-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r7nfr\" (UID: \"555137f2-da9f-4814-a9b9-91b82e0bf677\") " pod="openshift-multus/multus-additional-cni-plugins-r7nfr" Jul 06 17:51:22.043133 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.041354 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-host-var-lib-kubelet\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.043133 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.041401 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4728752-6c91-40e4-9673-bc1f893d8fb2-sys\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:22.043133 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.041546 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-run-systemd\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.043133 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:22.041557 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:51:22.043133 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:22.041630 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc43abe6-169b-482f-8d32-088a668e1820-metrics-certs podName:bc43abe6-169b-482f-8d32-088a668e1820 nodeName:}" failed. No retries permitted until 2026-07-06 17:51:22.541610565 +0000 UTC m=+3.226217520 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc43abe6-169b-482f-8d32-088a668e1820-metrics-certs") pod "network-metrics-daemon-gslrl" (UID: "bc43abe6-169b-482f-8d32-088a668e1820") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:51:22.043133 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.041652 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-cnibin\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.043133 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.041684 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/040449c9-0499-40a7-b0e9-0e070b07932b-host-slash\") pod \"iptables-alerter-h248v\" (UID: \"040449c9-0499-40a7-b0e9-0e070b07932b\") " pod="openshift-network-operator/iptables-alerter-h248v" Jul 06 17:51:22.043133 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.041695 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj2k7\" (UniqueName: \"kubernetes.io/projected/a4728752-6c91-40e4-9673-bc1f893d8fb2-kube-api-access-mj2k7\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:22.043133 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.041727 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bdf6bc9-0fd5-4579-98af-ab7b066fa383-tmp-dir\") pod \"node-resolver-g89hv\" (UID: \"0bdf6bc9-0fd5-4579-98af-ab7b066fa383\") " pod="openshift-dns/node-resolver-g89hv" Jul 06 17:51:22.043683 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.041725 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/555137f2-da9f-4814-a9b9-91b82e0bf677-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r7nfr\" (UID: \"555137f2-da9f-4814-a9b9-91b82e0bf677\") " pod="openshift-multus/multus-additional-cni-plugins-r7nfr" Jul 06 17:51:22.043683 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.041808 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-node-log\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.043683 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.041886 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3c9b8055-863b-43b0-8f1c-594c43656713-kubelet-config\") pod \"global-pull-secret-syncer-2fsf2\" (UID: \"3c9b8055-863b-43b0-8f1c-594c43656713\") " pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:22.043683 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.041943 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/555137f2-da9f-4814-a9b9-91b82e0bf677-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r7nfr\" (UID: \"555137f2-da9f-4814-a9b9-91b82e0bf677\") " pod="openshift-multus/multus-additional-cni-plugins-r7nfr" Jul 06 17:51:22.043683 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.041977 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-systemd-units\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.043683 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.042004 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/555137f2-da9f-4814-a9b9-91b82e0bf677-cni-binary-copy\") pod \"multus-additional-cni-plugins-r7nfr\" (UID: \"555137f2-da9f-4814-a9b9-91b82e0bf677\") " pod="openshift-multus/multus-additional-cni-plugins-r7nfr" Jul 06 17:51:22.043683 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.042024 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-etc-openvswitch\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.043683 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.042048 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ba941728-b986-47c7-b4d9-468ccf455c1f-agent-certs\") pod \"konnectivity-agent-vg7jb\" (UID: \"ba941728-b986-47c7-b4d9-468ccf455c1f\") " pod="kube-system/konnectivity-agent-vg7jb" Jul 06 17:51:22.043683 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.042064 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-host-run-k8s-cni-cncf-io\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.043683 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.042142 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-systemd-units\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.043683 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.042166 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-host-run-k8s-cni-cncf-io\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.043683 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.042228 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bdf6bc9-0fd5-4579-98af-ab7b066fa383-tmp-dir\") pod \"node-resolver-g89hv\" (UID: \"0bdf6bc9-0fd5-4579-98af-ab7b066fa383\") " pod="openshift-dns/node-resolver-g89hv" Jul 06 17:51:22.043683 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.042255 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/186d6dfb-0592-4ff7-8587-bdddd2d55c98-etc-openvswitch\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.043683 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.042250 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/186d6dfb-0592-4ff7-8587-bdddd2d55c98-ovnkube-config\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.044172 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.042822 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/555137f2-da9f-4814-a9b9-91b82e0bf677-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r7nfr\" (UID: \"555137f2-da9f-4814-a9b9-91b82e0bf677\") " pod="openshift-multus/multus-additional-cni-plugins-r7nfr" Jul 06 17:51:22.044172 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.043020 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/555137f2-da9f-4814-a9b9-91b82e0bf677-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r7nfr\" (UID: \"555137f2-da9f-4814-a9b9-91b82e0bf677\") " pod="openshift-multus/multus-additional-cni-plugins-r7nfr" Jul 06 17:51:22.044172 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.043215 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ba941728-b986-47c7-b4d9-468ccf455c1f-konnectivity-ca\") pod \"konnectivity-agent-vg7jb\" (UID: \"ba941728-b986-47c7-b4d9-468ccf455c1f\") " pod="kube-system/konnectivity-agent-vg7jb" Jul 06 17:51:22.044172 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.043961 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4728752-6c91-40e4-9673-bc1f893d8fb2-tmp\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:22.048264 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.048244 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdc6z\" (UniqueName: \"kubernetes.io/projected/5b3da362-9cbc-4fbc-abd9-1cbacbfb134a-kube-api-access-tdc6z\") pod \"multus-tv84v\" (UID: \"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a\") " pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.048906 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:22.048873 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 17:51:22.049002 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:22.048914 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 17:51:22.049002 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:22.048929 2578 projected.go:196] Error preparing data for projected volume kube-api-access-c9pnh for pod openshift-network-diagnostics/network-check-target-nvnv9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:51:22.049167 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:22.049102 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5900d925-dd5e-42a4-9d0f-5bd224512165-kube-api-access-c9pnh podName:5900d925-dd5e-42a4-9d0f-5bd224512165 nodeName:}" failed. No retries permitted until 2026-07-06 17:51:22.549071271 +0000 UTC m=+3.233678242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c9pnh" (UniqueName: "kubernetes.io/projected/5900d925-dd5e-42a4-9d0f-5bd224512165-kube-api-access-c9pnh") pod "network-check-target-nvnv9" (UID: "5900d925-dd5e-42a4-9d0f-5bd224512165") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:51:22.050251 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.050208 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzspk\" (UniqueName: \"kubernetes.io/projected/040449c9-0499-40a7-b0e9-0e070b07932b-kube-api-access-rzspk\") pod \"iptables-alerter-h248v\" (UID: \"040449c9-0499-40a7-b0e9-0e070b07932b\") " pod="openshift-network-operator/iptables-alerter-h248v" Jul 06 17:51:22.050890 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.050770 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jwzc\" (UniqueName: \"kubernetes.io/projected/ed64f8b7-31b6-4d4b-9ca7-59783916ed57-kube-api-access-9jwzc\") pod \"node-ca-d69n6\" (UID: \"ed64f8b7-31b6-4d4b-9ca7-59783916ed57\") " pod="openshift-image-registry/node-ca-d69n6" Jul 06 17:51:22.050890 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.050845 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szdzz\" (UniqueName: \"kubernetes.io/projected/0bdf6bc9-0fd5-4579-98af-ab7b066fa383-kube-api-access-szdzz\") pod \"node-resolver-g89hv\" (UID: \"0bdf6bc9-0fd5-4579-98af-ab7b066fa383\") " pod="openshift-dns/node-resolver-g89hv" Jul 06 17:51:22.051046 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.050983 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfnc4\" (UniqueName: \"kubernetes.io/projected/186d6dfb-0592-4ff7-8587-bdddd2d55c98-kube-api-access-dfnc4\") pod \"ovnkube-node-l4xhs\" (UID: \"186d6dfb-0592-4ff7-8587-bdddd2d55c98\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.051243 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.051225 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbxgq\" (UniqueName: \"kubernetes.io/projected/bc43abe6-169b-482f-8d32-088a668e1820-kube-api-access-sbxgq\") pod \"network-metrics-daemon-gslrl\" (UID: \"bc43abe6-169b-482f-8d32-088a668e1820\") " pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:22.051616 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.051595 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqnq5\" (UniqueName: \"kubernetes.io/projected/555137f2-da9f-4814-a9b9-91b82e0bf677-kube-api-access-pqnq5\") pod \"multus-additional-cni-plugins-r7nfr\" (UID: \"555137f2-da9f-4814-a9b9-91b82e0bf677\") " pod="openshift-multus/multus-additional-cni-plugins-r7nfr" Jul 06 17:51:22.052274 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.052254 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj2k7\" (UniqueName: \"kubernetes.io/projected/a4728752-6c91-40e4-9673-bc1f893d8fb2-kube-api-access-mj2k7\") pod \"tuned-6qbmw\" (UID: \"a4728752-6c91-40e4-9673-bc1f893d8fb2\") " pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:22.052640 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.052619 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg95r\" (UniqueName: \"kubernetes.io/projected/675bfef8-48e9-4a87-826f-d49b0f97d176-kube-api-access-tg95r\") pod \"aws-ebs-csi-driver-node-tjhn2\" (UID: \"675bfef8-48e9-4a87-826f-d49b0f97d176\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjhn2" Jul 06 17:51:22.166929 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.166847 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjhn2" Jul 06 17:51:22.175692 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:22.175664 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod675bfef8_48e9_4a87_826f_d49b0f97d176.slice/crio-b1d14fbc2501cb18958f521c386a2a943493dd3f6ec17b2749ad95299e718179 WatchSource:0}: Error finding container b1d14fbc2501cb18958f521c386a2a943493dd3f6ec17b2749ad95299e718179: Status 404 returned error can't find the container with id b1d14fbc2501cb18958f521c386a2a943493dd3f6ec17b2749ad95299e718179 Jul 06 17:51:22.206547 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.206519 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" Jul 06 17:51:22.213557 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:22.213535 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4728752_6c91_40e4_9673_bc1f893d8fb2.slice/crio-56aedc5286d2791388eb7dbed68200f54fefdef9c4c9fa113c3d7918770a1a93 WatchSource:0}: Error finding container 56aedc5286d2791388eb7dbed68200f54fefdef9c4c9fa113c3d7918770a1a93: Status 404 returned error can't find the container with id 56aedc5286d2791388eb7dbed68200f54fefdef9c4c9fa113c3d7918770a1a93 Jul 06 17:51:22.218674 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.218651 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-g89hv" Jul 06 17:51:22.225684 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:22.225663 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bdf6bc9_0fd5_4579_98af_ab7b066fa383.slice/crio-772a41e94501f8918bca3acf10303a39a2ad0469c15827532c62a41173d43a1f WatchSource:0}: Error finding container 772a41e94501f8918bca3acf10303a39a2ad0469c15827532c62a41173d43a1f: Status 404 returned error can't find the container with id 772a41e94501f8918bca3acf10303a39a2ad0469c15827532c62a41173d43a1f Jul 06 17:51:22.237369 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.237351 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h248v" Jul 06 17:51:22.244006 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:22.243986 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod040449c9_0499_40a7_b0e9_0e070b07932b.slice/crio-cd80a4d622709118db272b5da0f2fcb893a9384f681d15ab78fabc1512dce3ea WatchSource:0}: Error finding container cd80a4d622709118db272b5da0f2fcb893a9384f681d15ab78fabc1512dce3ea: Status 404 returned error can't find the container with id cd80a4d622709118db272b5da0f2fcb893a9384f681d15ab78fabc1512dce3ea Jul 06 17:51:22.252907 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.252887 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vg7jb" Jul 06 17:51:22.259651 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:22.259632 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba941728_b986_47c7_b4d9_468ccf455c1f.slice/crio-141c0627d365802cc379b5546f7b2714be8944cdda7ca152a3345b1627d2de1c WatchSource:0}: Error finding container 141c0627d365802cc379b5546f7b2714be8944cdda7ca152a3345b1627d2de1c: Status 404 returned error can't find the container with id 141c0627d365802cc379b5546f7b2714be8944cdda7ca152a3345b1627d2de1c Jul 06 17:51:22.269244 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.269227 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:22.277389 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:22.277356 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod186d6dfb_0592_4ff7_8587_bdddd2d55c98.slice/crio-0d3c7c3f68bbdc082ec9193e61b4c789a8764dab5647e666e60ebd3b4884fca6 WatchSource:0}: Error finding container 0d3c7c3f68bbdc082ec9193e61b4c789a8764dab5647e666e60ebd3b4884fca6: Status 404 returned error can't find the container with id 0d3c7c3f68bbdc082ec9193e61b4c789a8764dab5647e666e60ebd3b4884fca6 Jul 06 17:51:22.285890 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.285873 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d69n6" Jul 06 17:51:22.292614 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:22.292591 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded64f8b7_31b6_4d4b_9ca7_59783916ed57.slice/crio-193a1a2a7ee3677435cbcbf2694b9c5d58e795dff93f6cd309a3c63423caaf6b WatchSource:0}: Error finding container 193a1a2a7ee3677435cbcbf2694b9c5d58e795dff93f6cd309a3c63423caaf6b: Status 404 returned error can't find the container with id 193a1a2a7ee3677435cbcbf2694b9c5d58e795dff93f6cd309a3c63423caaf6b Jul 06 17:51:22.318296 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.318265 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r7nfr" Jul 06 17:51:22.323922 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.323898 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tv84v" Jul 06 17:51:22.326568 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:22.326545 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod555137f2_da9f_4814_a9b9_91b82e0bf677.slice/crio-af188aa8cee4ccf8689c5f6d054b90efc0859803d243f81ff7525477987af220 WatchSource:0}: Error finding container af188aa8cee4ccf8689c5f6d054b90efc0859803d243f81ff7525477987af220: Status 404 returned error can't find the container with id af188aa8cee4ccf8689c5f6d054b90efc0859803d243f81ff7525477987af220 Jul 06 17:51:22.331509 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:22.331488 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b3da362_9cbc_4fbc_abd9_1cbacbfb134a.slice/crio-859d20dc422cca3e4ebba6b67003337710ff22d20e4d26db53de7a895b68efdb WatchSource:0}: Error finding container 859d20dc422cca3e4ebba6b67003337710ff22d20e4d26db53de7a895b68efdb: Status 404 returned error can't find the container with id 859d20dc422cca3e4ebba6b67003337710ff22d20e4d26db53de7a895b68efdb Jul 06 17:51:22.546983 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.546897 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc43abe6-169b-482f-8d32-088a668e1820-metrics-certs\") pod \"network-metrics-daemon-gslrl\" (UID: \"bc43abe6-169b-482f-8d32-088a668e1820\") " pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:22.546983 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.546956 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c9b8055-863b-43b0-8f1c-594c43656713-original-pull-secret\") pod \"global-pull-secret-syncer-2fsf2\" (UID: \"3c9b8055-863b-43b0-8f1c-594c43656713\") " pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:22.547213 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:22.547066 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 17:51:22.547213 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:22.547070 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:51:22.547213 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:22.547136 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c9b8055-863b-43b0-8f1c-594c43656713-original-pull-secret podName:3c9b8055-863b-43b0-8f1c-594c43656713 nodeName:}" failed. No retries permitted until 2026-07-06 17:51:23.54712354 +0000 UTC m=+4.231730492 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3c9b8055-863b-43b0-8f1c-594c43656713-original-pull-secret") pod "global-pull-secret-syncer-2fsf2" (UID: "3c9b8055-863b-43b0-8f1c-594c43656713") : object "kube-system"/"original-pull-secret" not registered Jul 06 17:51:22.547213 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:22.547151 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc43abe6-169b-482f-8d32-088a668e1820-metrics-certs podName:bc43abe6-169b-482f-8d32-088a668e1820 nodeName:}" failed. No retries permitted until 2026-07-06 17:51:23.54714481 +0000 UTC m=+4.231751763 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc43abe6-169b-482f-8d32-088a668e1820-metrics-certs") pod "network-metrics-daemon-gslrl" (UID: "bc43abe6-169b-482f-8d32-088a668e1820") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:51:22.649131 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.649092 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9pnh\" (UniqueName: \"kubernetes.io/projected/5900d925-dd5e-42a4-9d0f-5bd224512165-kube-api-access-c9pnh\") pod \"network-check-target-nvnv9\" (UID: \"5900d925-dd5e-42a4-9d0f-5bd224512165\") " pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:51:22.649299 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:22.649224 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 17:51:22.649299 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:22.649249 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 17:51:22.649299 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:22.649260 2578 projected.go:196] Error preparing data for projected volume kube-api-access-c9pnh for pod openshift-network-diagnostics/network-check-target-nvnv9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:51:22.649432 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:22.649314 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5900d925-dd5e-42a4-9d0f-5bd224512165-kube-api-access-c9pnh podName:5900d925-dd5e-42a4-9d0f-5bd224512165 nodeName:}" failed. No retries permitted until 2026-07-06 17:51:23.649298937 +0000 UTC m=+4.333905890 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-c9pnh" (UniqueName: "kubernetes.io/projected/5900d925-dd5e-42a4-9d0f-5bd224512165-kube-api-access-c9pnh") pod "network-check-target-nvnv9" (UID: "5900d925-dd5e-42a4-9d0f-5bd224512165") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:51:22.935065 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.934918 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjhn2" event={"ID":"675bfef8-48e9-4a87-826f-d49b0f97d176","Type":"ContainerStarted","Data":"b1d14fbc2501cb18958f521c386a2a943493dd3f6ec17b2749ad95299e718179"} Jul 06 17:51:22.936940 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.936903 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-37.ec2.internal" event={"ID":"5dd462233376de3e85db0937786544c4","Type":"ContainerStarted","Data":"3b4b382072183ec08b0e458316a60a7457b84aac20add5e26a1fdf4a781004a2"} Jul 06 17:51:22.939098 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.939038 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d69n6" event={"ID":"ed64f8b7-31b6-4d4b-9ca7-59783916ed57","Type":"ContainerStarted","Data":"193a1a2a7ee3677435cbcbf2694b9c5d58e795dff93f6cd309a3c63423caaf6b"} Jul 06 17:51:22.940943 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.940915 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" event={"ID":"186d6dfb-0592-4ff7-8587-bdddd2d55c98","Type":"ContainerStarted","Data":"0d3c7c3f68bbdc082ec9193e61b4c789a8764dab5647e666e60ebd3b4884fca6"} Jul 06 17:51:22.942996 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.942966 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-37.ec2.internal" event={"ID":"88cc1f4e97892cc43b170f4401e7dc5f","Type":"ContainerStarted","Data":"f88396a4c6fbdc2369dbdf1d2422f381c367ad82853ab3ebde4ff9c5c5dcf124"} Jul 06 17:51:22.944802 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.944768 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tv84v" event={"ID":"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a","Type":"ContainerStarted","Data":"859d20dc422cca3e4ebba6b67003337710ff22d20e4d26db53de7a895b68efdb"} Jul 06 17:51:22.947173 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.947143 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7nfr" event={"ID":"555137f2-da9f-4814-a9b9-91b82e0bf677","Type":"ContainerStarted","Data":"af188aa8cee4ccf8689c5f6d054b90efc0859803d243f81ff7525477987af220"} Jul 06 17:51:22.948619 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.948584 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vg7jb" event={"ID":"ba941728-b986-47c7-b4d9-468ccf455c1f","Type":"ContainerStarted","Data":"141c0627d365802cc379b5546f7b2714be8944cdda7ca152a3345b1627d2de1c"} Jul 06 17:51:22.951456 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.951429 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h248v" event={"ID":"040449c9-0499-40a7-b0e9-0e070b07932b","Type":"ContainerStarted","Data":"cd80a4d622709118db272b5da0f2fcb893a9384f681d15ab78fabc1512dce3ea"} Jul 06 17:51:22.953069 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.953044 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-g89hv" event={"ID":"0bdf6bc9-0fd5-4579-98af-ab7b066fa383","Type":"ContainerStarted","Data":"772a41e94501f8918bca3acf10303a39a2ad0469c15827532c62a41173d43a1f"} Jul 06 17:51:22.954736 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.954712 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" event={"ID":"a4728752-6c91-40e4-9673-bc1f893d8fb2","Type":"ContainerStarted","Data":"56aedc5286d2791388eb7dbed68200f54fefdef9c4c9fa113c3d7918770a1a93"} Jul 06 17:51:22.963183 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.963150 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 17:46:22 +0000 UTC" deadline="2028-03-19 02:52:13.143685452 +0000 UTC" Jul 06 17:51:22.963285 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:22.963185 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14913h0m50.180505253s" Jul 06 17:51:23.556433 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:23.556392 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc43abe6-169b-482f-8d32-088a668e1820-metrics-certs\") pod \"network-metrics-daemon-gslrl\" (UID: \"bc43abe6-169b-482f-8d32-088a668e1820\") " pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:23.556644 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:23.556485 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c9b8055-863b-43b0-8f1c-594c43656713-original-pull-secret\") pod \"global-pull-secret-syncer-2fsf2\" (UID: \"3c9b8055-863b-43b0-8f1c-594c43656713\") " pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:23.556644 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:23.556615 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 17:51:23.556771 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:23.556683 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c9b8055-863b-43b0-8f1c-594c43656713-original-pull-secret podName:3c9b8055-863b-43b0-8f1c-594c43656713 nodeName:}" failed. No retries permitted until 2026-07-06 17:51:25.55666442 +0000 UTC m=+6.241271376 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3c9b8055-863b-43b0-8f1c-594c43656713-original-pull-secret") pod "global-pull-secret-syncer-2fsf2" (UID: "3c9b8055-863b-43b0-8f1c-594c43656713") : object "kube-system"/"original-pull-secret" not registered Jul 06 17:51:23.557137 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:23.557086 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:51:23.557236 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:23.557183 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc43abe6-169b-482f-8d32-088a668e1820-metrics-certs podName:bc43abe6-169b-482f-8d32-088a668e1820 nodeName:}" failed. No retries permitted until 2026-07-06 17:51:25.557165119 +0000 UTC m=+6.241772072 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc43abe6-169b-482f-8d32-088a668e1820-metrics-certs") pod "network-metrics-daemon-gslrl" (UID: "bc43abe6-169b-482f-8d32-088a668e1820") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:51:23.658056 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:23.658007 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9pnh\" (UniqueName: \"kubernetes.io/projected/5900d925-dd5e-42a4-9d0f-5bd224512165-kube-api-access-c9pnh\") pod \"network-check-target-nvnv9\" (UID: \"5900d925-dd5e-42a4-9d0f-5bd224512165\") " pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:51:23.658319 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:23.658296 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 17:51:23.658392 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:23.658334 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 17:51:23.658392 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:23.658349 2578 projected.go:196] Error preparing data for projected volume kube-api-access-c9pnh for pod openshift-network-diagnostics/network-check-target-nvnv9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:51:23.658568 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:23.658421 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5900d925-dd5e-42a4-9d0f-5bd224512165-kube-api-access-c9pnh podName:5900d925-dd5e-42a4-9d0f-5bd224512165 nodeName:}" failed. No retries permitted until 2026-07-06 17:51:25.658401362 +0000 UTC m=+6.343008335 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-c9pnh" (UniqueName: "kubernetes.io/projected/5900d925-dd5e-42a4-9d0f-5bd224512165-kube-api-access-c9pnh") pod "network-check-target-nvnv9" (UID: "5900d925-dd5e-42a4-9d0f-5bd224512165") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:51:23.930193 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:23.929562 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:23.930193 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:23.929693 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:51:23.930193 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:23.929708 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gslrl" podUID="bc43abe6-169b-482f-8d32-088a668e1820" Jul 06 17:51:23.930193 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:23.929805 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvnv9" podUID="5900d925-dd5e-42a4-9d0f-5bd224512165" Jul 06 17:51:23.930193 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:23.929866 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:23.930193 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:23.929942 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fsf2" podUID="3c9b8055-863b-43b0-8f1c-594c43656713" Jul 06 17:51:23.964140 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:23.964077 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 17:46:22 +0000 UTC" deadline="2027-12-02 03:45:12.953148216 +0000 UTC" Jul 06 17:51:23.964140 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:23.964137 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12321h53m48.989015197s" Jul 06 17:51:25.576038 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:25.575984 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c9b8055-863b-43b0-8f1c-594c43656713-original-pull-secret\") pod \"global-pull-secret-syncer-2fsf2\" (UID: \"3c9b8055-863b-43b0-8f1c-594c43656713\") " pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:25.576500 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:25.576071 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc43abe6-169b-482f-8d32-088a668e1820-metrics-certs\") pod \"network-metrics-daemon-gslrl\" (UID: \"bc43abe6-169b-482f-8d32-088a668e1820\") " pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:25.576500 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:25.576158 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 17:51:25.576500 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:25.576205 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:51:25.576500 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:25.576244 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c9b8055-863b-43b0-8f1c-594c43656713-original-pull-secret podName:3c9b8055-863b-43b0-8f1c-594c43656713 nodeName:}" failed. No retries permitted until 2026-07-06 17:51:29.576215239 +0000 UTC m=+10.260822208 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3c9b8055-863b-43b0-8f1c-594c43656713-original-pull-secret") pod "global-pull-secret-syncer-2fsf2" (UID: "3c9b8055-863b-43b0-8f1c-594c43656713") : object "kube-system"/"original-pull-secret" not registered Jul 06 17:51:25.576500 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:25.576267 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc43abe6-169b-482f-8d32-088a668e1820-metrics-certs podName:bc43abe6-169b-482f-8d32-088a668e1820 nodeName:}" failed. No retries permitted until 2026-07-06 17:51:29.576256016 +0000 UTC m=+10.260862973 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc43abe6-169b-482f-8d32-088a668e1820-metrics-certs") pod "network-metrics-daemon-gslrl" (UID: "bc43abe6-169b-482f-8d32-088a668e1820") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:51:25.676698 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:25.676580 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9pnh\" (UniqueName: \"kubernetes.io/projected/5900d925-dd5e-42a4-9d0f-5bd224512165-kube-api-access-c9pnh\") pod \"network-check-target-nvnv9\" (UID: \"5900d925-dd5e-42a4-9d0f-5bd224512165\") " pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:51:25.676869 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:25.676789 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 17:51:25.676869 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:25.676812 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 17:51:25.676869 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:25.676825 2578 projected.go:196] Error preparing data for projected volume kube-api-access-c9pnh for pod openshift-network-diagnostics/network-check-target-nvnv9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:51:25.677089 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:25.676885 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5900d925-dd5e-42a4-9d0f-5bd224512165-kube-api-access-c9pnh podName:5900d925-dd5e-42a4-9d0f-5bd224512165 nodeName:}" failed. No retries permitted until 2026-07-06 17:51:29.676866321 +0000 UTC m=+10.361473286 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-c9pnh" (UniqueName: "kubernetes.io/projected/5900d925-dd5e-42a4-9d0f-5bd224512165-kube-api-access-c9pnh") pod "network-check-target-nvnv9" (UID: "5900d925-dd5e-42a4-9d0f-5bd224512165") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:51:25.929919 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:25.929815 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:51:25.930110 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:25.929958 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvnv9" podUID="5900d925-dd5e-42a4-9d0f-5bd224512165" Jul 06 17:51:25.930195 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:25.930168 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:25.930323 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:25.930290 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gslrl" podUID="bc43abe6-169b-482f-8d32-088a668e1820" Jul 06 17:51:25.930393 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:25.930356 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:25.930467 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:25.930446 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fsf2" podUID="3c9b8055-863b-43b0-8f1c-594c43656713" Jul 06 17:51:27.929489 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:27.929451 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:27.929489 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:27.929470 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:27.929989 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:27.929451 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:51:27.929989 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:27.929585 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fsf2" podUID="3c9b8055-863b-43b0-8f1c-594c43656713" Jul 06 17:51:27.929989 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:27.929683 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvnv9" podUID="5900d925-dd5e-42a4-9d0f-5bd224512165" Jul 06 17:51:27.929989 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:27.929783 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gslrl" podUID="bc43abe6-169b-482f-8d32-088a668e1820" Jul 06 17:51:29.608138 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:29.608096 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc43abe6-169b-482f-8d32-088a668e1820-metrics-certs\") pod \"network-metrics-daemon-gslrl\" (UID: \"bc43abe6-169b-482f-8d32-088a668e1820\") " pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:29.608615 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:29.608167 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c9b8055-863b-43b0-8f1c-594c43656713-original-pull-secret\") pod \"global-pull-secret-syncer-2fsf2\" (UID: \"3c9b8055-863b-43b0-8f1c-594c43656713\") " pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:29.608615 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:29.608281 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 17:51:29.608615 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:29.608321 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:51:29.608615 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:29.608360 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c9b8055-863b-43b0-8f1c-594c43656713-original-pull-secret podName:3c9b8055-863b-43b0-8f1c-594c43656713 nodeName:}" failed. No retries permitted until 2026-07-06 17:51:37.608338608 +0000 UTC m=+18.292945559 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3c9b8055-863b-43b0-8f1c-594c43656713-original-pull-secret") pod "global-pull-secret-syncer-2fsf2" (UID: "3c9b8055-863b-43b0-8f1c-594c43656713") : object "kube-system"/"original-pull-secret" not registered Jul 06 17:51:29.608615 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:29.608380 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc43abe6-169b-482f-8d32-088a668e1820-metrics-certs podName:bc43abe6-169b-482f-8d32-088a668e1820 nodeName:}" failed. No retries permitted until 2026-07-06 17:51:37.608370515 +0000 UTC m=+18.292977471 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc43abe6-169b-482f-8d32-088a668e1820-metrics-certs") pod "network-metrics-daemon-gslrl" (UID: "bc43abe6-169b-482f-8d32-088a668e1820") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:51:29.709489 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:29.709454 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9pnh\" (UniqueName: \"kubernetes.io/projected/5900d925-dd5e-42a4-9d0f-5bd224512165-kube-api-access-c9pnh\") pod \"network-check-target-nvnv9\" (UID: \"5900d925-dd5e-42a4-9d0f-5bd224512165\") " pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:51:29.709698 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:29.709673 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 17:51:29.709763 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:29.709708 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 17:51:29.709763 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:29.709725 2578 projected.go:196] Error preparing data for projected volume kube-api-access-c9pnh for pod openshift-network-diagnostics/network-check-target-nvnv9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:51:29.709843 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:29.709793 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5900d925-dd5e-42a4-9d0f-5bd224512165-kube-api-access-c9pnh podName:5900d925-dd5e-42a4-9d0f-5bd224512165 nodeName:}" failed. No retries permitted until 2026-07-06 17:51:37.709774424 +0000 UTC m=+18.394381398 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-c9pnh" (UniqueName: "kubernetes.io/projected/5900d925-dd5e-42a4-9d0f-5bd224512165-kube-api-access-c9pnh") pod "network-check-target-nvnv9" (UID: "5900d925-dd5e-42a4-9d0f-5bd224512165") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:51:29.929711 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:29.929629 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:29.929711 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:29.929659 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:29.929918 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:29.929644 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:51:29.929918 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:29.929748 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fsf2" podUID="3c9b8055-863b-43b0-8f1c-594c43656713" Jul 06 17:51:29.929918 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:29.929798 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gslrl" podUID="bc43abe6-169b-482f-8d32-088a668e1820" Jul 06 17:51:29.929918 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:29.929875 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvnv9" podUID="5900d925-dd5e-42a4-9d0f-5bd224512165" Jul 06 17:51:31.929816 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:31.929362 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:31.929816 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:31.929387 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:31.929816 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:31.929387 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:51:31.929816 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:31.929508 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gslrl" podUID="bc43abe6-169b-482f-8d32-088a668e1820" Jul 06 17:51:31.929816 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:31.929557 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvnv9" podUID="5900d925-dd5e-42a4-9d0f-5bd224512165" Jul 06 17:51:31.929816 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:31.929619 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fsf2" podUID="3c9b8055-863b-43b0-8f1c-594c43656713" Jul 06 17:51:33.929592 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:33.929409 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:51:33.930050 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:33.929447 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:33.930050 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:33.929679 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvnv9" podUID="5900d925-dd5e-42a4-9d0f-5bd224512165" Jul 06 17:51:33.930050 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:33.929781 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fsf2" podUID="3c9b8055-863b-43b0-8f1c-594c43656713" Jul 06 17:51:33.930050 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:33.929482 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:33.930050 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:33.929880 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gslrl" podUID="bc43abe6-169b-482f-8d32-088a668e1820" Jul 06 17:51:33.996871 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:33.996828 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" event={"ID":"a4728752-6c91-40e4-9673-bc1f893d8fb2","Type":"ContainerStarted","Data":"c2612ed0f8e8a34c3862850f316e4b0e10408dccb682342df241c25804a823ac"} Jul 06 17:51:33.999377 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:33.998984 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-37.ec2.internal" event={"ID":"5dd462233376de3e85db0937786544c4","Type":"ContainerStarted","Data":"dbde32a9587264f84789fe9535915c7164bf8f978cd6beaa691f90f102268b08"} Jul 06 17:51:34.018140 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:34.017557 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6qbmw" podStartSLOduration=2.534461254 podStartE2EDuration="14.017536653s" totalImagesPullingTime="11.483075399s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:51:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:51:34.01676595 +0000 UTC m=+14.701372924" watchObservedRunningTime="2026-07-06 17:51:34.017536653 +0000 UTC m=+14.702143626" Jul 06 17:51:34.033382 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:34.032923 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-37.ec2.internal" podStartSLOduration=13.03290247 podStartE2EDuration="13.03290247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:51:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:51:34.032079275 +0000 UTC m=+14.716686249" watchObservedRunningTime="2026-07-06 17:51:34.03290247 +0000 UTC m=+14.717509446" Jul 06 17:51:35.003767 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:35.003445 2578 generic.go:356] "Generic (PLEG): container finished" podID="555137f2-da9f-4814-a9b9-91b82e0bf677" containerID="9e6e2af544fd0dbe0b2266313b6a062d94449efe91b81b57197038f9c5fa769c" exitCode=0 Jul 06 17:51:35.003767 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:35.003627 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7nfr" event={"ID":"555137f2-da9f-4814-a9b9-91b82e0bf677","Type":"ContainerDied","Data":"9e6e2af544fd0dbe0b2266313b6a062d94449efe91b81b57197038f9c5fa769c"} Jul 06 17:51:35.005599 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:35.005571 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vg7jb" event={"ID":"ba941728-b986-47c7-b4d9-468ccf455c1f","Type":"ContainerStarted","Data":"a3b90e9a634c735ae2edda013366bd4984b510604a4c201d046bdf2d48ccd6ca"} Jul 06 17:51:35.007638 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:35.007611 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-g89hv" event={"ID":"0bdf6bc9-0fd5-4579-98af-ab7b066fa383","Type":"ContainerStarted","Data":"10462aecd273d9dc22443d8f62f2c6be995fbb7413caebd12b11e91bb3e60ddc"} Jul 06 17:51:35.009625 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:35.009601 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjhn2" event={"ID":"675bfef8-48e9-4a87-826f-d49b0f97d176","Type":"ContainerStarted","Data":"d3ae4a8d2cd133cec8b54496680a7489088a1fc324e347435783029168624f4b"} Jul 06 17:51:35.011636 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:35.011613 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d69n6" event={"ID":"ed64f8b7-31b6-4d4b-9ca7-59783916ed57","Type":"ContainerStarted","Data":"c6d05ed3c06b3346c35608383e9b5b4fe23123e9afa818b5c8c020265a166ad4"} Jul 06 17:51:35.013315 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:35.013295 2578 generic.go:356] "Generic (PLEG): container finished" podID="88cc1f4e97892cc43b170f4401e7dc5f" containerID="e970843485a862dc9d9a201052a2e353d317b4261378001c9c6cca8bf0ecd0c9" exitCode=0 Jul 06 17:51:35.013406 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:35.013323 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-37.ec2.internal" event={"ID":"88cc1f4e97892cc43b170f4401e7dc5f","Type":"ContainerDied","Data":"e970843485a862dc9d9a201052a2e353d317b4261378001c9c6cca8bf0ecd0c9"} Jul 06 17:51:35.050453 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:35.050383 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-d69n6" podStartSLOduration=3.6470455729999998 podStartE2EDuration="15.050361632s" totalImagesPullingTime="11.403316059s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:51:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:51:35.050129227 +0000 UTC m=+15.734736218" watchObservedRunningTime="2026-07-06 17:51:35.050361632 +0000 UTC m=+15.734968605" Jul 06 17:51:35.094051 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:35.093597 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-g89hv" podStartSLOduration=3.671177845 podStartE2EDuration="15.093579196s" totalImagesPullingTime="11.422401351s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:51:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:51:35.093357835 +0000 UTC m=+15.777964810" watchObservedRunningTime="2026-07-06 17:51:35.093579196 +0000 UTC m=+15.778186169" Jul 06 17:51:35.111200 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:35.111145 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vg7jb" podStartSLOduration=3.673628598 podStartE2EDuration="15.111128116s" totalImagesPullingTime="11.437499518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:51:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:51:35.111080203 +0000 UTC m=+15.795687193" watchObservedRunningTime="2026-07-06 17:51:35.111128116 +0000 UTC m=+15.795735088" Jul 06 17:51:35.929681 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:35.929648 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:35.929835 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:35.929652 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:51:35.929835 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:35.929756 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gslrl" podUID="bc43abe6-169b-482f-8d32-088a668e1820" Jul 06 17:51:35.929835 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:35.929652 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:35.929984 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:35.929832 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvnv9" podUID="5900d925-dd5e-42a4-9d0f-5bd224512165" Jul 06 17:51:35.929984 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:35.929926 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fsf2" podUID="3c9b8055-863b-43b0-8f1c-594c43656713" Jul 06 17:51:36.017899 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:36.017859 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h248v" event={"ID":"040449c9-0499-40a7-b0e9-0e070b07932b","Type":"ContainerStarted","Data":"7baed3ada9381b74ef038ca10d36f812d197d18ea97ecd354ee713b71cbdb9b3"} Jul 06 17:51:36.043302 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:36.043246 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-h248v" podStartSLOduration=4.583883736 podStartE2EDuration="16.043228186s" totalImagesPullingTime="11.45934445s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:51:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:51:36.04314725 +0000 UTC m=+16.727754238" watchObservedRunningTime="2026-07-06 17:51:36.043228186 +0000 UTC m=+16.727835157" Jul 06 17:51:37.672683 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:37.672645 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc43abe6-169b-482f-8d32-088a668e1820-metrics-certs\") pod \"network-metrics-daemon-gslrl\" (UID: \"bc43abe6-169b-482f-8d32-088a668e1820\") " pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:37.673264 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:37.672727 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c9b8055-863b-43b0-8f1c-594c43656713-original-pull-secret\") pod \"global-pull-secret-syncer-2fsf2\" (UID: \"3c9b8055-863b-43b0-8f1c-594c43656713\") " pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:37.673264 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:37.672804 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 17:51:37.673264 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:37.672869 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c9b8055-863b-43b0-8f1c-594c43656713-original-pull-secret podName:3c9b8055-863b-43b0-8f1c-594c43656713 nodeName:}" failed. No retries permitted until 2026-07-06 17:51:53.672849802 +0000 UTC m=+34.357456753 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3c9b8055-863b-43b0-8f1c-594c43656713-original-pull-secret") pod "global-pull-secret-syncer-2fsf2" (UID: "3c9b8055-863b-43b0-8f1c-594c43656713") : object "kube-system"/"original-pull-secret" not registered Jul 06 17:51:37.673264 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:37.672803 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:51:37.673264 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:37.672970 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc43abe6-169b-482f-8d32-088a668e1820-metrics-certs podName:bc43abe6-169b-482f-8d32-088a668e1820 nodeName:}" failed. No retries permitted until 2026-07-06 17:51:53.672945194 +0000 UTC m=+34.357552156 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc43abe6-169b-482f-8d32-088a668e1820-metrics-certs") pod "network-metrics-daemon-gslrl" (UID: "bc43abe6-169b-482f-8d32-088a668e1820") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:51:37.773508 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:37.773467 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9pnh\" (UniqueName: \"kubernetes.io/projected/5900d925-dd5e-42a4-9d0f-5bd224512165-kube-api-access-c9pnh\") pod \"network-check-target-nvnv9\" (UID: \"5900d925-dd5e-42a4-9d0f-5bd224512165\") " pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:51:37.773672 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:37.773627 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 17:51:37.773672 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:37.773650 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 17:51:37.773672 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:37.773663 2578 projected.go:196] Error preparing data for projected volume kube-api-access-c9pnh for pod openshift-network-diagnostics/network-check-target-nvnv9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:51:37.773789 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:37.773728 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5900d925-dd5e-42a4-9d0f-5bd224512165-kube-api-access-c9pnh podName:5900d925-dd5e-42a4-9d0f-5bd224512165 nodeName:}" failed. No retries permitted until 2026-07-06 17:51:53.77371271 +0000 UTC m=+34.458319673 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-c9pnh" (UniqueName: "kubernetes.io/projected/5900d925-dd5e-42a4-9d0f-5bd224512165-kube-api-access-c9pnh") pod "network-check-target-nvnv9" (UID: "5900d925-dd5e-42a4-9d0f-5bd224512165") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:51:37.929509 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:37.929427 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:37.929509 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:37.929460 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:51:37.929509 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:37.929460 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:37.929767 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:37.929550 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fsf2" podUID="3c9b8055-863b-43b0-8f1c-594c43656713" Jul 06 17:51:37.929767 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:37.929614 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvnv9" podUID="5900d925-dd5e-42a4-9d0f-5bd224512165" Jul 06 17:51:37.929767 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:37.929688 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gslrl" podUID="bc43abe6-169b-482f-8d32-088a668e1820" Jul 06 17:51:39.335385 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:39.335346 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vg7jb" Jul 06 17:51:39.336091 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:39.336039 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vg7jb" Jul 06 17:51:39.928973 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:39.928933 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:39.928973 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:39.928959 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:39.928973 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:39.928972 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:51:39.929264 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:39.929118 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gslrl" podUID="bc43abe6-169b-482f-8d32-088a668e1820" Jul 06 17:51:39.929319 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:39.929263 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fsf2" podUID="3c9b8055-863b-43b0-8f1c-594c43656713" Jul 06 17:51:39.929407 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:39.929384 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvnv9" podUID="5900d925-dd5e-42a4-9d0f-5bd224512165" Jul 06 17:51:40.025894 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:40.025865 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vg7jb" Jul 06 17:51:40.026562 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:40.026537 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vg7jb" Jul 06 17:51:41.929515 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:41.929488 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:41.930077 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:41.929596 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:51:41.930077 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:41.929701 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvnv9" podUID="5900d925-dd5e-42a4-9d0f-5bd224512165" Jul 06 17:51:41.930077 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:41.929597 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gslrl" podUID="bc43abe6-169b-482f-8d32-088a668e1820" Jul 06 17:51:41.930077 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:41.929602 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:41.930077 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:41.929823 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fsf2" podUID="3c9b8055-863b-43b0-8f1c-594c43656713" Jul 06 17:51:43.499338 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:43.499156 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 17:51:43.840304 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:43.840224 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T17:51:43.499337168Z","UUID":"30dadda2-60de-4487-aad2-1217917aa148","Handler":null,"Name":"","Endpoint":""} Jul 06 17:51:43.841490 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:43.841474 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 17:51:43.841568 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:43.841507 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 17:51:43.929411 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:43.929377 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:43.929411 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:43.929402 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:43.929654 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:43.929513 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fsf2" podUID="3c9b8055-863b-43b0-8f1c-594c43656713" Jul 06 17:51:43.929654 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:43.929540 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:51:43.929766 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:43.929669 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gslrl" podUID="bc43abe6-169b-482f-8d32-088a668e1820" Jul 06 17:51:43.929766 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:43.929751 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvnv9" podUID="5900d925-dd5e-42a4-9d0f-5bd224512165" Jul 06 17:51:44.036737 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:44.036662 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjhn2" event={"ID":"675bfef8-48e9-4a87-826f-d49b0f97d176","Type":"ContainerStarted","Data":"acf26d39a8645f604aec0bb5fb8d6c6ac3b4833a9eccd337ff41db2ec75b15f9"} Jul 06 17:51:44.039217 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:44.039192 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" event={"ID":"186d6dfb-0592-4ff7-8587-bdddd2d55c98","Type":"ContainerStarted","Data":"fbf8b48894986d1afe593c15b6af6814a6f3d5bf4e6c8716d5538f12be30671e"} Jul 06 17:51:44.039355 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:44.039260 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" event={"ID":"186d6dfb-0592-4ff7-8587-bdddd2d55c98","Type":"ContainerStarted","Data":"3976fe68d2cc2b6b99b003680b58dbc93c619f521ce29252e4143e6b52822dd6"} Jul 06 17:51:44.039355 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:44.039292 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" event={"ID":"186d6dfb-0592-4ff7-8587-bdddd2d55c98","Type":"ContainerStarted","Data":"b2ca76aacd2646fa5e01a875345bd011480d098744a03127131f3d0f5343bd6e"} Jul 06 17:51:44.039355 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:44.039324 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" event={"ID":"186d6dfb-0592-4ff7-8587-bdddd2d55c98","Type":"ContainerStarted","Data":"81f748fe067039dbc55ce20ff743d7e87e8a3fe9bd4d5daf9fe9c5d47c9b01c2"} Jul 06 17:51:44.039355 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:44.039355 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" event={"ID":"186d6dfb-0592-4ff7-8587-bdddd2d55c98","Type":"ContainerStarted","Data":"bc9e2d683419ff82fce27f98084a73add7e0956b8e9dce6de7cc46dededb39a1"} Jul 06 17:51:44.039539 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:44.039381 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" event={"ID":"186d6dfb-0592-4ff7-8587-bdddd2d55c98","Type":"ContainerStarted","Data":"540ccfd2da89f25b6374589d627c724e2f260fd78bf576e25c8f2a92e750a578"} Jul 06 17:51:44.040915 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:44.040893 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-37.ec2.internal" event={"ID":"88cc1f4e97892cc43b170f4401e7dc5f","Type":"ContainerStarted","Data":"3c06c12b09236cad00be5f30b472419e11fd05c67dddccd2b11fff1d134c0ef9"} Jul 06 17:51:44.042244 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:44.042224 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tv84v" event={"ID":"5b3da362-9cbc-4fbc-abd9-1cbacbfb134a","Type":"ContainerStarted","Data":"79c75d390ff5f374f9edc207f59c155a80c90ea2f7019cd3f67e62f8d445d737"} Jul 06 17:51:44.057622 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:44.057582 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-37.ec2.internal" podStartSLOduration=23.057570322 podStartE2EDuration="23.057570322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:51:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:51:44.05725627 +0000 UTC m=+24.741863243" watchObservedRunningTime="2026-07-06 17:51:44.057570322 +0000 UTC m=+24.742177295" Jul 06 17:51:44.077278 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:44.077225 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tv84v" podStartSLOduration=3.257639474 podStartE2EDuration="24.077215241s" totalImagesPullingTime="20.819575767s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:51:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:51:44.076758019 +0000 UTC m=+24.761364992" watchObservedRunningTime="2026-07-06 17:51:44.077215241 +0000 UTC m=+24.761822213" Jul 06 17:51:45.929411 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:45.929214 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:51:45.929815 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:45.929240 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:45.929815 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:45.929477 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvnv9" podUID="5900d925-dd5e-42a4-9d0f-5bd224512165" Jul 06 17:51:45.929815 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:45.929280 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:45.929815 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:45.929550 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fsf2" podUID="3c9b8055-863b-43b0-8f1c-594c43656713" Jul 06 17:51:45.929815 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:45.929642 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gslrl" podUID="bc43abe6-169b-482f-8d32-088a668e1820" Jul 06 17:51:46.049017 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:46.048987 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjhn2" event={"ID":"675bfef8-48e9-4a87-826f-d49b0f97d176","Type":"ContainerStarted","Data":"7331495acae017afa707a9845e242d0a8a019f286ac74308c1b7045d5a7c6e4c"} Jul 06 17:51:46.073648 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:46.073580 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjhn2" podStartSLOduration=3.893238122 podStartE2EDuration="26.073565547s" totalImagesPullingTime="22.180327425s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:51:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:51:46.073304134 +0000 UTC m=+26.757911130" watchObservedRunningTime="2026-07-06 17:51:46.073565547 +0000 UTC m=+26.758172519" Jul 06 17:51:47.054597 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:47.054550 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" event={"ID":"186d6dfb-0592-4ff7-8587-bdddd2d55c98","Type":"ContainerStarted","Data":"e389a36d8ab2f166a14020852ed29d948fcaa46f216441fd89b795ee939a98fc"} Jul 06 17:51:47.929181 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:47.929152 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:47.929371 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:47.929152 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:47.929371 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:47.929251 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fsf2" podUID="3c9b8055-863b-43b0-8f1c-594c43656713" Jul 06 17:51:47.929371 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:47.929346 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gslrl" podUID="bc43abe6-169b-482f-8d32-088a668e1820" Jul 06 17:51:47.929371 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:47.929152 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:51:47.929561 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:47.929440 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvnv9" podUID="5900d925-dd5e-42a4-9d0f-5bd224512165" Jul 06 17:51:49.065401 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:49.065358 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" event={"ID":"186d6dfb-0592-4ff7-8587-bdddd2d55c98","Type":"ContainerStarted","Data":"5dfc7a8b60520b20f0d7566f9f0fd611c14b405a750fda17d5cd1a0b47d2de3c"} Jul 06 17:51:49.066178 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:49.065677 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:49.066178 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:49.065750 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:49.081383 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:49.081360 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:49.097222 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:49.097174 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" podStartSLOduration=8.181794807 podStartE2EDuration="29.097161925s" totalImagesPullingTime="20.915367118s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:51:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:51:49.096625772 +0000 UTC m=+29.781232745" watchObservedRunningTime="2026-07-06 17:51:49.097161925 +0000 UTC m=+29.781768898" Jul 06 17:51:49.929963 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:49.929767 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:51:49.930145 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:49.929823 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:49.930145 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:49.930075 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvnv9" podUID="5900d925-dd5e-42a4-9d0f-5bd224512165" Jul 06 17:51:49.930145 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:49.929835 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:49.930281 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:49.930161 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fsf2" podUID="3c9b8055-863b-43b0-8f1c-594c43656713" Jul 06 17:51:49.930281 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:49.930203 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gslrl" podUID="bc43abe6-169b-482f-8d32-088a668e1820" Jul 06 17:51:50.068377 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:50.068328 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:50.084676 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:50.084653 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:51:50.475000 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:50.474967 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nvnv9"] Jul 06 17:51:50.475183 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:50.475092 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:51:50.475183 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:50.475173 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvnv9" podUID="5900d925-dd5e-42a4-9d0f-5bd224512165" Jul 06 17:51:50.476917 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:50.476889 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gslrl"] Jul 06 17:51:50.477068 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:50.476974 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:50.477126 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:50.477079 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gslrl" podUID="bc43abe6-169b-482f-8d32-088a668e1820" Jul 06 17:51:50.487777 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:50.487742 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2fsf2"] Jul 06 17:51:50.487900 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:50.487853 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:50.487967 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:50.487950 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fsf2" podUID="3c9b8055-863b-43b0-8f1c-594c43656713" Jul 06 17:51:51.929772 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:51.929735 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:51:51.930144 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:51.929836 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:51.930144 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:51.929844 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvnv9" podUID="5900d925-dd5e-42a4-9d0f-5bd224512165" Jul 06 17:51:51.930144 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:51.929863 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:51.930144 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:51.929929 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fsf2" podUID="3c9b8055-863b-43b0-8f1c-594c43656713" Jul 06 17:51:51.930144 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:51.930002 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gslrl" podUID="bc43abe6-169b-482f-8d32-088a668e1820" Jul 06 17:51:52.074081 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:52.074046 2578 generic.go:356] "Generic (PLEG): container finished" podID="555137f2-da9f-4814-a9b9-91b82e0bf677" containerID="ef15b1f0f93d110ad9b2f8dea755e63b094afa89fcf4645b7e877e3dc011e96b" exitCode=0 Jul 06 17:51:52.074235 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:52.074118 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7nfr" event={"ID":"555137f2-da9f-4814-a9b9-91b82e0bf677","Type":"ContainerDied","Data":"ef15b1f0f93d110ad9b2f8dea755e63b094afa89fcf4645b7e877e3dc011e96b"} Jul 06 17:51:53.078141 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:53.078113 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7nfr" event={"ID":"555137f2-da9f-4814-a9b9-91b82e0bf677","Type":"ContainerStarted","Data":"c662235315ea52d51e1dd51b3563afeb3f26777069a4c4e6e23931ffbaab7325"} Jul 06 17:51:53.697835 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:53.697801 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c9b8055-863b-43b0-8f1c-594c43656713-original-pull-secret\") pod \"global-pull-secret-syncer-2fsf2\" (UID: \"3c9b8055-863b-43b0-8f1c-594c43656713\") " pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:53.697972 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:53.697854 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc43abe6-169b-482f-8d32-088a668e1820-metrics-certs\") pod \"network-metrics-daemon-gslrl\" (UID: \"bc43abe6-169b-482f-8d32-088a668e1820\") " pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:53.697972 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:53.697952 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:51:53.698081 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:53.698003 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc43abe6-169b-482f-8d32-088a668e1820-metrics-certs podName:bc43abe6-169b-482f-8d32-088a668e1820 nodeName:}" failed. No retries permitted until 2026-07-06 17:52:25.69799035 +0000 UTC m=+66.382597301 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc43abe6-169b-482f-8d32-088a668e1820-metrics-certs") pod "network-metrics-daemon-gslrl" (UID: "bc43abe6-169b-482f-8d32-088a668e1820") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:51:53.698081 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:53.697953 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 17:51:53.698166 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:53.698087 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c9b8055-863b-43b0-8f1c-594c43656713-original-pull-secret podName:3c9b8055-863b-43b0-8f1c-594c43656713 nodeName:}" failed. No retries permitted until 2026-07-06 17:52:25.698075107 +0000 UTC m=+66.382682062 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3c9b8055-863b-43b0-8f1c-594c43656713-original-pull-secret") pod "global-pull-secret-syncer-2fsf2" (UID: "3c9b8055-863b-43b0-8f1c-594c43656713") : object "kube-system"/"original-pull-secret" not registered Jul 06 17:51:53.798934 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:53.798899 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9pnh\" (UniqueName: \"kubernetes.io/projected/5900d925-dd5e-42a4-9d0f-5bd224512165-kube-api-access-c9pnh\") pod \"network-check-target-nvnv9\" (UID: \"5900d925-dd5e-42a4-9d0f-5bd224512165\") " pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:51:53.799095 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:53.799052 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 17:51:53.799095 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:53.799066 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 17:51:53.799095 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:53.799074 2578 projected.go:196] Error preparing data for projected volume kube-api-access-c9pnh for pod openshift-network-diagnostics/network-check-target-nvnv9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:51:53.799213 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:53.799121 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5900d925-dd5e-42a4-9d0f-5bd224512165-kube-api-access-c9pnh podName:5900d925-dd5e-42a4-9d0f-5bd224512165 nodeName:}" failed. No retries permitted until 2026-07-06 17:52:25.799108892 +0000 UTC m=+66.483715856 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-c9pnh" (UniqueName: "kubernetes.io/projected/5900d925-dd5e-42a4-9d0f-5bd224512165-kube-api-access-c9pnh") pod "network-check-target-nvnv9" (UID: "5900d925-dd5e-42a4-9d0f-5bd224512165") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:51:53.929463 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:53.929431 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:53.929610 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:53.929431 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:53.929610 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:53.929531 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gslrl" podUID="bc43abe6-169b-482f-8d32-088a668e1820" Jul 06 17:51:53.929743 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:53.929620 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fsf2" podUID="3c9b8055-863b-43b0-8f1c-594c43656713" Jul 06 17:51:53.929743 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:53.929431 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:51:53.929823 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:53.929772 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvnv9" podUID="5900d925-dd5e-42a4-9d0f-5bd224512165" Jul 06 17:51:54.082793 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:54.082702 2578 generic.go:356] "Generic (PLEG): container finished" podID="555137f2-da9f-4814-a9b9-91b82e0bf677" containerID="c662235315ea52d51e1dd51b3563afeb3f26777069a4c4e6e23931ffbaab7325" exitCode=0 Jul 06 17:51:54.082793 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:54.082752 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7nfr" event={"ID":"555137f2-da9f-4814-a9b9-91b82e0bf677","Type":"ContainerDied","Data":"c662235315ea52d51e1dd51b3563afeb3f26777069a4c4e6e23931ffbaab7325"} Jul 06 17:51:55.929215 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:55.928952 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:55.929787 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:55.929003 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:51:55.929787 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:55.929260 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gslrl" podUID="bc43abe6-169b-482f-8d32-088a668e1820" Jul 06 17:51:55.929787 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:55.929007 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:55.929787 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:55.929305 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nvnv9" podUID="5900d925-dd5e-42a4-9d0f-5bd224512165" Jul 06 17:51:55.929787 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:55.929368 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fsf2" podUID="3c9b8055-863b-43b0-8f1c-594c43656713" Jul 06 17:51:56.045502 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.045476 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-37.ec2.internal" event="NodeReady" Jul 06 17:51:56.045682 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.045616 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 17:51:56.090006 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.089973 2578 generic.go:356] "Generic (PLEG): container finished" podID="555137f2-da9f-4814-a9b9-91b82e0bf677" containerID="4b20a721b1acd92374437486f2168363012228a7f092bfe0795c3698e05b28a8" exitCode=0 Jul 06 17:51:56.090170 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.090053 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7nfr" event={"ID":"555137f2-da9f-4814-a9b9-91b82e0bf677","Type":"ContainerDied","Data":"4b20a721b1acd92374437486f2168363012228a7f092bfe0795c3698e05b28a8"} Jul 06 17:51:56.097892 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.097870 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65dbddffdc-k6pjs"] Jul 06 17:51:56.099919 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.099905 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:51:56.102861 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.102845 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 17:51:56.102971 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.102894 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 17:51:56.103149 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.103136 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 17:51:56.103562 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.103546 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-74rbm\"" Jul 06 17:51:56.110195 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.110176 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 17:51:56.117131 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.117113 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-f6glh"] Jul 06 17:51:56.118741 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.118728 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f6glh" Jul 06 17:51:56.122787 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.122746 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 17:51:56.122881 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.122771 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 17:51:56.123118 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.123103 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pm8pm\"" Jul 06 17:51:56.123474 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.123375 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-474kx"] Jul 06 17:51:56.125539 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.125522 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65dbddffdc-k6pjs"] Jul 06 17:51:56.125618 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.125587 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-474kx" Jul 06 17:51:56.128359 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.128343 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 17:51:56.128433 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.128378 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 17:51:56.128885 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.128869 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-q7vmz\"" Jul 06 17:51:56.128931 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.128871 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 17:51:56.138360 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.138342 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f6glh"] Jul 06 17:51:56.141910 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.141894 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-474kx"] Jul 06 17:51:56.219547 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.219447 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-certificates\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:51:56.219547 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.219476 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f94c1e12-5eed-4926-8cdb-d80695439c8c-tmp-dir\") pod \"dns-default-f6glh\" (UID: \"f94c1e12-5eed-4926-8cdb-d80695439c8c\") " pod="openshift-dns/dns-default-f6glh" Jul 06 17:51:56.219547 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.219503 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e28c1ed1-0d92-4ec8-a125-9323325769ed-ca-trust-extracted\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:51:56.219547 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.219520 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z55zz\" (UniqueName: \"kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-kube-api-access-z55zz\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:51:56.219787 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.219616 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e28c1ed1-0d92-4ec8-a125-9323325769ed-image-registry-private-configuration\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:51:56.219787 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.219656 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e28c1ed1-0d92-4ec8-a125-9323325769ed-installation-pull-secrets\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:51:56.219787 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.219672 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f94c1e12-5eed-4926-8cdb-d80695439c8c-metrics-tls\") pod \"dns-default-f6glh\" (UID: \"f94c1e12-5eed-4926-8cdb-d80695439c8c\") " pod="openshift-dns/dns-default-f6glh" Jul 06 17:51:56.219787 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.219759 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-bound-sa-token\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:51:56.219989 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.219940 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e28c1ed1-0d92-4ec8-a125-9323325769ed-trusted-ca\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:51:56.219989 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.219980 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f94c1e12-5eed-4926-8cdb-d80695439c8c-config-volume\") pod \"dns-default-f6glh\" (UID: \"f94c1e12-5eed-4926-8cdb-d80695439c8c\") " pod="openshift-dns/dns-default-f6glh" Jul 06 17:51:56.220098 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.220062 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwxk7\" (UniqueName: \"kubernetes.io/projected/f94c1e12-5eed-4926-8cdb-d80695439c8c-kube-api-access-kwxk7\") pod \"dns-default-f6glh\" (UID: \"f94c1e12-5eed-4926-8cdb-d80695439c8c\") " pod="openshift-dns/dns-default-f6glh" Jul 06 17:51:56.220135 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.220100 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-tls\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:51:56.320785 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.320752 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-tls\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:51:56.320913 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.320790 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-certificates\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:51:56.320913 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.320809 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f94c1e12-5eed-4926-8cdb-d80695439c8c-tmp-dir\") pod \"dns-default-f6glh\" (UID: \"f94c1e12-5eed-4926-8cdb-d80695439c8c\") " pod="openshift-dns/dns-default-f6glh" Jul 06 17:51:56.321020 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:56.320908 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 17:51:56.321020 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.320920 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3ec2919-fbd0-4ea4-bbbe-9b48b9c5d1f2-cert\") pod \"ingress-canary-474kx\" (UID: \"f3ec2919-fbd0-4ea4-bbbe-9b48b9c5d1f2\") " pod="openshift-ingress-canary/ingress-canary-474kx" Jul 06 17:51:56.321020 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:56.320928 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65dbddffdc-k6pjs: secret "image-registry-tls" not found Jul 06 17:51:56.321160 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:56.321053 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-tls podName:e28c1ed1-0d92-4ec8-a125-9323325769ed nodeName:}" failed. No retries permitted until 2026-07-06 17:51:56.82100981 +0000 UTC m=+37.505616761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-tls") pod "image-registry-65dbddffdc-k6pjs" (UID: "e28c1ed1-0d92-4ec8-a125-9323325769ed") : secret "image-registry-tls" not found Jul 06 17:51:56.321160 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.321148 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e28c1ed1-0d92-4ec8-a125-9323325769ed-ca-trust-extracted\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:51:56.321255 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.321171 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f94c1e12-5eed-4926-8cdb-d80695439c8c-tmp-dir\") pod \"dns-default-f6glh\" (UID: \"f94c1e12-5eed-4926-8cdb-d80695439c8c\") " pod="openshift-dns/dns-default-f6glh" Jul 06 17:51:56.321255 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.321179 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z55zz\" (UniqueName: \"kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-kube-api-access-z55zz\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:51:56.321255 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.321226 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e28c1ed1-0d92-4ec8-a125-9323325769ed-image-registry-private-configuration\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:51:56.321401 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.321257 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e28c1ed1-0d92-4ec8-a125-9323325769ed-installation-pull-secrets\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:51:56.321401 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.321281 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f94c1e12-5eed-4926-8cdb-d80695439c8c-metrics-tls\") pod \"dns-default-f6glh\" (UID: \"f94c1e12-5eed-4926-8cdb-d80695439c8c\") " pod="openshift-dns/dns-default-f6glh" Jul 06 17:51:56.321401 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.321350 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-bound-sa-token\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:51:56.321401 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.321381 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e28c1ed1-0d92-4ec8-a125-9323325769ed-trusted-ca\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:51:56.321599 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.321402 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f94c1e12-5eed-4926-8cdb-d80695439c8c-config-volume\") pod \"dns-default-f6glh\" (UID: \"f94c1e12-5eed-4926-8cdb-d80695439c8c\") " pod="openshift-dns/dns-default-f6glh" Jul 06 17:51:56.321599 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.321425 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwxk7\" (UniqueName: \"kubernetes.io/projected/f94c1e12-5eed-4926-8cdb-d80695439c8c-kube-api-access-kwxk7\") pod \"dns-default-f6glh\" (UID: \"f94c1e12-5eed-4926-8cdb-d80695439c8c\") " pod="openshift-dns/dns-default-f6glh" Jul 06 17:51:56.321599 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.321447 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-certificates\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:51:56.321599 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.321452 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm2bt\" (UniqueName: \"kubernetes.io/projected/f3ec2919-fbd0-4ea4-bbbe-9b48b9c5d1f2-kube-api-access-fm2bt\") pod \"ingress-canary-474kx\" (UID: \"f3ec2919-fbd0-4ea4-bbbe-9b48b9c5d1f2\") " pod="openshift-ingress-canary/ingress-canary-474kx" Jul 06 17:51:56.321599 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.321547 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e28c1ed1-0d92-4ec8-a125-9323325769ed-ca-trust-extracted\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:51:56.321827 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:56.321750 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:51:56.321827 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:56.321812 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f94c1e12-5eed-4926-8cdb-d80695439c8c-metrics-tls podName:f94c1e12-5eed-4926-8cdb-d80695439c8c nodeName:}" failed. No retries permitted until 2026-07-06 17:51:56.821794843 +0000 UTC m=+37.506401801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f94c1e12-5eed-4926-8cdb-d80695439c8c-metrics-tls") pod "dns-default-f6glh" (UID: "f94c1e12-5eed-4926-8cdb-d80695439c8c") : secret "dns-default-metrics-tls" not found Jul 06 17:51:56.322245 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.322223 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f94c1e12-5eed-4926-8cdb-d80695439c8c-config-volume\") pod \"dns-default-f6glh\" (UID: \"f94c1e12-5eed-4926-8cdb-d80695439c8c\") " pod="openshift-dns/dns-default-f6glh" Jul 06 17:51:56.322329 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.322267 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e28c1ed1-0d92-4ec8-a125-9323325769ed-trusted-ca\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:51:56.325258 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.325237 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e28c1ed1-0d92-4ec8-a125-9323325769ed-installation-pull-secrets\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:51:56.325325 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.325280 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e28c1ed1-0d92-4ec8-a125-9323325769ed-image-registry-private-configuration\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:51:56.335317 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.335297 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwxk7\" (UniqueName: \"kubernetes.io/projected/f94c1e12-5eed-4926-8cdb-d80695439c8c-kube-api-access-kwxk7\") pod \"dns-default-f6glh\" (UID: \"f94c1e12-5eed-4926-8cdb-d80695439c8c\") " pod="openshift-dns/dns-default-f6glh" Jul 06 17:51:56.335528 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.335507 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-bound-sa-token\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:51:56.335670 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.335650 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z55zz\" (UniqueName: \"kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-kube-api-access-z55zz\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:51:56.422296 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.422262 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm2bt\" (UniqueName: \"kubernetes.io/projected/f3ec2919-fbd0-4ea4-bbbe-9b48b9c5d1f2-kube-api-access-fm2bt\") pod \"ingress-canary-474kx\" (UID: \"f3ec2919-fbd0-4ea4-bbbe-9b48b9c5d1f2\") " pod="openshift-ingress-canary/ingress-canary-474kx" Jul 06 17:51:56.422449 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.422321 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3ec2919-fbd0-4ea4-bbbe-9b48b9c5d1f2-cert\") pod \"ingress-canary-474kx\" (UID: \"f3ec2919-fbd0-4ea4-bbbe-9b48b9c5d1f2\") " pod="openshift-ingress-canary/ingress-canary-474kx" Jul 06 17:51:56.424591 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.424572 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3ec2919-fbd0-4ea4-bbbe-9b48b9c5d1f2-cert\") pod \"ingress-canary-474kx\" (UID: \"f3ec2919-fbd0-4ea4-bbbe-9b48b9c5d1f2\") " pod="openshift-ingress-canary/ingress-canary-474kx" Jul 06 17:51:56.430545 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.430517 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm2bt\" (UniqueName: \"kubernetes.io/projected/f3ec2919-fbd0-4ea4-bbbe-9b48b9c5d1f2-kube-api-access-fm2bt\") pod \"ingress-canary-474kx\" (UID: \"f3ec2919-fbd0-4ea4-bbbe-9b48b9c5d1f2\") " pod="openshift-ingress-canary/ingress-canary-474kx" Jul 06 17:51:56.434388 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.434373 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-474kx" Jul 06 17:51:56.633428 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.633398 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-474kx"] Jul 06 17:51:56.637403 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:51:56.637375 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3ec2919_fbd0_4ea4_bbbe_9b48b9c5d1f2.slice/crio-eaf4df94f1c3402a40c3b4a7a54d57bae51faea169c9792adca0c98c2076280d WatchSource:0}: Error finding container eaf4df94f1c3402a40c3b4a7a54d57bae51faea169c9792adca0c98c2076280d: Status 404 returned error can't find the container with id eaf4df94f1c3402a40c3b4a7a54d57bae51faea169c9792adca0c98c2076280d Jul 06 17:51:56.711896 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.711849 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vg7jb_ba941728-b986-47c7-b4d9-468ccf455c1f/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:56.825140 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.825056 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-tls\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:51:56.825140 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.825116 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f94c1e12-5eed-4926-8cdb-d80695439c8c-metrics-tls\") pod \"dns-default-f6glh\" (UID: \"f94c1e12-5eed-4926-8cdb-d80695439c8c\") " pod="openshift-dns/dns-default-f6glh" Jul 06 17:51:56.825337 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:56.825218 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 17:51:56.825337 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:56.825234 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65dbddffdc-k6pjs: secret "image-registry-tls" not found Jul 06 17:51:56.825337 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:56.825269 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:51:56.825337 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:56.825311 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-tls podName:e28c1ed1-0d92-4ec8-a125-9323325769ed nodeName:}" failed. No retries permitted until 2026-07-06 17:51:57.825282496 +0000 UTC m=+38.509889446 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-tls") pod "image-registry-65dbddffdc-k6pjs" (UID: "e28c1ed1-0d92-4ec8-a125-9323325769ed") : secret "image-registry-tls" not found Jul 06 17:51:56.825337 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:56.825327 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f94c1e12-5eed-4926-8cdb-d80695439c8c-metrics-tls podName:f94c1e12-5eed-4926-8cdb-d80695439c8c nodeName:}" failed. No retries permitted until 2026-07-06 17:51:57.825320514 +0000 UTC m=+38.509927465 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f94c1e12-5eed-4926-8cdb-d80695439c8c-metrics-tls") pod "dns-default-f6glh" (UID: "f94c1e12-5eed-4926-8cdb-d80695439c8c") : secret "dns-default-metrics-tls" not found Jul 06 17:51:56.836009 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.835985 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vg7jb_ba941728-b986-47c7-b4d9-468ccf455c1f/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:56.935896 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:56.935864 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vg7jb_ba941728-b986-47c7-b4d9-468ccf455c1f/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:57.096636 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:57.096563 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-474kx" event={"ID":"f3ec2919-fbd0-4ea4-bbbe-9b48b9c5d1f2","Type":"ContainerStarted","Data":"eaf4df94f1c3402a40c3b4a7a54d57bae51faea169c9792adca0c98c2076280d"} Jul 06 17:51:57.833637 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:57.833392 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f94c1e12-5eed-4926-8cdb-d80695439c8c-metrics-tls\") pod \"dns-default-f6glh\" (UID: \"f94c1e12-5eed-4926-8cdb-d80695439c8c\") " pod="openshift-dns/dns-default-f6glh" Jul 06 17:51:57.833803 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:57.833720 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-tls\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:51:57.833869 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:57.833853 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 17:51:57.833920 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:57.833872 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65dbddffdc-k6pjs: secret "image-registry-tls" not found Jul 06 17:51:57.833965 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:57.833930 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-tls podName:e28c1ed1-0d92-4ec8-a125-9323325769ed nodeName:}" failed. No retries permitted until 2026-07-06 17:51:59.833912406 +0000 UTC m=+40.518519359 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-tls") pod "image-registry-65dbddffdc-k6pjs" (UID: "e28c1ed1-0d92-4ec8-a125-9323325769ed") : secret "image-registry-tls" not found Jul 06 17:51:57.834149 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:57.834130 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:51:57.834220 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:57.834173 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f94c1e12-5eed-4926-8cdb-d80695439c8c-metrics-tls podName:f94c1e12-5eed-4926-8cdb-d80695439c8c nodeName:}" failed. No retries permitted until 2026-07-06 17:51:59.834158828 +0000 UTC m=+40.518765782 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f94c1e12-5eed-4926-8cdb-d80695439c8c-metrics-tls") pod "dns-default-f6glh" (UID: "f94c1e12-5eed-4926-8cdb-d80695439c8c") : secret "dns-default-metrics-tls" not found Jul 06 17:51:57.929484 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:57.929450 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:51:57.929663 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:57.929452 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:51:57.929663 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:57.929451 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:51:57.932834 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:57.932815 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 17:51:57.933792 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:57.933772 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 17:51:57.933915 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:57.933776 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 17:51:57.933915 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:57.933781 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cvljr\"" Jul 06 17:51:57.934324 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:57.934301 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 17:51:57.934465 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:57.934324 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-22ww9\"" Jul 06 17:51:59.844977 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:59.844943 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-tls\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:51:59.845433 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:51:59.845013 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f94c1e12-5eed-4926-8cdb-d80695439c8c-metrics-tls\") pod \"dns-default-f6glh\" (UID: \"f94c1e12-5eed-4926-8cdb-d80695439c8c\") " pod="openshift-dns/dns-default-f6glh" Jul 06 17:51:59.845433 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:59.845102 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 17:51:59.845433 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:59.845124 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65dbddffdc-k6pjs: secret "image-registry-tls" not found Jul 06 17:51:59.845433 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:59.845179 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:51:59.845433 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:59.845185 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-tls podName:e28c1ed1-0d92-4ec8-a125-9323325769ed nodeName:}" failed. No retries permitted until 2026-07-06 17:52:03.845164954 +0000 UTC m=+44.529771923 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-tls") pod "image-registry-65dbddffdc-k6pjs" (UID: "e28c1ed1-0d92-4ec8-a125-9323325769ed") : secret "image-registry-tls" not found Jul 06 17:51:59.845433 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:51:59.845226 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f94c1e12-5eed-4926-8cdb-d80695439c8c-metrics-tls podName:f94c1e12-5eed-4926-8cdb-d80695439c8c nodeName:}" failed. No retries permitted until 2026-07-06 17:52:03.845214716 +0000 UTC m=+44.529821666 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f94c1e12-5eed-4926-8cdb-d80695439c8c-metrics-tls") pod "dns-default-f6glh" (UID: "f94c1e12-5eed-4926-8cdb-d80695439c8c") : secret "dns-default-metrics-tls" not found Jul 06 17:52:01.109510 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:01.109416 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-474kx" event={"ID":"f3ec2919-fbd0-4ea4-bbbe-9b48b9c5d1f2","Type":"ContainerStarted","Data":"8c72fc5eee3708c433f79a4ce660fb165d88eb3e5bf581abe76f8f86db322447"} Jul 06 17:52:01.127802 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:01.127753 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-474kx" podStartSLOduration=0.991404313 podStartE2EDuration="5.12773653s" totalImagesPullingTime="4.136332217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:51:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:52:01.127602825 +0000 UTC m=+41.812209810" watchObservedRunningTime="2026-07-06 17:52:01.12773653 +0000 UTC m=+41.812343506" Jul 06 17:52:03.880106 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:03.880060 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-tls\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:52:03.880520 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:03.880129 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f94c1e12-5eed-4926-8cdb-d80695439c8c-metrics-tls\") pod \"dns-default-f6glh\" (UID: \"f94c1e12-5eed-4926-8cdb-d80695439c8c\") " pod="openshift-dns/dns-default-f6glh" Jul 06 17:52:03.880520 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:03.880200 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 17:52:03.880520 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:03.880222 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65dbddffdc-k6pjs: secret "image-registry-tls" not found Jul 06 17:52:03.880520 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:03.880270 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:52:03.880520 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:03.880277 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-tls podName:e28c1ed1-0d92-4ec8-a125-9323325769ed nodeName:}" failed. No retries permitted until 2026-07-06 17:52:11.880263913 +0000 UTC m=+52.564870868 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-tls") pod "image-registry-65dbddffdc-k6pjs" (UID: "e28c1ed1-0d92-4ec8-a125-9323325769ed") : secret "image-registry-tls" not found Jul 06 17:52:03.880520 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:03.880332 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f94c1e12-5eed-4926-8cdb-d80695439c8c-metrics-tls podName:f94c1e12-5eed-4926-8cdb-d80695439c8c nodeName:}" failed. No retries permitted until 2026-07-06 17:52:11.880314393 +0000 UTC m=+52.564921343 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f94c1e12-5eed-4926-8cdb-d80695439c8c-metrics-tls") pod "dns-default-f6glh" (UID: "f94c1e12-5eed-4926-8cdb-d80695439c8c") : secret "dns-default-metrics-tls" not found Jul 06 17:52:05.121756 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:05.121722 2578 generic.go:356] "Generic (PLEG): container finished" podID="555137f2-da9f-4814-a9b9-91b82e0bf677" containerID="d17b86718acbed8920f9d70e5bb036eecbc88522e12afd8694a2214ee0f3b200" exitCode=0 Jul 06 17:52:05.122132 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:05.121772 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7nfr" event={"ID":"555137f2-da9f-4814-a9b9-91b82e0bf677","Type":"ContainerDied","Data":"d17b86718acbed8920f9d70e5bb036eecbc88522e12afd8694a2214ee0f3b200"} Jul 06 17:52:06.127216 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:06.127178 2578 generic.go:356] "Generic (PLEG): container finished" podID="555137f2-da9f-4814-a9b9-91b82e0bf677" containerID="bb8e02cff15f1743abd83d2a749ef46b847ac9218ca4d1f5f8a51d77c53083ce" exitCode=0 Jul 06 17:52:06.127617 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:06.127245 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7nfr" event={"ID":"555137f2-da9f-4814-a9b9-91b82e0bf677","Type":"ContainerDied","Data":"bb8e02cff15f1743abd83d2a749ef46b847ac9218ca4d1f5f8a51d77c53083ce"} Jul 06 17:52:07.133178 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:07.133145 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7nfr" event={"ID":"555137f2-da9f-4814-a9b9-91b82e0bf677","Type":"ContainerStarted","Data":"13db49703d8272dc360922fa989916a29ec24c8a8810b6dfb49640abf4ec164c"} Jul 06 17:52:11.940620 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:11.940576 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f94c1e12-5eed-4926-8cdb-d80695439c8c-metrics-tls\") pod \"dns-default-f6glh\" (UID: \"f94c1e12-5eed-4926-8cdb-d80695439c8c\") " pod="openshift-dns/dns-default-f6glh" Jul 06 17:52:11.941125 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:11.940653 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-tls\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:52:11.941125 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:11.940742 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 17:52:11.941125 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:11.940752 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65dbddffdc-k6pjs: secret "image-registry-tls" not found Jul 06 17:52:11.941125 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:11.940799 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-tls podName:e28c1ed1-0d92-4ec8-a125-9323325769ed nodeName:}" failed. No retries permitted until 2026-07-06 17:52:27.940785078 +0000 UTC m=+68.625392042 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-tls") pod "image-registry-65dbddffdc-k6pjs" (UID: "e28c1ed1-0d92-4ec8-a125-9323325769ed") : secret "image-registry-tls" not found Jul 06 17:52:11.941125 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:11.940741 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:52:11.941125 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:11.940888 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f94c1e12-5eed-4926-8cdb-d80695439c8c-metrics-tls podName:f94c1e12-5eed-4926-8cdb-d80695439c8c nodeName:}" failed. No retries permitted until 2026-07-06 17:52:27.940872633 +0000 UTC m=+68.625479589 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f94c1e12-5eed-4926-8cdb-d80695439c8c-metrics-tls") pod "dns-default-f6glh" (UID: "f94c1e12-5eed-4926-8cdb-d80695439c8c") : secret "dns-default-metrics-tls" not found Jul 06 17:52:22.084531 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:22.084504 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l4xhs" Jul 06 17:52:22.118283 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:22.118233 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r7nfr" podStartSLOduration=24.814180986 podStartE2EDuration="1m2.118216958s" totalImagesPullingTime="37.304035972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:51:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:52:07.161923516 +0000 UTC m=+47.846530488" watchObservedRunningTime="2026-07-06 17:52:22.118216958 +0000 UTC m=+62.802823985" Jul 06 17:52:25.739302 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:25.739253 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c9b8055-863b-43b0-8f1c-594c43656713-original-pull-secret\") pod \"global-pull-secret-syncer-2fsf2\" (UID: \"3c9b8055-863b-43b0-8f1c-594c43656713\") " pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:52:25.739823 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:25.739349 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc43abe6-169b-482f-8d32-088a668e1820-metrics-certs\") pod \"network-metrics-daemon-gslrl\" (UID: \"bc43abe6-169b-482f-8d32-088a668e1820\") " pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:52:25.742221 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:25.742199 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 17:52:25.742334 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:25.742240 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 17:52:25.750276 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:25.750255 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 17:52:25.750359 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:25.750316 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc43abe6-169b-482f-8d32-088a668e1820-metrics-certs podName:bc43abe6-169b-482f-8d32-088a668e1820 nodeName:}" failed. No retries permitted until 2026-07-06 17:53:29.750299903 +0000 UTC m=+130.434906853 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bc43abe6-169b-482f-8d32-088a668e1820-metrics-certs") pod "network-metrics-daemon-gslrl" (UID: "bc43abe6-169b-482f-8d32-088a668e1820") : secret "metrics-daemon-secret" not found Jul 06 17:52:25.753984 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:25.753960 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3c9b8055-863b-43b0-8f1c-594c43656713-original-pull-secret\") pod \"global-pull-secret-syncer-2fsf2\" (UID: \"3c9b8055-863b-43b0-8f1c-594c43656713\") " pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:52:25.840656 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:25.840614 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9pnh\" (UniqueName: \"kubernetes.io/projected/5900d925-dd5e-42a4-9d0f-5bd224512165-kube-api-access-c9pnh\") pod \"network-check-target-nvnv9\" (UID: \"5900d925-dd5e-42a4-9d0f-5bd224512165\") " pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:52:25.843813 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:25.843794 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 17:52:25.854924 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:25.854899 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fsf2" Jul 06 17:52:25.854991 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:25.854933 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 17:52:25.864150 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:25.864130 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9pnh\" (UniqueName: \"kubernetes.io/projected/5900d925-dd5e-42a4-9d0f-5bd224512165-kube-api-access-c9pnh\") pod \"network-check-target-nvnv9\" (UID: \"5900d925-dd5e-42a4-9d0f-5bd224512165\") " pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:52:25.995465 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:25.995383 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2fsf2"] Jul 06 17:52:25.999515 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:52:25.999487 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c9b8055_863b_43b0_8f1c_594c43656713.slice/crio-c6aeeb02fa86d5c6dc987d390a36de4a1a63b8f72b2d415fe5145db13f43e742 WatchSource:0}: Error finding container c6aeeb02fa86d5c6dc987d390a36de4a1a63b8f72b2d415fe5145db13f43e742: Status 404 returned error can't find the container with id c6aeeb02fa86d5c6dc987d390a36de4a1a63b8f72b2d415fe5145db13f43e742 Jul 06 17:52:26.152450 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:26.152416 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cvljr\"" Jul 06 17:52:26.160509 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:26.160485 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:52:26.178387 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:26.178356 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2fsf2" event={"ID":"3c9b8055-863b-43b0-8f1c-594c43656713","Type":"ContainerStarted","Data":"c6aeeb02fa86d5c6dc987d390a36de4a1a63b8f72b2d415fe5145db13f43e742"} Jul 06 17:52:26.281066 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:26.280975 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nvnv9"] Jul 06 17:52:26.283537 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:52:26.283511 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5900d925_dd5e_42a4_9d0f_5bd224512165.slice/crio-50e4b000e08b52c1a6adb3d4e71d98a87a042eb85cadca827ffa9c8b6b91cbbc WatchSource:0}: Error finding container 50e4b000e08b52c1a6adb3d4e71d98a87a042eb85cadca827ffa9c8b6b91cbbc: Status 404 returned error can't find the container with id 50e4b000e08b52c1a6adb3d4e71d98a87a042eb85cadca827ffa9c8b6b91cbbc Jul 06 17:52:27.182810 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:27.182715 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nvnv9" event={"ID":"5900d925-dd5e-42a4-9d0f-5bd224512165","Type":"ContainerStarted","Data":"50e4b000e08b52c1a6adb3d4e71d98a87a042eb85cadca827ffa9c8b6b91cbbc"} Jul 06 17:52:27.958624 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:27.958588 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f94c1e12-5eed-4926-8cdb-d80695439c8c-metrics-tls\") pod \"dns-default-f6glh\" (UID: \"f94c1e12-5eed-4926-8cdb-d80695439c8c\") " pod="openshift-dns/dns-default-f6glh" Jul 06 17:52:27.958919 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:27.958648 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-tls\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:52:27.958919 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:27.958741 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 17:52:27.958919 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:27.958754 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65dbddffdc-k6pjs: secret "image-registry-tls" not found Jul 06 17:52:27.958919 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:27.958753 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:52:27.958919 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:27.958801 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-tls podName:e28c1ed1-0d92-4ec8-a125-9323325769ed nodeName:}" failed. No retries permitted until 2026-07-06 17:52:59.958788785 +0000 UTC m=+100.643395736 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-tls") pod "image-registry-65dbddffdc-k6pjs" (UID: "e28c1ed1-0d92-4ec8-a125-9323325769ed") : secret "image-registry-tls" not found Jul 06 17:52:27.958919 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:27.958813 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f94c1e12-5eed-4926-8cdb-d80695439c8c-metrics-tls podName:f94c1e12-5eed-4926-8cdb-d80695439c8c nodeName:}" failed. No retries permitted until 2026-07-06 17:52:59.958808365 +0000 UTC m=+100.643415317 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f94c1e12-5eed-4926-8cdb-d80695439c8c-metrics-tls") pod "dns-default-f6glh" (UID: "f94c1e12-5eed-4926-8cdb-d80695439c8c") : secret "dns-default-metrics-tls" not found Jul 06 17:52:30.191861 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:30.191817 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nvnv9" event={"ID":"5900d925-dd5e-42a4-9d0f-5bd224512165","Type":"ContainerStarted","Data":"c732b38b45fbe95982502b1a9eb09d65841ebb187031c8e22ba250b10871e2b5"} Jul 06 17:52:30.192345 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:30.191972 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:52:30.211057 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:30.210988 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nvnv9" podStartSLOduration=66.789991494 podStartE2EDuration="1m10.21096849s" totalImagesPullingTime="3.420976996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:51:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:52:30.209427032 +0000 UTC m=+70.894034005" watchObservedRunningTime="2026-07-06 17:52:30.21096849 +0000 UTC m=+70.895575466" Jul 06 17:52:32.201883 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:32.201844 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2fsf2" event={"ID":"3c9b8055-863b-43b0-8f1c-594c43656713","Type":"ContainerStarted","Data":"0bf68106abea624da89ccd77106877bfcf9629dfcef17711be11734c4edc168e"} Jul 06 17:52:32.219571 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:32.219516 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2fsf2" podStartSLOduration=66.904550064 podStartE2EDuration="1m12.219501432s" totalImagesPullingTime="5.314951368s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:51:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:52:32.219444536 +0000 UTC m=+72.904051508" watchObservedRunningTime="2026-07-06 17:52:32.219501432 +0000 UTC m=+72.904108395" Jul 06 17:52:46.507452 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:46.507330 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6844c8868c-2lnp8"] Jul 06 17:52:46.509790 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:46.509772 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:52:46.513296 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:46.513273 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-k6x8z\"" Jul 06 17:52:46.514085 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:46.514065 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 06 17:52:46.514085 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:46.514088 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 17:52:46.514248 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:46.514131 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 17:52:46.514248 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:46.514215 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 06 17:52:46.514802 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:46.514788 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 06 17:52:46.515706 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:46.515690 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 06 17:52:46.527183 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:46.527156 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6844c8868c-2lnp8"] Jul 06 17:52:46.592372 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:46.592335 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkw6r\" (UniqueName: \"kubernetes.io/projected/383db5e4-be04-4210-92ca-08b4528901d2-kube-api-access-gkw6r\") pod \"router-default-6844c8868c-2lnp8\" (UID: \"383db5e4-be04-4210-92ca-08b4528901d2\") " pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:52:46.592546 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:46.592406 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/383db5e4-be04-4210-92ca-08b4528901d2-service-ca-bundle\") pod \"router-default-6844c8868c-2lnp8\" (UID: \"383db5e4-be04-4210-92ca-08b4528901d2\") " pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:52:46.592546 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:46.592437 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/383db5e4-be04-4210-92ca-08b4528901d2-metrics-certs\") pod \"router-default-6844c8868c-2lnp8\" (UID: \"383db5e4-be04-4210-92ca-08b4528901d2\") " pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:52:46.592546 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:46.592467 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/383db5e4-be04-4210-92ca-08b4528901d2-default-certificate\") pod \"router-default-6844c8868c-2lnp8\" (UID: \"383db5e4-be04-4210-92ca-08b4528901d2\") " pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:52:46.592546 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:46.592493 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/383db5e4-be04-4210-92ca-08b4528901d2-stats-auth\") pod \"router-default-6844c8868c-2lnp8\" (UID: \"383db5e4-be04-4210-92ca-08b4528901d2\") " pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:52:46.693851 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:46.693801 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/383db5e4-be04-4210-92ca-08b4528901d2-default-certificate\") pod \"router-default-6844c8868c-2lnp8\" (UID: \"383db5e4-be04-4210-92ca-08b4528901d2\") " pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:52:46.693851 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:46.693849 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/383db5e4-be04-4210-92ca-08b4528901d2-stats-auth\") pod \"router-default-6844c8868c-2lnp8\" (UID: \"383db5e4-be04-4210-92ca-08b4528901d2\") " pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:52:46.694080 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:46.693874 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkw6r\" (UniqueName: \"kubernetes.io/projected/383db5e4-be04-4210-92ca-08b4528901d2-kube-api-access-gkw6r\") pod \"router-default-6844c8868c-2lnp8\" (UID: \"383db5e4-be04-4210-92ca-08b4528901d2\") " pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:52:46.694080 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:46.693985 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/383db5e4-be04-4210-92ca-08b4528901d2-service-ca-bundle\") pod \"router-default-6844c8868c-2lnp8\" (UID: \"383db5e4-be04-4210-92ca-08b4528901d2\") " pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:52:46.694080 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:46.694048 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/383db5e4-be04-4210-92ca-08b4528901d2-metrics-certs\") pod \"router-default-6844c8868c-2lnp8\" (UID: \"383db5e4-be04-4210-92ca-08b4528901d2\") " pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:52:46.694182 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:46.694164 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/383db5e4-be04-4210-92ca-08b4528901d2-service-ca-bundle podName:383db5e4-be04-4210-92ca-08b4528901d2 nodeName:}" failed. No retries permitted until 2026-07-06 17:52:47.194146454 +0000 UTC m=+87.878753404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/383db5e4-be04-4210-92ca-08b4528901d2-service-ca-bundle") pod "router-default-6844c8868c-2lnp8" (UID: "383db5e4-be04-4210-92ca-08b4528901d2") : configmap references non-existent config key: service-ca.crt Jul 06 17:52:46.694182 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:46.694169 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 17:52:46.694257 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:46.694208 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/383db5e4-be04-4210-92ca-08b4528901d2-metrics-certs podName:383db5e4-be04-4210-92ca-08b4528901d2 nodeName:}" failed. No retries permitted until 2026-07-06 17:52:47.194198149 +0000 UTC m=+87.878805111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/383db5e4-be04-4210-92ca-08b4528901d2-metrics-certs") pod "router-default-6844c8868c-2lnp8" (UID: "383db5e4-be04-4210-92ca-08b4528901d2") : secret "router-metrics-certs-default" not found Jul 06 17:52:46.696385 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:46.696352 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/383db5e4-be04-4210-92ca-08b4528901d2-stats-auth\") pod \"router-default-6844c8868c-2lnp8\" (UID: \"383db5e4-be04-4210-92ca-08b4528901d2\") " pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:52:46.696495 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:46.696410 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/383db5e4-be04-4210-92ca-08b4528901d2-default-certificate\") pod \"router-default-6844c8868c-2lnp8\" (UID: \"383db5e4-be04-4210-92ca-08b4528901d2\") " pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:52:46.712326 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:46.712299 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkw6r\" (UniqueName: \"kubernetes.io/projected/383db5e4-be04-4210-92ca-08b4528901d2-kube-api-access-gkw6r\") pod \"router-default-6844c8868c-2lnp8\" (UID: \"383db5e4-be04-4210-92ca-08b4528901d2\") " pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:52:47.197170 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:47.197137 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/383db5e4-be04-4210-92ca-08b4528901d2-service-ca-bundle\") pod \"router-default-6844c8868c-2lnp8\" (UID: \"383db5e4-be04-4210-92ca-08b4528901d2\") " pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:52:47.197339 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:47.197179 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/383db5e4-be04-4210-92ca-08b4528901d2-metrics-certs\") pod \"router-default-6844c8868c-2lnp8\" (UID: \"383db5e4-be04-4210-92ca-08b4528901d2\") " pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:52:47.197339 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:47.197284 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 17:52:47.197339 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:47.197309 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/383db5e4-be04-4210-92ca-08b4528901d2-service-ca-bundle podName:383db5e4-be04-4210-92ca-08b4528901d2 nodeName:}" failed. No retries permitted until 2026-07-06 17:52:48.197290706 +0000 UTC m=+88.881897656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/383db5e4-be04-4210-92ca-08b4528901d2-service-ca-bundle") pod "router-default-6844c8868c-2lnp8" (UID: "383db5e4-be04-4210-92ca-08b4528901d2") : configmap references non-existent config key: service-ca.crt Jul 06 17:52:47.197339 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:47.197334 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/383db5e4-be04-4210-92ca-08b4528901d2-metrics-certs podName:383db5e4-be04-4210-92ca-08b4528901d2 nodeName:}" failed. No retries permitted until 2026-07-06 17:52:48.19732371 +0000 UTC m=+88.881930660 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/383db5e4-be04-4210-92ca-08b4528901d2-metrics-certs") pod "router-default-6844c8868c-2lnp8" (UID: "383db5e4-be04-4210-92ca-08b4528901d2") : secret "router-metrics-certs-default" not found Jul 06 17:52:48.203564 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:48.203517 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/383db5e4-be04-4210-92ca-08b4528901d2-service-ca-bundle\") pod \"router-default-6844c8868c-2lnp8\" (UID: \"383db5e4-be04-4210-92ca-08b4528901d2\") " pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:52:48.203564 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:48.203571 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/383db5e4-be04-4210-92ca-08b4528901d2-metrics-certs\") pod \"router-default-6844c8868c-2lnp8\" (UID: \"383db5e4-be04-4210-92ca-08b4528901d2\") " pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:52:48.204118 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:48.203712 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 17:52:48.204118 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:48.203743 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/383db5e4-be04-4210-92ca-08b4528901d2-service-ca-bundle podName:383db5e4-be04-4210-92ca-08b4528901d2 nodeName:}" failed. No retries permitted until 2026-07-06 17:52:50.203721469 +0000 UTC m=+90.888328425 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/383db5e4-be04-4210-92ca-08b4528901d2-service-ca-bundle") pod "router-default-6844c8868c-2lnp8" (UID: "383db5e4-be04-4210-92ca-08b4528901d2") : configmap references non-existent config key: service-ca.crt Jul 06 17:52:48.204118 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:48.203778 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/383db5e4-be04-4210-92ca-08b4528901d2-metrics-certs podName:383db5e4-be04-4210-92ca-08b4528901d2 nodeName:}" failed. No retries permitted until 2026-07-06 17:52:50.203767764 +0000 UTC m=+90.888374720 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/383db5e4-be04-4210-92ca-08b4528901d2-metrics-certs") pod "router-default-6844c8868c-2lnp8" (UID: "383db5e4-be04-4210-92ca-08b4528901d2") : secret "router-metrics-certs-default" not found Jul 06 17:52:50.220715 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:50.220665 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/383db5e4-be04-4210-92ca-08b4528901d2-service-ca-bundle\") pod \"router-default-6844c8868c-2lnp8\" (UID: \"383db5e4-be04-4210-92ca-08b4528901d2\") " pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:52:50.221198 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:50.220727 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/383db5e4-be04-4210-92ca-08b4528901d2-metrics-certs\") pod \"router-default-6844c8868c-2lnp8\" (UID: \"383db5e4-be04-4210-92ca-08b4528901d2\") " pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:52:50.221198 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:50.220848 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 17:52:50.221198 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:50.220855 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/383db5e4-be04-4210-92ca-08b4528901d2-service-ca-bundle podName:383db5e4-be04-4210-92ca-08b4528901d2 nodeName:}" failed. No retries permitted until 2026-07-06 17:52:54.220836708 +0000 UTC m=+94.905443663 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/383db5e4-be04-4210-92ca-08b4528901d2-service-ca-bundle") pod "router-default-6844c8868c-2lnp8" (UID: "383db5e4-be04-4210-92ca-08b4528901d2") : configmap references non-existent config key: service-ca.crt Jul 06 17:52:50.221198 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:50.220915 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/383db5e4-be04-4210-92ca-08b4528901d2-metrics-certs podName:383db5e4-be04-4210-92ca-08b4528901d2 nodeName:}" failed. No retries permitted until 2026-07-06 17:52:54.22090001 +0000 UTC m=+94.905506961 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/383db5e4-be04-4210-92ca-08b4528901d2-metrics-certs") pod "router-default-6844c8868c-2lnp8" (UID: "383db5e4-be04-4210-92ca-08b4528901d2") : secret "router-metrics-certs-default" not found Jul 06 17:52:50.598626 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:50.598544 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8r4q5"] Jul 06 17:52:50.600907 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:50.600892 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8r4q5" Jul 06 17:52:50.603385 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:50.603351 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 17:52:50.603489 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:50.603361 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 17:52:50.603867 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:50.603845 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 17:52:50.604305 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:50.604289 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 17:52:50.604367 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:50.604351 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-j6zr4\"" Jul 06 17:52:50.627417 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:50.627394 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8r4q5"] Jul 06 17:52:50.724357 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:50.724335 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8771806-daf9-42e9-ab05-a0cf4e357dc1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8r4q5\" (UID: \"b8771806-daf9-42e9-ab05-a0cf4e357dc1\") " pod="openshift-insights/insights-runtime-extractor-8r4q5" Jul 06 17:52:50.724357 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:50.724363 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmmt4\" (UniqueName: \"kubernetes.io/projected/b8771806-daf9-42e9-ab05-a0cf4e357dc1-kube-api-access-gmmt4\") pod \"insights-runtime-extractor-8r4q5\" (UID: \"b8771806-daf9-42e9-ab05-a0cf4e357dc1\") " pod="openshift-insights/insights-runtime-extractor-8r4q5" Jul 06 17:52:50.724522 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:50.724492 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b8771806-daf9-42e9-ab05-a0cf4e357dc1-crio-socket\") pod \"insights-runtime-extractor-8r4q5\" (UID: \"b8771806-daf9-42e9-ab05-a0cf4e357dc1\") " pod="openshift-insights/insights-runtime-extractor-8r4q5" Jul 06 17:52:50.724522 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:50.724512 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8771806-daf9-42e9-ab05-a0cf4e357dc1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8r4q5\" (UID: \"b8771806-daf9-42e9-ab05-a0cf4e357dc1\") " pod="openshift-insights/insights-runtime-extractor-8r4q5" Jul 06 17:52:50.724602 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:50.724532 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8771806-daf9-42e9-ab05-a0cf4e357dc1-data-volume\") pod \"insights-runtime-extractor-8r4q5\" (UID: \"b8771806-daf9-42e9-ab05-a0cf4e357dc1\") " pod="openshift-insights/insights-runtime-extractor-8r4q5" Jul 06 17:52:50.825516 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:50.825490 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b8771806-daf9-42e9-ab05-a0cf4e357dc1-crio-socket\") pod \"insights-runtime-extractor-8r4q5\" (UID: \"b8771806-daf9-42e9-ab05-a0cf4e357dc1\") " pod="openshift-insights/insights-runtime-extractor-8r4q5" Jul 06 17:52:50.825516 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:50.825518 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8771806-daf9-42e9-ab05-a0cf4e357dc1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8r4q5\" (UID: \"b8771806-daf9-42e9-ab05-a0cf4e357dc1\") " pod="openshift-insights/insights-runtime-extractor-8r4q5" Jul 06 17:52:50.825718 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:50.825539 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8771806-daf9-42e9-ab05-a0cf4e357dc1-data-volume\") pod \"insights-runtime-extractor-8r4q5\" (UID: \"b8771806-daf9-42e9-ab05-a0cf4e357dc1\") " pod="openshift-insights/insights-runtime-extractor-8r4q5" Jul 06 17:52:50.825718 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:50.825608 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8771806-daf9-42e9-ab05-a0cf4e357dc1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8r4q5\" (UID: \"b8771806-daf9-42e9-ab05-a0cf4e357dc1\") " pod="openshift-insights/insights-runtime-extractor-8r4q5" Jul 06 17:52:50.825718 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:50.825639 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmmt4\" (UniqueName: \"kubernetes.io/projected/b8771806-daf9-42e9-ab05-a0cf4e357dc1-kube-api-access-gmmt4\") pod \"insights-runtime-extractor-8r4q5\" (UID: \"b8771806-daf9-42e9-ab05-a0cf4e357dc1\") " pod="openshift-insights/insights-runtime-extractor-8r4q5" Jul 06 17:52:50.825718 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:50.825650 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 17:52:50.825718 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:50.825615 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b8771806-daf9-42e9-ab05-a0cf4e357dc1-crio-socket\") pod \"insights-runtime-extractor-8r4q5\" (UID: \"b8771806-daf9-42e9-ab05-a0cf4e357dc1\") " pod="openshift-insights/insights-runtime-extractor-8r4q5" Jul 06 17:52:50.825919 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:50.825721 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 17:52:50.825919 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:50.825729 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8771806-daf9-42e9-ab05-a0cf4e357dc1-insights-runtime-extractor-tls podName:b8771806-daf9-42e9-ab05-a0cf4e357dc1 nodeName:}" failed. No retries permitted until 2026-07-06 17:52:51.325706745 +0000 UTC m=+92.010313717 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b8771806-daf9-42e9-ab05-a0cf4e357dc1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8r4q5" (UID: "b8771806-daf9-42e9-ab05-a0cf4e357dc1") : secret "insights-runtime-extractor-tls" not found Jul 06 17:52:50.825919 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:50.825782 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b8771806-daf9-42e9-ab05-a0cf4e357dc1-kube-rbac-proxy-cm podName:b8771806-daf9-42e9-ab05-a0cf4e357dc1 nodeName:}" failed. No retries permitted until 2026-07-06 17:52:51.32576761 +0000 UTC m=+92.010374569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b8771806-daf9-42e9-ab05-a0cf4e357dc1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8r4q5" (UID: "b8771806-daf9-42e9-ab05-a0cf4e357dc1") : configmap "kube-rbac-proxy" not found Jul 06 17:52:50.825919 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:50.825860 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8771806-daf9-42e9-ab05-a0cf4e357dc1-data-volume\") pod \"insights-runtime-extractor-8r4q5\" (UID: \"b8771806-daf9-42e9-ab05-a0cf4e357dc1\") " pod="openshift-insights/insights-runtime-extractor-8r4q5" Jul 06 17:52:50.840883 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:50.840857 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmmt4\" (UniqueName: \"kubernetes.io/projected/b8771806-daf9-42e9-ab05-a0cf4e357dc1-kube-api-access-gmmt4\") pod \"insights-runtime-extractor-8r4q5\" (UID: \"b8771806-daf9-42e9-ab05-a0cf4e357dc1\") " pod="openshift-insights/insights-runtime-extractor-8r4q5" Jul 06 17:52:51.329310 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:51.329262 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8771806-daf9-42e9-ab05-a0cf4e357dc1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8r4q5\" (UID: \"b8771806-daf9-42e9-ab05-a0cf4e357dc1\") " pod="openshift-insights/insights-runtime-extractor-8r4q5" Jul 06 17:52:51.329310 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:51.329315 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8771806-daf9-42e9-ab05-a0cf4e357dc1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8r4q5\" (UID: \"b8771806-daf9-42e9-ab05-a0cf4e357dc1\") " pod="openshift-insights/insights-runtime-extractor-8r4q5" Jul 06 17:52:51.329725 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:51.329393 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 17:52:51.329725 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:51.329402 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 17:52:51.329725 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:51.329450 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b8771806-daf9-42e9-ab05-a0cf4e357dc1-kube-rbac-proxy-cm podName:b8771806-daf9-42e9-ab05-a0cf4e357dc1 nodeName:}" failed. No retries permitted until 2026-07-06 17:52:52.32943803 +0000 UTC m=+93.014044981 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b8771806-daf9-42e9-ab05-a0cf4e357dc1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8r4q5" (UID: "b8771806-daf9-42e9-ab05-a0cf4e357dc1") : configmap "kube-rbac-proxy" not found Jul 06 17:52:51.329725 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:51.329462 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8771806-daf9-42e9-ab05-a0cf4e357dc1-insights-runtime-extractor-tls podName:b8771806-daf9-42e9-ab05-a0cf4e357dc1 nodeName:}" failed. No retries permitted until 2026-07-06 17:52:52.329456698 +0000 UTC m=+93.014063648 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b8771806-daf9-42e9-ab05-a0cf4e357dc1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8r4q5" (UID: "b8771806-daf9-42e9-ab05-a0cf4e357dc1") : secret "insights-runtime-extractor-tls" not found Jul 06 17:52:52.338305 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:52.338256 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8771806-daf9-42e9-ab05-a0cf4e357dc1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8r4q5\" (UID: \"b8771806-daf9-42e9-ab05-a0cf4e357dc1\") " pod="openshift-insights/insights-runtime-extractor-8r4q5" Jul 06 17:52:52.338697 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:52.338367 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8771806-daf9-42e9-ab05-a0cf4e357dc1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8r4q5\" (UID: \"b8771806-daf9-42e9-ab05-a0cf4e357dc1\") " pod="openshift-insights/insights-runtime-extractor-8r4q5" Jul 06 17:52:52.338697 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:52.338385 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 17:52:52.338697 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:52.338444 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b8771806-daf9-42e9-ab05-a0cf4e357dc1-kube-rbac-proxy-cm podName:b8771806-daf9-42e9-ab05-a0cf4e357dc1 nodeName:}" failed. No retries permitted until 2026-07-06 17:52:54.338427851 +0000 UTC m=+95.023034801 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b8771806-daf9-42e9-ab05-a0cf4e357dc1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8r4q5" (UID: "b8771806-daf9-42e9-ab05-a0cf4e357dc1") : configmap "kube-rbac-proxy" not found Jul 06 17:52:52.338697 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:52.338456 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 17:52:52.338697 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:52.338495 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8771806-daf9-42e9-ab05-a0cf4e357dc1-insights-runtime-extractor-tls podName:b8771806-daf9-42e9-ab05-a0cf4e357dc1 nodeName:}" failed. No retries permitted until 2026-07-06 17:52:54.338484989 +0000 UTC m=+95.023091939 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b8771806-daf9-42e9-ab05-a0cf4e357dc1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8r4q5" (UID: "b8771806-daf9-42e9-ab05-a0cf4e357dc1") : secret "insights-runtime-extractor-tls" not found Jul 06 17:52:52.626668 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:52.626603 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g89hv_0bdf6bc9-0fd5-4579-98af-ab7b066fa383/dns-node-resolver/0.log" Jul 06 17:52:53.425430 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:53.425402 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d69n6_ed64f8b7-31b6-4d4b-9ca7-59783916ed57/node-ca/0.log" Jul 06 17:52:54.027171 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:54.027139 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-474kx_f3ec2919-fbd0-4ea4-bbbe-9b48b9c5d1f2/serve-healthcheck-canary/0.log" Jul 06 17:52:54.250467 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:54.250430 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/383db5e4-be04-4210-92ca-08b4528901d2-service-ca-bundle\") pod \"router-default-6844c8868c-2lnp8\" (UID: \"383db5e4-be04-4210-92ca-08b4528901d2\") " pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:52:54.250636 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:54.250479 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/383db5e4-be04-4210-92ca-08b4528901d2-metrics-certs\") pod \"router-default-6844c8868c-2lnp8\" (UID: \"383db5e4-be04-4210-92ca-08b4528901d2\") " pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:52:54.250636 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:54.250589 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 17:52:54.250636 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:54.250591 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/383db5e4-be04-4210-92ca-08b4528901d2-service-ca-bundle podName:383db5e4-be04-4210-92ca-08b4528901d2 nodeName:}" failed. No retries permitted until 2026-07-06 17:53:02.250574369 +0000 UTC m=+102.935181320 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/383db5e4-be04-4210-92ca-08b4528901d2-service-ca-bundle") pod "router-default-6844c8868c-2lnp8" (UID: "383db5e4-be04-4210-92ca-08b4528901d2") : configmap references non-existent config key: service-ca.crt Jul 06 17:52:54.250792 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:54.250647 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/383db5e4-be04-4210-92ca-08b4528901d2-metrics-certs podName:383db5e4-be04-4210-92ca-08b4528901d2 nodeName:}" failed. No retries permitted until 2026-07-06 17:53:02.250632627 +0000 UTC m=+102.935239581 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/383db5e4-be04-4210-92ca-08b4528901d2-metrics-certs") pod "router-default-6844c8868c-2lnp8" (UID: "383db5e4-be04-4210-92ca-08b4528901d2") : secret "router-metrics-certs-default" not found Jul 06 17:52:54.351744 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:54.351638 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8771806-daf9-42e9-ab05-a0cf4e357dc1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8r4q5\" (UID: \"b8771806-daf9-42e9-ab05-a0cf4e357dc1\") " pod="openshift-insights/insights-runtime-extractor-8r4q5" Jul 06 17:52:54.351744 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:54.351704 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8771806-daf9-42e9-ab05-a0cf4e357dc1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8r4q5\" (UID: \"b8771806-daf9-42e9-ab05-a0cf4e357dc1\") " pod="openshift-insights/insights-runtime-extractor-8r4q5" Jul 06 17:52:54.351932 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:54.351816 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 17:52:54.351932 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:54.351876 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8771806-daf9-42e9-ab05-a0cf4e357dc1-insights-runtime-extractor-tls podName:b8771806-daf9-42e9-ab05-a0cf4e357dc1 nodeName:}" failed. No retries permitted until 2026-07-06 17:52:58.351863442 +0000 UTC m=+99.036470396 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b8771806-daf9-42e9-ab05-a0cf4e357dc1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8r4q5" (UID: "b8771806-daf9-42e9-ab05-a0cf4e357dc1") : secret "insights-runtime-extractor-tls" not found Jul 06 17:52:54.351932 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:54.351816 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 17:52:54.352070 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:54.351947 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b8771806-daf9-42e9-ab05-a0cf4e357dc1-kube-rbac-proxy-cm podName:b8771806-daf9-42e9-ab05-a0cf4e357dc1 nodeName:}" failed. No retries permitted until 2026-07-06 17:52:58.351933953 +0000 UTC m=+99.036540922 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b8771806-daf9-42e9-ab05-a0cf4e357dc1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8r4q5" (UID: "b8771806-daf9-42e9-ab05-a0cf4e357dc1") : configmap "kube-rbac-proxy" not found Jul 06 17:52:57.381046 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:57.380991 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-6p5nh"] Jul 06 17:52:57.383113 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:57.383091 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6p5nh" Jul 06 17:52:57.385471 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:57.385452 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4wj79\"" Jul 06 17:52:57.395019 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:57.395000 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-6p5nh"] Jul 06 17:52:57.475486 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:57.475450 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t279z\" (UniqueName: \"kubernetes.io/projected/11d46d8e-f8ba-4b2a-9a6e-5fc46e2851f1-kube-api-access-t279z\") pod \"network-check-source-989f8b8dc-6p5nh\" (UID: \"11d46d8e-f8ba-4b2a-9a6e-5fc46e2851f1\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6p5nh" Jul 06 17:52:57.576909 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:57.576866 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t279z\" (UniqueName: \"kubernetes.io/projected/11d46d8e-f8ba-4b2a-9a6e-5fc46e2851f1-kube-api-access-t279z\") pod \"network-check-source-989f8b8dc-6p5nh\" (UID: \"11d46d8e-f8ba-4b2a-9a6e-5fc46e2851f1\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6p5nh" Jul 06 17:52:57.587193 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:57.587170 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t279z\" (UniqueName: \"kubernetes.io/projected/11d46d8e-f8ba-4b2a-9a6e-5fc46e2851f1-kube-api-access-t279z\") pod \"network-check-source-989f8b8dc-6p5nh\" (UID: \"11d46d8e-f8ba-4b2a-9a6e-5fc46e2851f1\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6p5nh" Jul 06 17:52:57.691977 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:57.691950 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6p5nh" Jul 06 17:52:57.809107 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:57.809074 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-6p5nh"] Jul 06 17:52:57.812682 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:52:57.812654 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11d46d8e_f8ba_4b2a_9a6e_5fc46e2851f1.slice/crio-3689c35e4f576966dab33bbc06305a46143601836789455a0b3b91b1a697fd4c WatchSource:0}: Error finding container 3689c35e4f576966dab33bbc06305a46143601836789455a0b3b91b1a697fd4c: Status 404 returned error can't find the container with id 3689c35e4f576966dab33bbc06305a46143601836789455a0b3b91b1a697fd4c Jul 06 17:52:58.263339 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:58.263303 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6p5nh" event={"ID":"11d46d8e-f8ba-4b2a-9a6e-5fc46e2851f1","Type":"ContainerStarted","Data":"4d6f3915f6ab8678ab0a3bec8cb115f04f426474cff07da2ed4920786799c863"} Jul 06 17:52:58.263589 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:58.263366 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6p5nh" event={"ID":"11d46d8e-f8ba-4b2a-9a6e-5fc46e2851f1","Type":"ContainerStarted","Data":"3689c35e4f576966dab33bbc06305a46143601836789455a0b3b91b1a697fd4c"} Jul 06 17:52:58.280103 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:58.280055 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-6p5nh" podStartSLOduration=1.280040263 podStartE2EDuration="1.280040263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:52:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:52:58.27946312 +0000 UTC m=+98.964070109" watchObservedRunningTime="2026-07-06 17:52:58.280040263 +0000 UTC m=+98.964647233" Jul 06 17:52:58.383213 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:58.383179 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8771806-daf9-42e9-ab05-a0cf4e357dc1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8r4q5\" (UID: \"b8771806-daf9-42e9-ab05-a0cf4e357dc1\") " pod="openshift-insights/insights-runtime-extractor-8r4q5" Jul 06 17:52:58.383625 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:58.383250 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8771806-daf9-42e9-ab05-a0cf4e357dc1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8r4q5\" (UID: \"b8771806-daf9-42e9-ab05-a0cf4e357dc1\") " pod="openshift-insights/insights-runtime-extractor-8r4q5" Jul 06 17:52:58.383625 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:58.383359 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 17:52:58.383625 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:58.383380 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 17:52:58.383625 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:58.383439 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8771806-daf9-42e9-ab05-a0cf4e357dc1-insights-runtime-extractor-tls podName:b8771806-daf9-42e9-ab05-a0cf4e357dc1 nodeName:}" failed. No retries permitted until 2026-07-06 17:53:06.383416788 +0000 UTC m=+107.068023755 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b8771806-daf9-42e9-ab05-a0cf4e357dc1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8r4q5" (UID: "b8771806-daf9-42e9-ab05-a0cf4e357dc1") : secret "insights-runtime-extractor-tls" not found Jul 06 17:52:58.383625 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:58.383462 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b8771806-daf9-42e9-ab05-a0cf4e357dc1-kube-rbac-proxy-cm podName:b8771806-daf9-42e9-ab05-a0cf4e357dc1 nodeName:}" failed. No retries permitted until 2026-07-06 17:53:06.383451973 +0000 UTC m=+107.068058924 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b8771806-daf9-42e9-ab05-a0cf4e357dc1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8r4q5" (UID: "b8771806-daf9-42e9-ab05-a0cf4e357dc1") : configmap "kube-rbac-proxy" not found Jul 06 17:52:59.998342 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:59.998313 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f94c1e12-5eed-4926-8cdb-d80695439c8c-metrics-tls\") pod \"dns-default-f6glh\" (UID: \"f94c1e12-5eed-4926-8cdb-d80695439c8c\") " pod="openshift-dns/dns-default-f6glh" Jul 06 17:52:59.998791 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:52:59.998398 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-tls\") pod \"image-registry-65dbddffdc-k6pjs\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:52:59.998791 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:59.998447 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:52:59.998791 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:59.998482 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 17:52:59.998791 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:59.998492 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65dbddffdc-k6pjs: secret "image-registry-tls" not found Jul 06 17:52:59.998791 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:59.998506 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f94c1e12-5eed-4926-8cdb-d80695439c8c-metrics-tls podName:f94c1e12-5eed-4926-8cdb-d80695439c8c nodeName:}" failed. No retries permitted until 2026-07-06 17:54:03.998491187 +0000 UTC m=+164.683098140 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f94c1e12-5eed-4926-8cdb-d80695439c8c-metrics-tls") pod "dns-default-f6glh" (UID: "f94c1e12-5eed-4926-8cdb-d80695439c8c") : secret "dns-default-metrics-tls" not found Jul 06 17:52:59.998791 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:52:59.998524 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-tls podName:e28c1ed1-0d92-4ec8-a125-9323325769ed nodeName:}" failed. No retries permitted until 2026-07-06 17:54:03.998514413 +0000 UTC m=+164.683121363 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-tls") pod "image-registry-65dbddffdc-k6pjs" (UID: "e28c1ed1-0d92-4ec8-a125-9323325769ed") : secret "image-registry-tls" not found Jul 06 17:53:01.197476 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:01.197448 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nvnv9" Jul 06 17:53:02.319365 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:02.319324 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/383db5e4-be04-4210-92ca-08b4528901d2-metrics-certs\") pod \"router-default-6844c8868c-2lnp8\" (UID: \"383db5e4-be04-4210-92ca-08b4528901d2\") " pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:53:02.319842 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:02.319449 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/383db5e4-be04-4210-92ca-08b4528901d2-service-ca-bundle\") pod \"router-default-6844c8868c-2lnp8\" (UID: \"383db5e4-be04-4210-92ca-08b4528901d2\") " pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:53:02.319842 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:53:02.319467 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 17:53:02.319842 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:53:02.319524 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/383db5e4-be04-4210-92ca-08b4528901d2-metrics-certs podName:383db5e4-be04-4210-92ca-08b4528901d2 nodeName:}" failed. No retries permitted until 2026-07-06 17:53:18.319510046 +0000 UTC m=+119.004116996 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/383db5e4-be04-4210-92ca-08b4528901d2-metrics-certs") pod "router-default-6844c8868c-2lnp8" (UID: "383db5e4-be04-4210-92ca-08b4528901d2") : secret "router-metrics-certs-default" not found Jul 06 17:53:02.319842 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:53:02.319570 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/383db5e4-be04-4210-92ca-08b4528901d2-service-ca-bundle podName:383db5e4-be04-4210-92ca-08b4528901d2 nodeName:}" failed. No retries permitted until 2026-07-06 17:53:18.319553093 +0000 UTC m=+119.004160043 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/383db5e4-be04-4210-92ca-08b4528901d2-service-ca-bundle") pod "router-default-6844c8868c-2lnp8" (UID: "383db5e4-be04-4210-92ca-08b4528901d2") : configmap references non-existent config key: service-ca.crt Jul 06 17:53:06.447253 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:06.447198 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8771806-daf9-42e9-ab05-a0cf4e357dc1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8r4q5\" (UID: \"b8771806-daf9-42e9-ab05-a0cf4e357dc1\") " pod="openshift-insights/insights-runtime-extractor-8r4q5" Jul 06 17:53:06.447253 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:06.447254 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8771806-daf9-42e9-ab05-a0cf4e357dc1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8r4q5\" (UID: \"b8771806-daf9-42e9-ab05-a0cf4e357dc1\") " pod="openshift-insights/insights-runtime-extractor-8r4q5" Jul 06 17:53:06.447680 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:53:06.447358 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 17:53:06.447680 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:53:06.447430 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8771806-daf9-42e9-ab05-a0cf4e357dc1-insights-runtime-extractor-tls podName:b8771806-daf9-42e9-ab05-a0cf4e357dc1 nodeName:}" failed. No retries permitted until 2026-07-06 17:53:22.447414422 +0000 UTC m=+123.132021376 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b8771806-daf9-42e9-ab05-a0cf4e357dc1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8r4q5" (UID: "b8771806-daf9-42e9-ab05-a0cf4e357dc1") : secret "insights-runtime-extractor-tls" not found Jul 06 17:53:06.447776 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:06.447714 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8771806-daf9-42e9-ab05-a0cf4e357dc1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8r4q5\" (UID: \"b8771806-daf9-42e9-ab05-a0cf4e357dc1\") " pod="openshift-insights/insights-runtime-extractor-8r4q5" Jul 06 17:53:18.339575 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:18.339531 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/383db5e4-be04-4210-92ca-08b4528901d2-service-ca-bundle\") pod \"router-default-6844c8868c-2lnp8\" (UID: \"383db5e4-be04-4210-92ca-08b4528901d2\") " pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:53:18.339575 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:18.339582 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/383db5e4-be04-4210-92ca-08b4528901d2-metrics-certs\") pod \"router-default-6844c8868c-2lnp8\" (UID: \"383db5e4-be04-4210-92ca-08b4528901d2\") " pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:53:18.340315 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:18.340289 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/383db5e4-be04-4210-92ca-08b4528901d2-service-ca-bundle\") pod \"router-default-6844c8868c-2lnp8\" (UID: \"383db5e4-be04-4210-92ca-08b4528901d2\") " pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:53:18.341791 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:18.341773 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/383db5e4-be04-4210-92ca-08b4528901d2-metrics-certs\") pod \"router-default-6844c8868c-2lnp8\" (UID: \"383db5e4-be04-4210-92ca-08b4528901d2\") " pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:53:18.618896 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:18.618801 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:53:18.752305 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:18.752283 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6844c8868c-2lnp8"] Jul 06 17:53:18.752764 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:53:18.752736 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod383db5e4_be04_4210_92ca_08b4528901d2.slice/crio-0c267a7f1d1ce22072cd91af63af11dad8b9ed2881bd8b5e45e37c6b0ae9cba3 WatchSource:0}: Error finding container 0c267a7f1d1ce22072cd91af63af11dad8b9ed2881bd8b5e45e37c6b0ae9cba3: Status 404 returned error can't find the container with id 0c267a7f1d1ce22072cd91af63af11dad8b9ed2881bd8b5e45e37c6b0ae9cba3 Jul 06 17:53:19.317349 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:19.317313 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6844c8868c-2lnp8" event={"ID":"383db5e4-be04-4210-92ca-08b4528901d2","Type":"ContainerStarted","Data":"0b569da21fcb238efbc719cb18072af342f01faf48774235537a53b01abb2b71"} Jul 06 17:53:19.317552 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:19.317361 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6844c8868c-2lnp8" event={"ID":"383db5e4-be04-4210-92ca-08b4528901d2","Type":"ContainerStarted","Data":"0c267a7f1d1ce22072cd91af63af11dad8b9ed2881bd8b5e45e37c6b0ae9cba3"} Jul 06 17:53:19.340158 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:19.340112 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6844c8868c-2lnp8" podStartSLOduration=33.340095634 podStartE2EDuration="33.340095634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:52:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:53:19.33856067 +0000 UTC m=+120.023167646" watchObservedRunningTime="2026-07-06 17:53:19.340095634 +0000 UTC m=+120.024702604" Jul 06 17:53:19.619574 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:19.619493 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:53:19.621868 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:19.621847 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:53:20.320454 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:20.320418 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:53:20.321691 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:20.321668 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6844c8868c-2lnp8" Jul 06 17:53:22.468719 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:22.468685 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8771806-daf9-42e9-ab05-a0cf4e357dc1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8r4q5\" (UID: \"b8771806-daf9-42e9-ab05-a0cf4e357dc1\") " pod="openshift-insights/insights-runtime-extractor-8r4q5" Jul 06 17:53:22.470957 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:22.470935 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8771806-daf9-42e9-ab05-a0cf4e357dc1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8r4q5\" (UID: \"b8771806-daf9-42e9-ab05-a0cf4e357dc1\") " pod="openshift-insights/insights-runtime-extractor-8r4q5" Jul 06 17:53:22.723509 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:22.723427 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-j6zr4\"" Jul 06 17:53:22.730443 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:22.730425 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8r4q5" Jul 06 17:53:22.857159 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:22.857126 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8r4q5"] Jul 06 17:53:22.859955 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:53:22.859928 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8771806_daf9_42e9_ab05_a0cf4e357dc1.slice/crio-c3fa34379527992ba0841aea15a6d8f4ec02a44865426c754de2df889d4bd7bd WatchSource:0}: Error finding container c3fa34379527992ba0841aea15a6d8f4ec02a44865426c754de2df889d4bd7bd: Status 404 returned error can't find the container with id c3fa34379527992ba0841aea15a6d8f4ec02a44865426c754de2df889d4bd7bd Jul 06 17:53:23.331140 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:23.331086 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8r4q5" event={"ID":"b8771806-daf9-42e9-ab05-a0cf4e357dc1","Type":"ContainerStarted","Data":"c3fa34379527992ba0841aea15a6d8f4ec02a44865426c754de2df889d4bd7bd"} Jul 06 17:53:27.343430 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:27.343347 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8r4q5" event={"ID":"b8771806-daf9-42e9-ab05-a0cf4e357dc1","Type":"ContainerStarted","Data":"707a01d746ad369e11b0435f1c3610675b34db3f9f84e8bc2b85fea6e06e9a8c"} Jul 06 17:53:27.343430 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:27.343403 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8r4q5" event={"ID":"b8771806-daf9-42e9-ab05-a0cf4e357dc1","Type":"ContainerStarted","Data":"4eb296fdd1fbdfd5c4b75609067ec0e29e4adca303360ef6a2cdab8fed5d0f0d"} Jul 06 17:53:29.828006 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:29.827972 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc43abe6-169b-482f-8d32-088a668e1820-metrics-certs\") pod \"network-metrics-daemon-gslrl\" (UID: \"bc43abe6-169b-482f-8d32-088a668e1820\") " pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:53:29.830403 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:29.830376 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc43abe6-169b-482f-8d32-088a668e1820-metrics-certs\") pod \"network-metrics-daemon-gslrl\" (UID: \"bc43abe6-169b-482f-8d32-088a668e1820\") " pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:53:29.869233 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:29.869203 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b"] Jul 06 17:53:29.871753 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:29.871737 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b" Jul 06 17:53:29.878409 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:29.878266 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 06 17:53:29.878409 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:29.878266 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 06 17:53:29.878409 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:29.878323 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 06 17:53:29.879305 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:29.879283 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 06 17:53:29.879463 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:29.879312 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 06 17:53:29.889238 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:29.889203 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 06 17:53:29.889391 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:29.889364 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 06 17:53:29.896286 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:29.896263 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b"] Jul 06 17:53:29.928746 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:29.928723 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksh4m\" (UniqueName: \"kubernetes.io/projected/6844cc0d-2481-4bc2-9c02-09a86b55ff93-kube-api-access-ksh4m\") pod \"cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b\" (UID: \"6844cc0d-2481-4bc2-9c02-09a86b55ff93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b" Jul 06 17:53:29.928860 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:29.928764 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6844cc0d-2481-4bc2-9c02-09a86b55ff93-hub\") pod \"cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b\" (UID: \"6844cc0d-2481-4bc2-9c02-09a86b55ff93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b" Jul 06 17:53:29.928860 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:29.928806 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6844cc0d-2481-4bc2-9c02-09a86b55ff93-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b\" (UID: \"6844cc0d-2481-4bc2-9c02-09a86b55ff93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b" Jul 06 17:53:29.928928 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:29.928884 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6844cc0d-2481-4bc2-9c02-09a86b55ff93-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b\" (UID: \"6844cc0d-2481-4bc2-9c02-09a86b55ff93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b" Jul 06 17:53:29.928928 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:29.928910 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6844cc0d-2481-4bc2-9c02-09a86b55ff93-ca\") pod \"cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b\" (UID: \"6844cc0d-2481-4bc2-9c02-09a86b55ff93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b" Jul 06 17:53:29.928990 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:29.928948 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6844cc0d-2481-4bc2-9c02-09a86b55ff93-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b\" (UID: \"6844cc0d-2481-4bc2-9c02-09a86b55ff93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b" Jul 06 17:53:30.029916 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:30.029887 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6844cc0d-2481-4bc2-9c02-09a86b55ff93-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b\" (UID: \"6844cc0d-2481-4bc2-9c02-09a86b55ff93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b" Jul 06 17:53:30.029916 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:30.029920 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6844cc0d-2481-4bc2-9c02-09a86b55ff93-ca\") pod \"cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b\" (UID: \"6844cc0d-2481-4bc2-9c02-09a86b55ff93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b" Jul 06 17:53:30.030192 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:30.029937 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6844cc0d-2481-4bc2-9c02-09a86b55ff93-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b\" (UID: \"6844cc0d-2481-4bc2-9c02-09a86b55ff93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b" Jul 06 17:53:30.030192 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:30.029957 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksh4m\" (UniqueName: \"kubernetes.io/projected/6844cc0d-2481-4bc2-9c02-09a86b55ff93-kube-api-access-ksh4m\") pod \"cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b\" (UID: \"6844cc0d-2481-4bc2-9c02-09a86b55ff93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b" Jul 06 17:53:30.030192 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:30.030154 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6844cc0d-2481-4bc2-9c02-09a86b55ff93-hub\") pod \"cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b\" (UID: \"6844cc0d-2481-4bc2-9c02-09a86b55ff93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b" Jul 06 17:53:30.030377 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:30.030236 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6844cc0d-2481-4bc2-9c02-09a86b55ff93-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b\" (UID: \"6844cc0d-2481-4bc2-9c02-09a86b55ff93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b" Jul 06 17:53:30.030924 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:30.030873 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6844cc0d-2481-4bc2-9c02-09a86b55ff93-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b\" (UID: \"6844cc0d-2481-4bc2-9c02-09a86b55ff93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b" Jul 06 17:53:30.032637 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:30.032609 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6844cc0d-2481-4bc2-9c02-09a86b55ff93-ca\") pod \"cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b\" (UID: \"6844cc0d-2481-4bc2-9c02-09a86b55ff93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b" Jul 06 17:53:30.032752 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:30.032669 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6844cc0d-2481-4bc2-9c02-09a86b55ff93-hub\") pod \"cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b\" (UID: \"6844cc0d-2481-4bc2-9c02-09a86b55ff93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b" Jul 06 17:53:30.032752 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:30.032743 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6844cc0d-2481-4bc2-9c02-09a86b55ff93-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b\" (UID: \"6844cc0d-2481-4bc2-9c02-09a86b55ff93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b" Jul 06 17:53:30.033010 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:30.032992 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6844cc0d-2481-4bc2-9c02-09a86b55ff93-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b\" (UID: \"6844cc0d-2481-4bc2-9c02-09a86b55ff93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b" Jul 06 17:53:30.043047 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:30.043004 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksh4m\" (UniqueName: \"kubernetes.io/projected/6844cc0d-2481-4bc2-9c02-09a86b55ff93-kube-api-access-ksh4m\") pod \"cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b\" (UID: \"6844cc0d-2481-4bc2-9c02-09a86b55ff93\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b" Jul 06 17:53:30.046839 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:30.046804 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-22ww9\"" Jul 06 17:53:30.051672 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:30.051651 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gslrl" Jul 06 17:53:30.185608 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:53:30.185582 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc43abe6_169b_482f_8d32_088a668e1820.slice/crio-5796ef7852edf5f43c051da964960087e6e6208dcaf03ed84afe75b9bddabdbf WatchSource:0}: Error finding container 5796ef7852edf5f43c051da964960087e6e6208dcaf03ed84afe75b9bddabdbf: Status 404 returned error can't find the container with id 5796ef7852edf5f43c051da964960087e6e6208dcaf03ed84afe75b9bddabdbf Jul 06 17:53:30.187480 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:30.187462 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gslrl"] Jul 06 17:53:30.194417 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:30.194399 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b" Jul 06 17:53:30.359244 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:30.359214 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8r4q5" event={"ID":"b8771806-daf9-42e9-ab05-a0cf4e357dc1","Type":"ContainerStarted","Data":"222835c6cc03f0286c5277636c497b5e93d3b991986d2b1022f6f3269321e788"} Jul 06 17:53:30.360047 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:30.359877 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b"] Jul 06 17:53:30.360550 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:30.360434 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gslrl" event={"ID":"bc43abe6-169b-482f-8d32-088a668e1820","Type":"ContainerStarted","Data":"5796ef7852edf5f43c051da964960087e6e6208dcaf03ed84afe75b9bddabdbf"} Jul 06 17:53:30.362356 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:53:30.362334 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6844cc0d_2481_4bc2_9c02_09a86b55ff93.slice/crio-bb0e50122563c8a41ae7681649e9351449d007e9d94683b408d965cd3fbcd957 WatchSource:0}: Error finding container bb0e50122563c8a41ae7681649e9351449d007e9d94683b408d965cd3fbcd957: Status 404 returned error can't find the container with id bb0e50122563c8a41ae7681649e9351449d007e9d94683b408d965cd3fbcd957 Jul 06 17:53:30.409392 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:30.409341 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8r4q5" podStartSLOduration=33.708948878 podStartE2EDuration="40.409323566s" totalImagesPullingTime="6.700374688s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:52:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:53:30.409057895 +0000 UTC m=+131.093664865" watchObservedRunningTime="2026-07-06 17:53:30.409323566 +0000 UTC m=+131.093930540" Jul 06 17:53:31.364683 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:31.364654 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b" event={"ID":"6844cc0d-2481-4bc2-9c02-09a86b55ff93","Type":"ContainerStarted","Data":"bb0e50122563c8a41ae7681649e9351449d007e9d94683b408d965cd3fbcd957"} Jul 06 17:53:32.371606 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:32.371569 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gslrl" event={"ID":"bc43abe6-169b-482f-8d32-088a668e1820","Type":"ContainerStarted","Data":"f7f6a2c6d24c3cbcf02acea858fa8f309033a7b4eb97c8a4368b74dbe9c572d2"} Jul 06 17:53:32.372060 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:32.371660 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gslrl" event={"ID":"bc43abe6-169b-482f-8d32-088a668e1820","Type":"ContainerStarted","Data":"c297dc6cfa0aa2594d18aebe1281e2f62ae1148f70da978db480473f3e33f6bc"} Jul 06 17:53:32.415348 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:32.415272 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gslrl" podStartSLOduration=131.301310587 podStartE2EDuration="2m12.415255049s" totalImagesPullingTime="1.113944462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:51:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:53:32.414154625 +0000 UTC m=+133.098761601" watchObservedRunningTime="2026-07-06 17:53:32.415255049 +0000 UTC m=+133.099862021" Jul 06 17:53:37.391040 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:37.390986 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b" event={"ID":"6844cc0d-2481-4bc2-9c02-09a86b55ff93","Type":"ContainerStarted","Data":"f8b237404c0ed531a6f168509bb5a538c69110ef84bb5bf1d0d3427ac7652842"} Jul 06 17:53:37.391498 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:37.391051 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b" event={"ID":"6844cc0d-2481-4bc2-9c02-09a86b55ff93","Type":"ContainerStarted","Data":"788b08f071f13b0cbd674ee1178cc4d78cab643b1529eb1e278f4d77a7bec3d8"} Jul 06 17:53:37.391498 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:37.391072 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b" event={"ID":"6844cc0d-2481-4bc2-9c02-09a86b55ff93","Type":"ContainerStarted","Data":"4ecf6045e132b29b07e72ab0af9b1455dda3e77262c50bef66ff593fa45d3640"} Jul 06 17:53:37.412205 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:37.412158 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b5ffc7c44-5lt6b" podStartSLOduration=2.33155803 podStartE2EDuration="8.412142743s" totalImagesPullingTime="6.080584713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:53:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:53:37.411227757 +0000 UTC m=+138.095834729" watchObservedRunningTime="2026-07-06 17:53:37.412142743 +0000 UTC m=+138.096749718" Jul 06 17:53:41.976785 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:41.976740 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-64jsf"] Jul 06 17:53:41.981822 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:41.981798 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:41.984478 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:41.984457 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 17:53:41.984591 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:41.984466 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-r4hp5\"" Jul 06 17:53:41.984680 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:41.984665 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 17:53:41.985164 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:41.985148 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 17:53:41.985241 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:41.985173 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 17:53:41.985241 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:41.985183 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 17:53:41.985326 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:41.985240 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 17:53:42.125240 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:42.125213 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-metrics-client-ca\") pod \"node-exporter-64jsf\" (UID: \"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81\") " pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:42.125409 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:42.125255 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-64jsf\" (UID: \"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81\") " pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:42.125409 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:42.125280 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-node-exporter-accelerators-collector-config\") pod \"node-exporter-64jsf\" (UID: \"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81\") " pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:42.125409 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:42.125358 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27knf\" (UniqueName: \"kubernetes.io/projected/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-kube-api-access-27knf\") pod \"node-exporter-64jsf\" (UID: \"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81\") " pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:42.125515 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:42.125407 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-node-exporter-tls\") pod \"node-exporter-64jsf\" (UID: \"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81\") " pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:42.125515 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:42.125433 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-node-exporter-textfile\") pod \"node-exporter-64jsf\" (UID: \"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81\") " pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:42.125515 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:42.125473 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-sys\") pod \"node-exporter-64jsf\" (UID: \"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81\") " pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:42.125515 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:42.125499 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-root\") pod \"node-exporter-64jsf\" (UID: \"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81\") " pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:42.125637 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:42.125540 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-node-exporter-wtmp\") pod \"node-exporter-64jsf\" (UID: \"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81\") " pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:42.226334 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:42.226299 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-metrics-client-ca\") pod \"node-exporter-64jsf\" (UID: \"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81\") " pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:42.226477 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:42.226342 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-64jsf\" (UID: \"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81\") " pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:42.226477 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:42.226364 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-node-exporter-accelerators-collector-config\") pod \"node-exporter-64jsf\" (UID: \"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81\") " pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:42.226477 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:42.226433 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27knf\" (UniqueName: \"kubernetes.io/projected/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-kube-api-access-27knf\") pod \"node-exporter-64jsf\" (UID: \"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81\") " pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:42.226477 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:42.226470 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-node-exporter-tls\") pod \"node-exporter-64jsf\" (UID: \"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81\") " pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:42.226650 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:42.226494 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-node-exporter-textfile\") pod \"node-exporter-64jsf\" (UID: \"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81\") " pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:42.226650 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:42.226523 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-sys\") pod \"node-exporter-64jsf\" (UID: \"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81\") " pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:42.226650 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:42.226555 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-root\") pod \"node-exporter-64jsf\" (UID: \"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81\") " pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:42.226650 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:42.226590 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-node-exporter-wtmp\") pod \"node-exporter-64jsf\" (UID: \"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81\") " pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:42.226650 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:53:42.226637 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 17:53:42.226901 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:42.226688 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-root\") pod \"node-exporter-64jsf\" (UID: \"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81\") " pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:42.226901 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:53:42.226704 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-node-exporter-tls podName:0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81 nodeName:}" failed. No retries permitted until 2026-07-06 17:53:42.726684703 +0000 UTC m=+143.411291656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-node-exporter-tls") pod "node-exporter-64jsf" (UID: "0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81") : secret "node-exporter-tls" not found Jul 06 17:53:42.226901 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:42.226747 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-node-exporter-wtmp\") pod \"node-exporter-64jsf\" (UID: \"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81\") " pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:42.226901 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:42.226897 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-metrics-client-ca\") pod \"node-exporter-64jsf\" (UID: \"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81\") " pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:42.227123 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:42.226916 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-node-exporter-accelerators-collector-config\") pod \"node-exporter-64jsf\" (UID: \"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81\") " pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:42.227123 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:42.226921 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-node-exporter-textfile\") pod \"node-exporter-64jsf\" (UID: \"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81\") " pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:42.227123 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:42.226973 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-sys\") pod \"node-exporter-64jsf\" (UID: \"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81\") " pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:42.228901 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:42.228880 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-64jsf\" (UID: \"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81\") " pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:42.234433 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:42.234395 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27knf\" (UniqueName: \"kubernetes.io/projected/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-kube-api-access-27knf\") pod \"node-exporter-64jsf\" (UID: \"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81\") " pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:42.729924 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:42.729894 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-node-exporter-tls\") pod \"node-exporter-64jsf\" (UID: \"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81\") " pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:42.732233 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:42.732209 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81-node-exporter-tls\") pod \"node-exporter-64jsf\" (UID: \"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81\") " pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:42.890798 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:42.890649 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-64jsf" Jul 06 17:53:42.900734 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:53:42.900706 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d998a0f_b2bb_4510_a3d7_49a5ecf2bb81.slice/crio-463345c48cd4aa29f5e7bb0192e2d25945c21a49051385ef70afe70341753e27 WatchSource:0}: Error finding container 463345c48cd4aa29f5e7bb0192e2d25945c21a49051385ef70afe70341753e27: Status 404 returned error can't find the container with id 463345c48cd4aa29f5e7bb0192e2d25945c21a49051385ef70afe70341753e27 Jul 06 17:53:43.409830 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:43.409795 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-64jsf" event={"ID":"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81","Type":"ContainerStarted","Data":"463345c48cd4aa29f5e7bb0192e2d25945c21a49051385ef70afe70341753e27"} Jul 06 17:53:44.413926 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:44.413875 2578 generic.go:356] "Generic (PLEG): container finished" podID="0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81" containerID="a5612360f03f66c87de5f8bbdd26f3f4cbbadba899eb4fc36407845fb0f48d81" exitCode=0 Jul 06 17:53:44.414307 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:44.413954 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-64jsf" event={"ID":"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81","Type":"ContainerDied","Data":"a5612360f03f66c87de5f8bbdd26f3f4cbbadba899eb4fc36407845fb0f48d81"} Jul 06 17:53:45.418982 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:45.418948 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-64jsf" event={"ID":"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81","Type":"ContainerStarted","Data":"c718ea3c4ad97f6905c5c8dc9af7b7039b3cf3341cd5b727106ec002534928ef"} Jul 06 17:53:45.419375 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:45.419000 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-64jsf" event={"ID":"0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81","Type":"ContainerStarted","Data":"63a8d7edee6fe6896d4a6dc098b8f3cb06d6282f46f6274059a4f89390fbe485"} Jul 06 17:53:45.442320 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:45.442256 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-64jsf" podStartSLOduration=3.408218907 podStartE2EDuration="4.442238037s" totalImagesPullingTime="970.259834ms" totalInitContainerRuntime="63.759296ms" isStatefulPod=true podCreationTimestamp="2026-07-06 17:53:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:53:45.44081041 +0000 UTC m=+146.125417386" watchObservedRunningTime="2026-07-06 17:53:45.442238037 +0000 UTC m=+146.126845009" Jul 06 17:53:52.510092 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:52.510040 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65dbddffdc-k6pjs"] Jul 06 17:53:52.510480 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:53:52.510287 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" podUID="e28c1ed1-0d92-4ec8-a125-9323325769ed" Jul 06 17:53:53.443917 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:53.443886 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:53:53.449985 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:53.449966 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:53:53.619578 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:53.619546 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-bound-sa-token\") pod \"e28c1ed1-0d92-4ec8-a125-9323325769ed\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " Jul 06 17:53:53.619578 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:53.619594 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e28c1ed1-0d92-4ec8-a125-9323325769ed-image-registry-private-configuration\") pod \"e28c1ed1-0d92-4ec8-a125-9323325769ed\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " Jul 06 17:53:53.620123 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:53.619657 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e28c1ed1-0d92-4ec8-a125-9323325769ed-ca-trust-extracted\") pod \"e28c1ed1-0d92-4ec8-a125-9323325769ed\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " Jul 06 17:53:53.620123 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:53.619688 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z55zz\" (UniqueName: \"kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-kube-api-access-z55zz\") pod \"e28c1ed1-0d92-4ec8-a125-9323325769ed\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " Jul 06 17:53:53.620123 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:53.619726 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-certificates\") pod \"e28c1ed1-0d92-4ec8-a125-9323325769ed\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " Jul 06 17:53:53.620123 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:53.619760 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e28c1ed1-0d92-4ec8-a125-9323325769ed-trusted-ca\") pod \"e28c1ed1-0d92-4ec8-a125-9323325769ed\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " Jul 06 17:53:53.620123 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:53.619791 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e28c1ed1-0d92-4ec8-a125-9323325769ed-installation-pull-secrets\") pod \"e28c1ed1-0d92-4ec8-a125-9323325769ed\" (UID: \"e28c1ed1-0d92-4ec8-a125-9323325769ed\") " Jul 06 17:53:53.620123 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:53.620003 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e28c1ed1-0d92-4ec8-a125-9323325769ed-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e28c1ed1-0d92-4ec8-a125-9323325769ed" (UID: "e28c1ed1-0d92-4ec8-a125-9323325769ed"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:53:53.620441 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:53.620233 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e28c1ed1-0d92-4ec8-a125-9323325769ed" (UID: "e28c1ed1-0d92-4ec8-a125-9323325769ed"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:53:53.620441 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:53.620244 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e28c1ed1-0d92-4ec8-a125-9323325769ed-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e28c1ed1-0d92-4ec8-a125-9323325769ed" (UID: "e28c1ed1-0d92-4ec8-a125-9323325769ed"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:53:53.622102 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:53.622065 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e28c1ed1-0d92-4ec8-a125-9323325769ed-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e28c1ed1-0d92-4ec8-a125-9323325769ed" (UID: "e28c1ed1-0d92-4ec8-a125-9323325769ed"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:53:53.622234 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:53.622110 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-kube-api-access-z55zz" (OuterVolumeSpecName: "kube-api-access-z55zz") pod "e28c1ed1-0d92-4ec8-a125-9323325769ed" (UID: "e28c1ed1-0d92-4ec8-a125-9323325769ed"). InnerVolumeSpecName "kube-api-access-z55zz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:53:53.622285 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:53.622257 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e28c1ed1-0d92-4ec8-a125-9323325769ed" (UID: "e28c1ed1-0d92-4ec8-a125-9323325769ed"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:53:53.622334 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:53.622319 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e28c1ed1-0d92-4ec8-a125-9323325769ed-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e28c1ed1-0d92-4ec8-a125-9323325769ed" (UID: "e28c1ed1-0d92-4ec8-a125-9323325769ed"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:53:53.721256 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:53.721174 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e28c1ed1-0d92-4ec8-a125-9323325769ed-ca-trust-extracted\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 17:53:53.721256 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:53.721202 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z55zz\" (UniqueName: \"kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-kube-api-access-z55zz\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 17:53:53.721256 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:53.721212 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-certificates\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 17:53:53.721256 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:53.721221 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e28c1ed1-0d92-4ec8-a125-9323325769ed-trusted-ca\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 17:53:53.721256 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:53.721229 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e28c1ed1-0d92-4ec8-a125-9323325769ed-installation-pull-secrets\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 17:53:53.721256 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:53.721237 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-bound-sa-token\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 17:53:53.721256 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:53.721247 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e28c1ed1-0d92-4ec8-a125-9323325769ed-image-registry-private-configuration\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 17:53:54.447010 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:54.446975 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65dbddffdc-k6pjs" Jul 06 17:53:54.481266 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:54.481143 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65dbddffdc-k6pjs"] Jul 06 17:53:54.485806 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:54.485773 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-65dbddffdc-k6pjs"] Jul 06 17:53:54.628081 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:54.628012 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e28c1ed1-0d92-4ec8-a125-9323325769ed-registry-tls\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 17:53:54.933890 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:54.933863 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e28c1ed1-0d92-4ec8-a125-9323325769ed" path="/var/lib/kubelet/pods/e28c1ed1-0d92-4ec8-a125-9323325769ed/volumes" Jul 06 17:53:55.912516 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:55.912486 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b4dd8c7cf-ptb8k"] Jul 06 17:53:55.925202 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:55.925177 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b4dd8c7cf-ptb8k" Jul 06 17:53:55.929057 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:55.929006 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b4dd8c7cf-ptb8k"] Jul 06 17:53:55.934327 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:55.934288 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 17:53:55.934503 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:55.934384 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 17:53:55.934960 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:55.934591 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 17:53:55.934960 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:55.934777 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 17:53:55.934960 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:55.934827 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 17:53:55.934960 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:55.934832 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 17:53:55.934960 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:55.934921 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 17:53:55.935298 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:55.935048 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nsjbk\"" Jul 06 17:53:55.939146 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:55.939129 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 17:53:56.038073 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:56.038014 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85e56b12-2086-45fa-bff7-1455b6434a6e-console-config\") pod \"console-6b4dd8c7cf-ptb8k\" (UID: \"85e56b12-2086-45fa-bff7-1455b6434a6e\") " pod="openshift-console/console-6b4dd8c7cf-ptb8k" Jul 06 17:53:56.038213 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:56.038132 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbfrs\" (UniqueName: \"kubernetes.io/projected/85e56b12-2086-45fa-bff7-1455b6434a6e-kube-api-access-nbfrs\") pod \"console-6b4dd8c7cf-ptb8k\" (UID: \"85e56b12-2086-45fa-bff7-1455b6434a6e\") " pod="openshift-console/console-6b4dd8c7cf-ptb8k" Jul 06 17:53:56.038213 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:56.038172 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85e56b12-2086-45fa-bff7-1455b6434a6e-service-ca\") pod \"console-6b4dd8c7cf-ptb8k\" (UID: \"85e56b12-2086-45fa-bff7-1455b6434a6e\") " pod="openshift-console/console-6b4dd8c7cf-ptb8k" Jul 06 17:53:56.038213 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:56.038211 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85e56b12-2086-45fa-bff7-1455b6434a6e-oauth-serving-cert\") pod \"console-6b4dd8c7cf-ptb8k\" (UID: \"85e56b12-2086-45fa-bff7-1455b6434a6e\") " pod="openshift-console/console-6b4dd8c7cf-ptb8k" Jul 06 17:53:56.038336 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:56.038302 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85e56b12-2086-45fa-bff7-1455b6434a6e-trusted-ca-bundle\") pod \"console-6b4dd8c7cf-ptb8k\" (UID: \"85e56b12-2086-45fa-bff7-1455b6434a6e\") " pod="openshift-console/console-6b4dd8c7cf-ptb8k" Jul 06 17:53:56.038366 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:56.038354 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85e56b12-2086-45fa-bff7-1455b6434a6e-console-oauth-config\") pod \"console-6b4dd8c7cf-ptb8k\" (UID: \"85e56b12-2086-45fa-bff7-1455b6434a6e\") " pod="openshift-console/console-6b4dd8c7cf-ptb8k" Jul 06 17:53:56.038395 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:56.038383 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85e56b12-2086-45fa-bff7-1455b6434a6e-console-serving-cert\") pod \"console-6b4dd8c7cf-ptb8k\" (UID: \"85e56b12-2086-45fa-bff7-1455b6434a6e\") " pod="openshift-console/console-6b4dd8c7cf-ptb8k" Jul 06 17:53:56.139260 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:56.139224 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbfrs\" (UniqueName: \"kubernetes.io/projected/85e56b12-2086-45fa-bff7-1455b6434a6e-kube-api-access-nbfrs\") pod \"console-6b4dd8c7cf-ptb8k\" (UID: \"85e56b12-2086-45fa-bff7-1455b6434a6e\") " pod="openshift-console/console-6b4dd8c7cf-ptb8k" Jul 06 17:53:56.139260 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:56.139261 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85e56b12-2086-45fa-bff7-1455b6434a6e-service-ca\") pod \"console-6b4dd8c7cf-ptb8k\" (UID: \"85e56b12-2086-45fa-bff7-1455b6434a6e\") " pod="openshift-console/console-6b4dd8c7cf-ptb8k" Jul 06 17:53:56.139481 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:56.139284 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85e56b12-2086-45fa-bff7-1455b6434a6e-oauth-serving-cert\") pod \"console-6b4dd8c7cf-ptb8k\" (UID: \"85e56b12-2086-45fa-bff7-1455b6434a6e\") " pod="openshift-console/console-6b4dd8c7cf-ptb8k" Jul 06 17:53:56.139481 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:56.139305 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85e56b12-2086-45fa-bff7-1455b6434a6e-trusted-ca-bundle\") pod \"console-6b4dd8c7cf-ptb8k\" (UID: \"85e56b12-2086-45fa-bff7-1455b6434a6e\") " pod="openshift-console/console-6b4dd8c7cf-ptb8k" Jul 06 17:53:56.139481 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:56.139326 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85e56b12-2086-45fa-bff7-1455b6434a6e-console-oauth-config\") pod \"console-6b4dd8c7cf-ptb8k\" (UID: \"85e56b12-2086-45fa-bff7-1455b6434a6e\") " pod="openshift-console/console-6b4dd8c7cf-ptb8k" Jul 06 17:53:56.139481 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:56.139352 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85e56b12-2086-45fa-bff7-1455b6434a6e-console-serving-cert\") pod \"console-6b4dd8c7cf-ptb8k\" (UID: \"85e56b12-2086-45fa-bff7-1455b6434a6e\") " pod="openshift-console/console-6b4dd8c7cf-ptb8k" Jul 06 17:53:56.139481 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:56.139380 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85e56b12-2086-45fa-bff7-1455b6434a6e-console-config\") pod \"console-6b4dd8c7cf-ptb8k\" (UID: \"85e56b12-2086-45fa-bff7-1455b6434a6e\") " pod="openshift-console/console-6b4dd8c7cf-ptb8k" Jul 06 17:53:56.140148 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:56.140124 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85e56b12-2086-45fa-bff7-1455b6434a6e-console-config\") pod \"console-6b4dd8c7cf-ptb8k\" (UID: \"85e56b12-2086-45fa-bff7-1455b6434a6e\") " pod="openshift-console/console-6b4dd8c7cf-ptb8k" Jul 06 17:53:56.140257 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:56.140224 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85e56b12-2086-45fa-bff7-1455b6434a6e-oauth-serving-cert\") pod \"console-6b4dd8c7cf-ptb8k\" (UID: \"85e56b12-2086-45fa-bff7-1455b6434a6e\") " pod="openshift-console/console-6b4dd8c7cf-ptb8k" Jul 06 17:53:56.140348 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:56.140326 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85e56b12-2086-45fa-bff7-1455b6434a6e-service-ca\") pod \"console-6b4dd8c7cf-ptb8k\" (UID: \"85e56b12-2086-45fa-bff7-1455b6434a6e\") " pod="openshift-console/console-6b4dd8c7cf-ptb8k" Jul 06 17:53:56.140425 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:56.140409 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85e56b12-2086-45fa-bff7-1455b6434a6e-trusted-ca-bundle\") pod \"console-6b4dd8c7cf-ptb8k\" (UID: \"85e56b12-2086-45fa-bff7-1455b6434a6e\") " pod="openshift-console/console-6b4dd8c7cf-ptb8k" Jul 06 17:53:56.141875 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:56.141842 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85e56b12-2086-45fa-bff7-1455b6434a6e-console-serving-cert\") pod \"console-6b4dd8c7cf-ptb8k\" (UID: \"85e56b12-2086-45fa-bff7-1455b6434a6e\") " pod="openshift-console/console-6b4dd8c7cf-ptb8k" Jul 06 17:53:56.141973 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:56.141951 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85e56b12-2086-45fa-bff7-1455b6434a6e-console-oauth-config\") pod \"console-6b4dd8c7cf-ptb8k\" (UID: \"85e56b12-2086-45fa-bff7-1455b6434a6e\") " pod="openshift-console/console-6b4dd8c7cf-ptb8k" Jul 06 17:53:56.148787 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:56.148762 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbfrs\" (UniqueName: \"kubernetes.io/projected/85e56b12-2086-45fa-bff7-1455b6434a6e-kube-api-access-nbfrs\") pod \"console-6b4dd8c7cf-ptb8k\" (UID: \"85e56b12-2086-45fa-bff7-1455b6434a6e\") " pod="openshift-console/console-6b4dd8c7cf-ptb8k" Jul 06 17:53:56.239073 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:56.239036 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b4dd8c7cf-ptb8k" Jul 06 17:53:56.365825 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:56.365796 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b4dd8c7cf-ptb8k"] Jul 06 17:53:56.368859 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:53:56.368835 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85e56b12_2086_45fa_bff7_1455b6434a6e.slice/crio-ff1eb274d107290d897fbb4549258b57544fa2e9b68f85a97a3a9fcf43b35379 WatchSource:0}: Error finding container ff1eb274d107290d897fbb4549258b57544fa2e9b68f85a97a3a9fcf43b35379: Status 404 returned error can't find the container with id ff1eb274d107290d897fbb4549258b57544fa2e9b68f85a97a3a9fcf43b35379 Jul 06 17:53:56.454213 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:56.454179 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b4dd8c7cf-ptb8k" event={"ID":"85e56b12-2086-45fa-bff7-1455b6434a6e","Type":"ContainerStarted","Data":"ff1eb274d107290d897fbb4549258b57544fa2e9b68f85a97a3a9fcf43b35379"} Jul 06 17:53:59.127801 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:53:59.127755 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-f6glh" podUID="f94c1e12-5eed-4926-8cdb-d80695439c8c" Jul 06 17:53:59.465787 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:59.465761 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f6glh" Jul 06 17:53:59.465787 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:59.465779 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b4dd8c7cf-ptb8k" event={"ID":"85e56b12-2086-45fa-bff7-1455b6434a6e","Type":"ContainerStarted","Data":"7e159ab36f14b8280444a4ec280b1e83276a90fc5cf07cd7ffac408beb1eeeab"} Jul 06 17:53:59.487633 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:53:59.487468 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b4dd8c7cf-ptb8k" podStartSLOduration=1.716076013 podStartE2EDuration="4.487449593s" totalImagesPullingTime="2.77137358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:53:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:53:59.486207455 +0000 UTC m=+160.170814428" watchObservedRunningTime="2026-07-06 17:53:59.487449593 +0000 UTC m=+160.172056567" Jul 06 17:54:04.096536 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:54:04.096494 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f94c1e12-5eed-4926-8cdb-d80695439c8c-metrics-tls\") pod \"dns-default-f6glh\" (UID: \"f94c1e12-5eed-4926-8cdb-d80695439c8c\") " pod="openshift-dns/dns-default-f6glh" Jul 06 17:54:04.098747 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:54:04.098728 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f94c1e12-5eed-4926-8cdb-d80695439c8c-metrics-tls\") pod \"dns-default-f6glh\" (UID: \"f94c1e12-5eed-4926-8cdb-d80695439c8c\") " pod="openshift-dns/dns-default-f6glh" Jul 06 17:54:04.268902 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:54:04.268872 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pm8pm\"" Jul 06 17:54:04.277039 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:54:04.277008 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f6glh" Jul 06 17:54:04.425755 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:54:04.425726 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f6glh"] Jul 06 17:54:04.428725 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:54:04.428702 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf94c1e12_5eed_4926_8cdb_d80695439c8c.slice/crio-5bf428f3106e010584b40abe5ab82778526b8dc6ff0694d15f886f03fe4397da WatchSource:0}: Error finding container 5bf428f3106e010584b40abe5ab82778526b8dc6ff0694d15f886f03fe4397da: Status 404 returned error can't find the container with id 5bf428f3106e010584b40abe5ab82778526b8dc6ff0694d15f886f03fe4397da Jul 06 17:54:04.482003 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:54:04.481972 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f6glh" event={"ID":"f94c1e12-5eed-4926-8cdb-d80695439c8c","Type":"ContainerStarted","Data":"5bf428f3106e010584b40abe5ab82778526b8dc6ff0694d15f886f03fe4397da"} Jul 06 17:54:06.239550 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:54:06.239507 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b4dd8c7cf-ptb8k" Jul 06 17:54:06.239929 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:54:06.239630 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b4dd8c7cf-ptb8k" Jul 06 17:54:06.244443 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:54:06.244421 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b4dd8c7cf-ptb8k" Jul 06 17:54:06.493742 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:54:06.493668 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b4dd8c7cf-ptb8k" Jul 06 17:54:07.493622 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:54:07.493587 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f6glh" event={"ID":"f94c1e12-5eed-4926-8cdb-d80695439c8c","Type":"ContainerStarted","Data":"84ed54c39a4eac76fa87ff351c1dcc65a6383dff13e16363369b8408718d2fa4"} Jul 06 17:54:07.493995 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:54:07.493637 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f6glh" event={"ID":"f94c1e12-5eed-4926-8cdb-d80695439c8c","Type":"ContainerStarted","Data":"820470e5b173b7785d7372202f3f6a709c5b57ed9bc9b3ae2d9fcce9f936af26"} Jul 06 17:54:07.514615 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:54:07.514570 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-f6glh" podStartSLOduration=129.236854574 podStartE2EDuration="2m11.514556272s" totalImagesPullingTime="2.277701698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:51:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:54:07.513287774 +0000 UTC m=+168.197894764" watchObservedRunningTime="2026-07-06 17:54:07.514556272 +0000 UTC m=+168.199163244" Jul 06 17:54:08.496737 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:54:08.496702 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-f6glh" Jul 06 17:54:18.502397 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:54:18.502329 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-f6glh" Jul 06 17:55:39.106008 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:55:39.105970 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b4dd8c7cf-ptb8k"] Jul 06 17:56:04.127372 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.127332 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6b4dd8c7cf-ptb8k" podUID="85e56b12-2086-45fa-bff7-1455b6434a6e" containerName="console" containerID="cri-o://7e159ab36f14b8280444a4ec280b1e83276a90fc5cf07cd7ffac408beb1eeeab" gracePeriod=15 Jul 06 17:56:04.361375 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.361354 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b4dd8c7cf-ptb8k" Jul 06 17:56:04.433144 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.433122 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbfrs\" (UniqueName: \"kubernetes.io/projected/85e56b12-2086-45fa-bff7-1455b6434a6e-kube-api-access-nbfrs\") pod \"85e56b12-2086-45fa-bff7-1455b6434a6e\" (UID: \"85e56b12-2086-45fa-bff7-1455b6434a6e\") " Jul 06 17:56:04.433312 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.433160 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85e56b12-2086-45fa-bff7-1455b6434a6e-service-ca\") pod \"85e56b12-2086-45fa-bff7-1455b6434a6e\" (UID: \"85e56b12-2086-45fa-bff7-1455b6434a6e\") " Jul 06 17:56:04.433312 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.433198 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85e56b12-2086-45fa-bff7-1455b6434a6e-trusted-ca-bundle\") pod \"85e56b12-2086-45fa-bff7-1455b6434a6e\" (UID: \"85e56b12-2086-45fa-bff7-1455b6434a6e\") " Jul 06 17:56:04.433312 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.433216 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85e56b12-2086-45fa-bff7-1455b6434a6e-console-serving-cert\") pod \"85e56b12-2086-45fa-bff7-1455b6434a6e\" (UID: \"85e56b12-2086-45fa-bff7-1455b6434a6e\") " Jul 06 17:56:04.433312 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.433247 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85e56b12-2086-45fa-bff7-1455b6434a6e-console-config\") pod \"85e56b12-2086-45fa-bff7-1455b6434a6e\" (UID: \"85e56b12-2086-45fa-bff7-1455b6434a6e\") " Jul 06 17:56:04.433312 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.433261 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85e56b12-2086-45fa-bff7-1455b6434a6e-oauth-serving-cert\") pod \"85e56b12-2086-45fa-bff7-1455b6434a6e\" (UID: \"85e56b12-2086-45fa-bff7-1455b6434a6e\") " Jul 06 17:56:04.433312 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.433284 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85e56b12-2086-45fa-bff7-1455b6434a6e-console-oauth-config\") pod \"85e56b12-2086-45fa-bff7-1455b6434a6e\" (UID: \"85e56b12-2086-45fa-bff7-1455b6434a6e\") " Jul 06 17:56:04.433672 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.433647 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85e56b12-2086-45fa-bff7-1455b6434a6e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "85e56b12-2086-45fa-bff7-1455b6434a6e" (UID: "85e56b12-2086-45fa-bff7-1455b6434a6e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:56:04.433672 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.433658 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85e56b12-2086-45fa-bff7-1455b6434a6e-service-ca" (OuterVolumeSpecName: "service-ca") pod "85e56b12-2086-45fa-bff7-1455b6434a6e" (UID: "85e56b12-2086-45fa-bff7-1455b6434a6e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:56:04.433765 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.433737 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85e56b12-2086-45fa-bff7-1455b6434a6e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "85e56b12-2086-45fa-bff7-1455b6434a6e" (UID: "85e56b12-2086-45fa-bff7-1455b6434a6e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:56:04.433765 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.433745 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85e56b12-2086-45fa-bff7-1455b6434a6e-console-config" (OuterVolumeSpecName: "console-config") pod "85e56b12-2086-45fa-bff7-1455b6434a6e" (UID: "85e56b12-2086-45fa-bff7-1455b6434a6e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:56:04.435452 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.435424 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85e56b12-2086-45fa-bff7-1455b6434a6e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "85e56b12-2086-45fa-bff7-1455b6434a6e" (UID: "85e56b12-2086-45fa-bff7-1455b6434a6e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:56:04.435550 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.435451 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85e56b12-2086-45fa-bff7-1455b6434a6e-kube-api-access-nbfrs" (OuterVolumeSpecName: "kube-api-access-nbfrs") pod "85e56b12-2086-45fa-bff7-1455b6434a6e" (UID: "85e56b12-2086-45fa-bff7-1455b6434a6e"). InnerVolumeSpecName "kube-api-access-nbfrs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:56:04.435550 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.435476 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85e56b12-2086-45fa-bff7-1455b6434a6e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "85e56b12-2086-45fa-bff7-1455b6434a6e" (UID: "85e56b12-2086-45fa-bff7-1455b6434a6e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:56:04.534351 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.534322 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85e56b12-2086-45fa-bff7-1455b6434a6e-console-config\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 17:56:04.534351 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.534347 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85e56b12-2086-45fa-bff7-1455b6434a6e-oauth-serving-cert\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 17:56:04.534351 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.534357 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85e56b12-2086-45fa-bff7-1455b6434a6e-console-oauth-config\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 17:56:04.534585 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.534365 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbfrs\" (UniqueName: \"kubernetes.io/projected/85e56b12-2086-45fa-bff7-1455b6434a6e-kube-api-access-nbfrs\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 17:56:04.534585 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.534374 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85e56b12-2086-45fa-bff7-1455b6434a6e-service-ca\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 17:56:04.534585 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.534385 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85e56b12-2086-45fa-bff7-1455b6434a6e-trusted-ca-bundle\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 17:56:04.534585 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.534397 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85e56b12-2086-45fa-bff7-1455b6434a6e-console-serving-cert\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 17:56:04.864865 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.864782 2578 generic.go:356] "Generic (PLEG): container finished" podID="85e56b12-2086-45fa-bff7-1455b6434a6e" containerID="7e159ab36f14b8280444a4ec280b1e83276a90fc5cf07cd7ffac408beb1eeeab" exitCode=0 Jul 06 17:56:04.864865 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.864828 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b4dd8c7cf-ptb8k" Jul 06 17:56:04.864865 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.864843 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b4dd8c7cf-ptb8k" event={"ID":"85e56b12-2086-45fa-bff7-1455b6434a6e","Type":"ContainerDied","Data":"7e159ab36f14b8280444a4ec280b1e83276a90fc5cf07cd7ffac408beb1eeeab"} Jul 06 17:56:04.865136 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.864883 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b4dd8c7cf-ptb8k" event={"ID":"85e56b12-2086-45fa-bff7-1455b6434a6e","Type":"ContainerDied","Data":"ff1eb274d107290d897fbb4549258b57544fa2e9b68f85a97a3a9fcf43b35379"} Jul 06 17:56:04.865136 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.864903 2578 scope.go:117] "RemoveContainer" containerID="7e159ab36f14b8280444a4ec280b1e83276a90fc5cf07cd7ffac408beb1eeeab" Jul 06 17:56:04.875448 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.875429 2578 scope.go:117] "RemoveContainer" containerID="7e159ab36f14b8280444a4ec280b1e83276a90fc5cf07cd7ffac408beb1eeeab" Jul 06 17:56:04.875724 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:56:04.875703 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e159ab36f14b8280444a4ec280b1e83276a90fc5cf07cd7ffac408beb1eeeab\": container with ID starting with 7e159ab36f14b8280444a4ec280b1e83276a90fc5cf07cd7ffac408beb1eeeab not found: ID does not exist" containerID="7e159ab36f14b8280444a4ec280b1e83276a90fc5cf07cd7ffac408beb1eeeab" Jul 06 17:56:04.875769 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.875732 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e159ab36f14b8280444a4ec280b1e83276a90fc5cf07cd7ffac408beb1eeeab"} err="failed to get container status \"7e159ab36f14b8280444a4ec280b1e83276a90fc5cf07cd7ffac408beb1eeeab\": rpc error: code = NotFound desc = could not find container \"7e159ab36f14b8280444a4ec280b1e83276a90fc5cf07cd7ffac408beb1eeeab\": container with ID starting with 7e159ab36f14b8280444a4ec280b1e83276a90fc5cf07cd7ffac408beb1eeeab not found: ID does not exist" Jul 06 17:56:04.888159 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.888131 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b4dd8c7cf-ptb8k"] Jul 06 17:56:04.892365 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.892344 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b4dd8c7cf-ptb8k"] Jul 06 17:56:04.933636 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:04.933608 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85e56b12-2086-45fa-bff7-1455b6434a6e" path="/var/lib/kubelet/pods/85e56b12-2086-45fa-bff7-1455b6434a6e/volumes" Jul 06 17:56:19.743176 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:19.743148 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 17:56:45.372551 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:45.372519 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9rsw8"] Jul 06 17:56:45.374257 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:45.372735 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85e56b12-2086-45fa-bff7-1455b6434a6e" containerName="console" Jul 06 17:56:45.374257 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:45.372763 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="85e56b12-2086-45fa-bff7-1455b6434a6e" containerName="console" Jul 06 17:56:45.374257 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:45.372806 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="85e56b12-2086-45fa-bff7-1455b6434a6e" containerName="console" Jul 06 17:56:45.374770 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:45.374749 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9rsw8" Jul 06 17:56:45.377043 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:45.377010 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 06 17:56:45.377166 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:45.377103 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 06 17:56:45.377871 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:45.377856 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-cd7xl\"" Jul 06 17:56:45.386081 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:45.386060 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9rsw8"] Jul 06 17:56:45.410298 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:45.410277 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa226cf2-9408-474d-b466-579c02b37e21-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9rsw8\" (UID: \"aa226cf2-9408-474d-b466-579c02b37e21\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9rsw8" Jul 06 17:56:45.410403 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:45.410305 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxl8b\" (UniqueName: \"kubernetes.io/projected/aa226cf2-9408-474d-b466-579c02b37e21-kube-api-access-xxl8b\") pod \"cert-manager-cainjector-559cdd8c87-9rsw8\" (UID: \"aa226cf2-9408-474d-b466-579c02b37e21\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9rsw8" Jul 06 17:56:45.511232 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:45.511206 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa226cf2-9408-474d-b466-579c02b37e21-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9rsw8\" (UID: \"aa226cf2-9408-474d-b466-579c02b37e21\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9rsw8" Jul 06 17:56:45.511324 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:45.511236 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxl8b\" (UniqueName: \"kubernetes.io/projected/aa226cf2-9408-474d-b466-579c02b37e21-kube-api-access-xxl8b\") pod \"cert-manager-cainjector-559cdd8c87-9rsw8\" (UID: \"aa226cf2-9408-474d-b466-579c02b37e21\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9rsw8" Jul 06 17:56:45.521058 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:45.521019 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa226cf2-9408-474d-b466-579c02b37e21-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9rsw8\" (UID: \"aa226cf2-9408-474d-b466-579c02b37e21\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9rsw8" Jul 06 17:56:45.521336 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:45.521316 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxl8b\" (UniqueName: \"kubernetes.io/projected/aa226cf2-9408-474d-b466-579c02b37e21-kube-api-access-xxl8b\") pod \"cert-manager-cainjector-559cdd8c87-9rsw8\" (UID: \"aa226cf2-9408-474d-b466-579c02b37e21\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9rsw8" Jul 06 17:56:45.683617 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:45.683592 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9rsw8" Jul 06 17:56:45.802403 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:45.802373 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9rsw8"] Jul 06 17:56:45.805390 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:56:45.805357 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa226cf2_9408_474d_b466_579c02b37e21.slice/crio-4a42c4d5fe63ff931851b8ddf193a4fee1d3e2fd1b8ad609c48a7c2994070aba WatchSource:0}: Error finding container 4a42c4d5fe63ff931851b8ddf193a4fee1d3e2fd1b8ad609c48a7c2994070aba: Status 404 returned error can't find the container with id 4a42c4d5fe63ff931851b8ddf193a4fee1d3e2fd1b8ad609c48a7c2994070aba Jul 06 17:56:45.807326 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:45.807310 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 17:56:45.993422 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:45.993343 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9rsw8" event={"ID":"aa226cf2-9408-474d-b466-579c02b37e21","Type":"ContainerStarted","Data":"4a42c4d5fe63ff931851b8ddf193a4fee1d3e2fd1b8ad609c48a7c2994070aba"} Jul 06 17:56:49.006635 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:49.006605 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9rsw8" event={"ID":"aa226cf2-9408-474d-b466-579c02b37e21","Type":"ContainerStarted","Data":"62f00547574f0b25284522a8b2a95558ab925c5f2e06fa8c2f430fd80f2891a7"} Jul 06 17:56:49.029733 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:56:49.029685 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9rsw8" podStartSLOduration=0.972009566 podStartE2EDuration="4.029667926s" totalImagesPullingTime="3.05765836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:56:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:56:49.029305058 +0000 UTC m=+329.713912030" watchObservedRunningTime="2026-07-06 17:56:49.029667926 +0000 UTC m=+329.714274900" Jul 06 17:57:19.210316 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:19.210227 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-sv72h"] Jul 06 17:57:19.212519 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:19.212496 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-sv72h" Jul 06 17:57:19.216239 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:19.216221 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2c6xq\"" Jul 06 17:57:19.216570 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:19.216557 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 17:57:19.216774 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:19.216763 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 17:57:19.217037 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:19.217010 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 17:57:19.217417 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:19.217401 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 17:57:19.239515 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:19.239490 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-sv72h"] Jul 06 17:57:19.357384 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:19.357339 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1828c53e-91b1-4e6e-ad8b-55533a87db31-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-sv72h\" (UID: \"1828c53e-91b1-4e6e-ad8b-55533a87db31\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-sv72h" Jul 06 17:57:19.357582 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:19.357418 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7647p\" (UniqueName: \"kubernetes.io/projected/1828c53e-91b1-4e6e-ad8b-55533a87db31-kube-api-access-7647p\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-sv72h\" (UID: \"1828c53e-91b1-4e6e-ad8b-55533a87db31\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-sv72h" Jul 06 17:57:19.357582 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:19.357460 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1828c53e-91b1-4e6e-ad8b-55533a87db31-manifests\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-sv72h\" (UID: \"1828c53e-91b1-4e6e-ad8b-55533a87db31\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-sv72h" Jul 06 17:57:19.357582 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:19.357488 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1828c53e-91b1-4e6e-ad8b-55533a87db31-tmp\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-sv72h\" (UID: \"1828c53e-91b1-4e6e-ad8b-55533a87db31\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-sv72h" Jul 06 17:57:19.357582 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:19.357522 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1828c53e-91b1-4e6e-ad8b-55533a87db31-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-sv72h\" (UID: \"1828c53e-91b1-4e6e-ad8b-55533a87db31\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-sv72h" Jul 06 17:57:19.458230 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:19.458193 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1828c53e-91b1-4e6e-ad8b-55533a87db31-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-sv72h\" (UID: \"1828c53e-91b1-4e6e-ad8b-55533a87db31\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-sv72h" Jul 06 17:57:19.458424 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:19.458233 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7647p\" (UniqueName: \"kubernetes.io/projected/1828c53e-91b1-4e6e-ad8b-55533a87db31-kube-api-access-7647p\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-sv72h\" (UID: \"1828c53e-91b1-4e6e-ad8b-55533a87db31\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-sv72h" Jul 06 17:57:19.458424 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:19.458313 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1828c53e-91b1-4e6e-ad8b-55533a87db31-manifests\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-sv72h\" (UID: \"1828c53e-91b1-4e6e-ad8b-55533a87db31\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-sv72h" Jul 06 17:57:19.458424 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:19.458341 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1828c53e-91b1-4e6e-ad8b-55533a87db31-tmp\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-sv72h\" (UID: \"1828c53e-91b1-4e6e-ad8b-55533a87db31\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-sv72h" Jul 06 17:57:19.458424 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:19.458382 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1828c53e-91b1-4e6e-ad8b-55533a87db31-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-sv72h\" (UID: \"1828c53e-91b1-4e6e-ad8b-55533a87db31\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-sv72h" Jul 06 17:57:19.458768 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:19.458742 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1828c53e-91b1-4e6e-ad8b-55533a87db31-manifests\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-sv72h\" (UID: \"1828c53e-91b1-4e6e-ad8b-55533a87db31\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-sv72h" Jul 06 17:57:19.460691 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:19.460636 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1828c53e-91b1-4e6e-ad8b-55533a87db31-tmp\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-sv72h\" (UID: \"1828c53e-91b1-4e6e-ad8b-55533a87db31\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-sv72h" Jul 06 17:57:19.460783 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:19.460740 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1828c53e-91b1-4e6e-ad8b-55533a87db31-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-sv72h\" (UID: \"1828c53e-91b1-4e6e-ad8b-55533a87db31\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-sv72h" Jul 06 17:57:19.460783 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:19.460767 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1828c53e-91b1-4e6e-ad8b-55533a87db31-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-sv72h\" (UID: \"1828c53e-91b1-4e6e-ad8b-55533a87db31\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-sv72h" Jul 06 17:57:19.465767 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:19.465742 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7647p\" (UniqueName: \"kubernetes.io/projected/1828c53e-91b1-4e6e-ad8b-55533a87db31-kube-api-access-7647p\") pod \"opendatahub-operator-controller-manager-7f8c8d8b67-sv72h\" (UID: \"1828c53e-91b1-4e6e-ad8b-55533a87db31\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-sv72h" Jul 06 17:57:19.521509 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:19.521485 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-sv72h" Jul 06 17:57:19.648312 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:19.648249 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-sv72h"] Jul 06 17:57:19.651068 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:57:19.651042 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1828c53e_91b1_4e6e_ad8b_55533a87db31.slice/crio-65b4a1217dd6c602f3e31849d88032005582534bfb606b6a81e32d0517e5af75 WatchSource:0}: Error finding container 65b4a1217dd6c602f3e31849d88032005582534bfb606b6a81e32d0517e5af75: Status 404 returned error can't find the container with id 65b4a1217dd6c602f3e31849d88032005582534bfb606b6a81e32d0517e5af75 Jul 06 17:57:20.103196 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:20.103165 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-sv72h" event={"ID":"1828c53e-91b1-4e6e-ad8b-55533a87db31","Type":"ContainerStarted","Data":"65b4a1217dd6c602f3e31849d88032005582534bfb606b6a81e32d0517e5af75"} Jul 06 17:57:23.116773 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:23.116694 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-sv72h" event={"ID":"1828c53e-91b1-4e6e-ad8b-55533a87db31","Type":"ContainerStarted","Data":"e2c5f2c5a30919e143752215baf39845ff228a588686a2358eb1e3cb0ee1c76c"} Jul 06 17:57:24.122070 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:24.121974 2578 generic.go:356] "Generic (PLEG): container finished" podID="1828c53e-91b1-4e6e-ad8b-55533a87db31" containerID="e2c5f2c5a30919e143752215baf39845ff228a588686a2358eb1e3cb0ee1c76c" exitCode=0 Jul 06 17:57:24.122399 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:24.122064 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-sv72h" event={"ID":"1828c53e-91b1-4e6e-ad8b-55533a87db31","Type":"ContainerDied","Data":"e2c5f2c5a30919e143752215baf39845ff228a588686a2358eb1e3cb0ee1c76c"} Jul 06 17:57:25.126821 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:25.126785 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-sv72h" event={"ID":"1828c53e-91b1-4e6e-ad8b-55533a87db31","Type":"ContainerStarted","Data":"339dcfafeb9d3b1061ea06b9a197b4f9dc0d4adf0d04f49141e7e0588466a752"} Jul 06 17:57:25.127209 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:25.126863 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-sv72h" Jul 06 17:57:25.178509 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:25.178453 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-sv72h" podStartSLOduration=1.684793521 podStartE2EDuration="6.17843635s" totalImagesPullingTime="3.463428022s" totalInitContainerRuntime="1.030214807s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:57:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:57:25.176377313 +0000 UTC m=+365.860984284" watchObservedRunningTime="2026-07-06 17:57:25.17843635 +0000 UTC m=+365.863043312" Jul 06 17:57:36.133099 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:36.133067 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7f8c8d8b67-sv72h" Jul 06 17:57:40.158795 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:40.158738 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rjwcv"] Jul 06 17:57:40.164270 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:40.164248 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-rjwcv" Jul 06 17:57:40.167442 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:40.167419 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 06 17:57:40.167442 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:40.167430 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-rws6b\"" Jul 06 17:57:40.200316 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:40.200291 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rjwcv"] Jul 06 17:57:40.210250 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:40.210227 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jrj9\" (UniqueName: \"kubernetes.io/projected/c546bc20-63c6-4efc-b843-8d22961d31b1-kube-api-access-9jrj9\") pod \"odh-model-controller-7998c67dc4-rjwcv\" (UID: \"c546bc20-63c6-4efc-b843-8d22961d31b1\") " pod="opendatahub/odh-model-controller-7998c67dc4-rjwcv" Jul 06 17:57:40.210368 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:40.210263 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c546bc20-63c6-4efc-b843-8d22961d31b1-cert\") pod \"odh-model-controller-7998c67dc4-rjwcv\" (UID: \"c546bc20-63c6-4efc-b843-8d22961d31b1\") " pod="opendatahub/odh-model-controller-7998c67dc4-rjwcv" Jul 06 17:57:40.310978 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:40.310947 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jrj9\" (UniqueName: \"kubernetes.io/projected/c546bc20-63c6-4efc-b843-8d22961d31b1-kube-api-access-9jrj9\") pod \"odh-model-controller-7998c67dc4-rjwcv\" (UID: \"c546bc20-63c6-4efc-b843-8d22961d31b1\") " pod="opendatahub/odh-model-controller-7998c67dc4-rjwcv" Jul 06 17:57:40.311165 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:40.310989 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c546bc20-63c6-4efc-b843-8d22961d31b1-cert\") pod \"odh-model-controller-7998c67dc4-rjwcv\" (UID: \"c546bc20-63c6-4efc-b843-8d22961d31b1\") " pod="opendatahub/odh-model-controller-7998c67dc4-rjwcv" Jul 06 17:57:40.311165 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:57:40.311118 2578 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 06 17:57:40.311245 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:57:40.311172 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c546bc20-63c6-4efc-b843-8d22961d31b1-cert podName:c546bc20-63c6-4efc-b843-8d22961d31b1 nodeName:}" failed. No retries permitted until 2026-07-06 17:57:40.811155551 +0000 UTC m=+381.495762509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c546bc20-63c6-4efc-b843-8d22961d31b1-cert") pod "odh-model-controller-7998c67dc4-rjwcv" (UID: "c546bc20-63c6-4efc-b843-8d22961d31b1") : secret "odh-model-controller-webhook-cert" not found Jul 06 17:57:40.323040 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:40.323003 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jrj9\" (UniqueName: \"kubernetes.io/projected/c546bc20-63c6-4efc-b843-8d22961d31b1-kube-api-access-9jrj9\") pod \"odh-model-controller-7998c67dc4-rjwcv\" (UID: \"c546bc20-63c6-4efc-b843-8d22961d31b1\") " pod="opendatahub/odh-model-controller-7998c67dc4-rjwcv" Jul 06 17:57:40.815459 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:40.815423 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c546bc20-63c6-4efc-b843-8d22961d31b1-cert\") pod \"odh-model-controller-7998c67dc4-rjwcv\" (UID: \"c546bc20-63c6-4efc-b843-8d22961d31b1\") " pod="opendatahub/odh-model-controller-7998c67dc4-rjwcv" Jul 06 17:57:40.815620 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:57:40.815581 2578 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 06 17:57:40.815663 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:57:40.815646 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c546bc20-63c6-4efc-b843-8d22961d31b1-cert podName:c546bc20-63c6-4efc-b843-8d22961d31b1 nodeName:}" failed. No retries permitted until 2026-07-06 17:57:41.815628769 +0000 UTC m=+382.500235723 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c546bc20-63c6-4efc-b843-8d22961d31b1-cert") pod "odh-model-controller-7998c67dc4-rjwcv" (UID: "c546bc20-63c6-4efc-b843-8d22961d31b1") : secret "odh-model-controller-webhook-cert" not found Jul 06 17:57:41.200449 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:41.200421 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hkkq8"] Jul 06 17:57:41.203000 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:41.202985 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-hkkq8" Jul 06 17:57:41.205848 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:41.205823 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-7cblk\"" Jul 06 17:57:41.206105 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:41.206090 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 06 17:57:41.218121 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:41.218089 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hkkq8"] Jul 06 17:57:41.218258 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:41.218234 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b83bc448-de88-4275-9138-c9ba7ccaa92f-tls-certs\") pod \"model-serving-api-54d89bd5fc-hkkq8\" (UID: \"b83bc448-de88-4275-9138-c9ba7ccaa92f\") " pod="opendatahub/model-serving-api-54d89bd5fc-hkkq8" Jul 06 17:57:41.218380 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:41.218352 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g82ld\" (UniqueName: \"kubernetes.io/projected/b83bc448-de88-4275-9138-c9ba7ccaa92f-kube-api-access-g82ld\") pod \"model-serving-api-54d89bd5fc-hkkq8\" (UID: \"b83bc448-de88-4275-9138-c9ba7ccaa92f\") " pod="opendatahub/model-serving-api-54d89bd5fc-hkkq8" Jul 06 17:57:41.318821 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:41.318783 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g82ld\" (UniqueName: \"kubernetes.io/projected/b83bc448-de88-4275-9138-c9ba7ccaa92f-kube-api-access-g82ld\") pod \"model-serving-api-54d89bd5fc-hkkq8\" (UID: \"b83bc448-de88-4275-9138-c9ba7ccaa92f\") " pod="opendatahub/model-serving-api-54d89bd5fc-hkkq8" Jul 06 17:57:41.318821 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:41.318824 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b83bc448-de88-4275-9138-c9ba7ccaa92f-tls-certs\") pod \"model-serving-api-54d89bd5fc-hkkq8\" (UID: \"b83bc448-de88-4275-9138-c9ba7ccaa92f\") " pod="opendatahub/model-serving-api-54d89bd5fc-hkkq8" Jul 06 17:57:41.319172 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:57:41.318943 2578 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 06 17:57:41.319172 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:57:41.318992 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b83bc448-de88-4275-9138-c9ba7ccaa92f-tls-certs podName:b83bc448-de88-4275-9138-c9ba7ccaa92f nodeName:}" failed. No retries permitted until 2026-07-06 17:57:41.818979326 +0000 UTC m=+382.503586281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/b83bc448-de88-4275-9138-c9ba7ccaa92f-tls-certs") pod "model-serving-api-54d89bd5fc-hkkq8" (UID: "b83bc448-de88-4275-9138-c9ba7ccaa92f") : secret "model-serving-api-tls" not found Jul 06 17:57:41.330500 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:41.330460 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g82ld\" (UniqueName: \"kubernetes.io/projected/b83bc448-de88-4275-9138-c9ba7ccaa92f-kube-api-access-g82ld\") pod \"model-serving-api-54d89bd5fc-hkkq8\" (UID: \"b83bc448-de88-4275-9138-c9ba7ccaa92f\") " pod="opendatahub/model-serving-api-54d89bd5fc-hkkq8" Jul 06 17:57:41.823612 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:41.823575 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b83bc448-de88-4275-9138-c9ba7ccaa92f-tls-certs\") pod \"model-serving-api-54d89bd5fc-hkkq8\" (UID: \"b83bc448-de88-4275-9138-c9ba7ccaa92f\") " pod="opendatahub/model-serving-api-54d89bd5fc-hkkq8" Jul 06 17:57:41.823792 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:41.823620 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c546bc20-63c6-4efc-b843-8d22961d31b1-cert\") pod \"odh-model-controller-7998c67dc4-rjwcv\" (UID: \"c546bc20-63c6-4efc-b843-8d22961d31b1\") " pod="opendatahub/odh-model-controller-7998c67dc4-rjwcv" Jul 06 17:57:41.825983 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:41.825955 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c546bc20-63c6-4efc-b843-8d22961d31b1-cert\") pod \"odh-model-controller-7998c67dc4-rjwcv\" (UID: \"c546bc20-63c6-4efc-b843-8d22961d31b1\") " pod="opendatahub/odh-model-controller-7998c67dc4-rjwcv" Jul 06 17:57:41.826110 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:41.826018 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b83bc448-de88-4275-9138-c9ba7ccaa92f-tls-certs\") pod \"model-serving-api-54d89bd5fc-hkkq8\" (UID: \"b83bc448-de88-4275-9138-c9ba7ccaa92f\") " pod="opendatahub/model-serving-api-54d89bd5fc-hkkq8" Jul 06 17:57:41.975535 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:41.975497 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-rjwcv" Jul 06 17:57:42.101486 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:42.101421 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rjwcv"] Jul 06 17:57:42.104256 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:57:42.104232 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc546bc20_63c6_4efc_b843_8d22961d31b1.slice/crio-9400fabbb7317cdea9cd05099ecf30ed1f4c32e6ed6ac5417840f1b01fe32f53 WatchSource:0}: Error finding container 9400fabbb7317cdea9cd05099ecf30ed1f4c32e6ed6ac5417840f1b01fe32f53: Status 404 returned error can't find the container with id 9400fabbb7317cdea9cd05099ecf30ed1f4c32e6ed6ac5417840f1b01fe32f53 Jul 06 17:57:42.113728 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:42.113707 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-hkkq8" Jul 06 17:57:42.182527 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:42.182496 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-rjwcv" event={"ID":"c546bc20-63c6-4efc-b843-8d22961d31b1","Type":"ContainerStarted","Data":"9400fabbb7317cdea9cd05099ecf30ed1f4c32e6ed6ac5417840f1b01fe32f53"} Jul 06 17:57:42.247626 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:42.247602 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hkkq8"] Jul 06 17:57:42.249982 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:57:42.249960 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb83bc448_de88_4275_9138_c9ba7ccaa92f.slice/crio-1f6597ff76b273f4d8e2bc06d8c946f19d5476e2bf82e10b28cefcd30f66b1e2 WatchSource:0}: Error finding container 1f6597ff76b273f4d8e2bc06d8c946f19d5476e2bf82e10b28cefcd30f66b1e2: Status 404 returned error can't find the container with id 1f6597ff76b273f4d8e2bc06d8c946f19d5476e2bf82e10b28cefcd30f66b1e2 Jul 06 17:57:43.089764 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:43.089729 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-76c4c4d987-258bc"] Jul 06 17:57:43.092159 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:43.092113 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-76c4c4d987-258bc" Jul 06 17:57:43.095389 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:43.095347 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7wdq2\"" Jul 06 17:57:43.095571 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:43.095549 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 06 17:57:43.095782 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:43.095766 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 17:57:43.103644 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:43.103625 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-76c4c4d987-258bc"] Jul 06 17:57:43.134323 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:43.134290 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7f6h\" (UniqueName: \"kubernetes.io/projected/a4d95b91-3e89-4a11-a5ad-b1e38e587571-kube-api-access-l7f6h\") pod \"kube-auth-proxy-76c4c4d987-258bc\" (UID: \"a4d95b91-3e89-4a11-a5ad-b1e38e587571\") " pod="openshift-ingress/kube-auth-proxy-76c4c4d987-258bc" Jul 06 17:57:43.134482 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:43.134358 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4d95b91-3e89-4a11-a5ad-b1e38e587571-tls-certs\") pod \"kube-auth-proxy-76c4c4d987-258bc\" (UID: \"a4d95b91-3e89-4a11-a5ad-b1e38e587571\") " pod="openshift-ingress/kube-auth-proxy-76c4c4d987-258bc" Jul 06 17:57:43.134482 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:43.134411 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4d95b91-3e89-4a11-a5ad-b1e38e587571-tmp\") pod \"kube-auth-proxy-76c4c4d987-258bc\" (UID: \"a4d95b91-3e89-4a11-a5ad-b1e38e587571\") " pod="openshift-ingress/kube-auth-proxy-76c4c4d987-258bc" Jul 06 17:57:43.189502 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:43.189466 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-hkkq8" event={"ID":"b83bc448-de88-4275-9138-c9ba7ccaa92f","Type":"ContainerStarted","Data":"1f6597ff76b273f4d8e2bc06d8c946f19d5476e2bf82e10b28cefcd30f66b1e2"} Jul 06 17:57:43.235583 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:43.235549 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4d95b91-3e89-4a11-a5ad-b1e38e587571-tls-certs\") pod \"kube-auth-proxy-76c4c4d987-258bc\" (UID: \"a4d95b91-3e89-4a11-a5ad-b1e38e587571\") " pod="openshift-ingress/kube-auth-proxy-76c4c4d987-258bc" Jul 06 17:57:43.235768 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:43.235614 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4d95b91-3e89-4a11-a5ad-b1e38e587571-tmp\") pod \"kube-auth-proxy-76c4c4d987-258bc\" (UID: \"a4d95b91-3e89-4a11-a5ad-b1e38e587571\") " pod="openshift-ingress/kube-auth-proxy-76c4c4d987-258bc" Jul 06 17:57:43.235768 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:43.235666 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7f6h\" (UniqueName: \"kubernetes.io/projected/a4d95b91-3e89-4a11-a5ad-b1e38e587571-kube-api-access-l7f6h\") pod \"kube-auth-proxy-76c4c4d987-258bc\" (UID: \"a4d95b91-3e89-4a11-a5ad-b1e38e587571\") " pod="openshift-ingress/kube-auth-proxy-76c4c4d987-258bc" Jul 06 17:57:43.240567 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:43.240538 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4d95b91-3e89-4a11-a5ad-b1e38e587571-tmp\") pod \"kube-auth-proxy-76c4c4d987-258bc\" (UID: \"a4d95b91-3e89-4a11-a5ad-b1e38e587571\") " pod="openshift-ingress/kube-auth-proxy-76c4c4d987-258bc" Jul 06 17:57:43.241934 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:43.241888 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4d95b91-3e89-4a11-a5ad-b1e38e587571-tls-certs\") pod \"kube-auth-proxy-76c4c4d987-258bc\" (UID: \"a4d95b91-3e89-4a11-a5ad-b1e38e587571\") " pod="openshift-ingress/kube-auth-proxy-76c4c4d987-258bc" Jul 06 17:57:43.248976 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:43.248915 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7f6h\" (UniqueName: \"kubernetes.io/projected/a4d95b91-3e89-4a11-a5ad-b1e38e587571-kube-api-access-l7f6h\") pod \"kube-auth-proxy-76c4c4d987-258bc\" (UID: \"a4d95b91-3e89-4a11-a5ad-b1e38e587571\") " pod="openshift-ingress/kube-auth-proxy-76c4c4d987-258bc" Jul 06 17:57:43.407325 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:43.407249 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-76c4c4d987-258bc" Jul 06 17:57:43.573279 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:43.573138 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-76c4c4d987-258bc"] Jul 06 17:57:44.292561 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:57:44.292524 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4d95b91_3e89_4a11_a5ad_b1e38e587571.slice/crio-f5a7ce5e0e4e228420824f4384df6602e542b5ff81ac06acbe820fa6a9812df2 WatchSource:0}: Error finding container f5a7ce5e0e4e228420824f4384df6602e542b5ff81ac06acbe820fa6a9812df2: Status 404 returned error can't find the container with id f5a7ce5e0e4e228420824f4384df6602e542b5ff81ac06acbe820fa6a9812df2 Jul 06 17:57:44.394264 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.394223 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2"] Jul 06 17:57:44.397505 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.397477 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" Jul 06 17:57:44.401198 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.401096 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 17:57:44.401198 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.401110 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 17:57:44.401198 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.401123 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 17:57:44.401415 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.401351 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2zrwd\"" Jul 06 17:57:44.401625 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.401606 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 17:57:44.416072 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.416047 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2"] Jul 06 17:57:44.447847 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.447814 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpfnd\" (UniqueName: \"kubernetes.io/projected/d683efe8-0657-4db4-b2d8-186706025173-kube-api-access-wpfnd\") pod \"istiod-openshift-gateway-7574459656-n6nz2\" (UID: \"d683efe8-0657-4db4-b2d8-186706025173\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" Jul 06 17:57:44.448018 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.447861 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d683efe8-0657-4db4-b2d8-186706025173-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-n6nz2\" (UID: \"d683efe8-0657-4db4-b2d8-186706025173\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" Jul 06 17:57:44.448018 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.447902 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d683efe8-0657-4db4-b2d8-186706025173-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-n6nz2\" (UID: \"d683efe8-0657-4db4-b2d8-186706025173\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" Jul 06 17:57:44.448018 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.447933 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d683efe8-0657-4db4-b2d8-186706025173-istio-token\") pod \"istiod-openshift-gateway-7574459656-n6nz2\" (UID: \"d683efe8-0657-4db4-b2d8-186706025173\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" Jul 06 17:57:44.448018 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.447971 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d683efe8-0657-4db4-b2d8-186706025173-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-n6nz2\" (UID: \"d683efe8-0657-4db4-b2d8-186706025173\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" Jul 06 17:57:44.448266 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.448060 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d683efe8-0657-4db4-b2d8-186706025173-cacerts\") pod \"istiod-openshift-gateway-7574459656-n6nz2\" (UID: \"d683efe8-0657-4db4-b2d8-186706025173\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" Jul 06 17:57:44.448266 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.448152 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d683efe8-0657-4db4-b2d8-186706025173-local-certs\") pod \"istiod-openshift-gateway-7574459656-n6nz2\" (UID: \"d683efe8-0657-4db4-b2d8-186706025173\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" Jul 06 17:57:44.548888 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.548814 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d683efe8-0657-4db4-b2d8-186706025173-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-n6nz2\" (UID: \"d683efe8-0657-4db4-b2d8-186706025173\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" Jul 06 17:57:44.548888 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.548857 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d683efe8-0657-4db4-b2d8-186706025173-cacerts\") pod \"istiod-openshift-gateway-7574459656-n6nz2\" (UID: \"d683efe8-0657-4db4-b2d8-186706025173\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" Jul 06 17:57:44.549147 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.548912 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d683efe8-0657-4db4-b2d8-186706025173-local-certs\") pod \"istiod-openshift-gateway-7574459656-n6nz2\" (UID: \"d683efe8-0657-4db4-b2d8-186706025173\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" Jul 06 17:57:44.549147 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.548934 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpfnd\" (UniqueName: \"kubernetes.io/projected/d683efe8-0657-4db4-b2d8-186706025173-kube-api-access-wpfnd\") pod \"istiod-openshift-gateway-7574459656-n6nz2\" (UID: \"d683efe8-0657-4db4-b2d8-186706025173\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" Jul 06 17:57:44.549147 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.548967 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d683efe8-0657-4db4-b2d8-186706025173-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-n6nz2\" (UID: \"d683efe8-0657-4db4-b2d8-186706025173\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" Jul 06 17:57:44.549147 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.548995 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d683efe8-0657-4db4-b2d8-186706025173-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-n6nz2\" (UID: \"d683efe8-0657-4db4-b2d8-186706025173\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" Jul 06 17:57:44.549147 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.549038 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d683efe8-0657-4db4-b2d8-186706025173-istio-token\") pod \"istiod-openshift-gateway-7574459656-n6nz2\" (UID: \"d683efe8-0657-4db4-b2d8-186706025173\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" Jul 06 17:57:44.549539 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.549510 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d683efe8-0657-4db4-b2d8-186706025173-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-n6nz2\" (UID: \"d683efe8-0657-4db4-b2d8-186706025173\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" Jul 06 17:57:44.551841 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.551796 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d683efe8-0657-4db4-b2d8-186706025173-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-n6nz2\" (UID: \"d683efe8-0657-4db4-b2d8-186706025173\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" Jul 06 17:57:44.551952 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.551867 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d683efe8-0657-4db4-b2d8-186706025173-cacerts\") pod \"istiod-openshift-gateway-7574459656-n6nz2\" (UID: \"d683efe8-0657-4db4-b2d8-186706025173\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" Jul 06 17:57:44.552008 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.551979 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d683efe8-0657-4db4-b2d8-186706025173-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-n6nz2\" (UID: \"d683efe8-0657-4db4-b2d8-186706025173\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" Jul 06 17:57:44.552297 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.552276 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d683efe8-0657-4db4-b2d8-186706025173-local-certs\") pod \"istiod-openshift-gateway-7574459656-n6nz2\" (UID: \"d683efe8-0657-4db4-b2d8-186706025173\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" Jul 06 17:57:44.565542 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.565504 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d683efe8-0657-4db4-b2d8-186706025173-istio-token\") pod \"istiod-openshift-gateway-7574459656-n6nz2\" (UID: \"d683efe8-0657-4db4-b2d8-186706025173\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" Jul 06 17:57:44.565778 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.565753 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpfnd\" (UniqueName: \"kubernetes.io/projected/d683efe8-0657-4db4-b2d8-186706025173-kube-api-access-wpfnd\") pod \"istiod-openshift-gateway-7574459656-n6nz2\" (UID: \"d683efe8-0657-4db4-b2d8-186706025173\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" Jul 06 17:57:44.709298 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:44.709263 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" Jul 06 17:57:45.199289 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:45.199245 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-76c4c4d987-258bc" event={"ID":"a4d95b91-3e89-4a11-a5ad-b1e38e587571","Type":"ContainerStarted","Data":"f5a7ce5e0e4e228420824f4384df6602e542b5ff81ac06acbe820fa6a9812df2"} Jul 06 17:57:45.428647 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:45.428614 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2"] Jul 06 17:57:45.431676 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:57:45.431647 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd683efe8_0657_4db4_b2d8_186706025173.slice/crio-ac2acb98e3353ce0e787d2798f29980444255663055bc9b9c56c71b6c48fb6fb WatchSource:0}: Error finding container ac2acb98e3353ce0e787d2798f29980444255663055bc9b9c56c71b6c48fb6fb: Status 404 returned error can't find the container with id ac2acb98e3353ce0e787d2798f29980444255663055bc9b9c56c71b6c48fb6fb Jul 06 17:57:46.205195 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:46.205162 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" event={"ID":"d683efe8-0657-4db4-b2d8-186706025173","Type":"ContainerStarted","Data":"ac2acb98e3353ce0e787d2798f29980444255663055bc9b9c56c71b6c48fb6fb"} Jul 06 17:57:46.206951 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:46.206916 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-rjwcv" event={"ID":"c546bc20-63c6-4efc-b843-8d22961d31b1","Type":"ContainerStarted","Data":"94b7dedac61dbb427b2513cb6706cca5a7ee089883fe3d9c4afe901ac0e158f0"} Jul 06 17:57:46.207180 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:46.207040 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-rjwcv" Jul 06 17:57:46.208634 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:46.208614 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-hkkq8" event={"ID":"b83bc448-de88-4275-9138-c9ba7ccaa92f","Type":"ContainerStarted","Data":"09f0f0423211db05c33c5103b4c7c20b7700064af940f46879009e911facfd90"} Jul 06 17:57:46.208763 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:46.208749 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-hkkq8" Jul 06 17:57:46.237264 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:46.237222 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-rjwcv" podStartSLOduration=3.038835213 podStartE2EDuration="6.237206388s" totalImagesPullingTime="3.198371175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:57:46.234898103 +0000 UTC m=+386.919505074" watchObservedRunningTime="2026-07-06 17:57:46.237206388 +0000 UTC m=+386.921813559" Jul 06 17:57:46.260509 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:46.260459 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-hkkq8" podStartSLOduration=2.219637209 podStartE2EDuration="5.260442566s" totalImagesPullingTime="3.040805357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:57:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:57:46.258148739 +0000 UTC m=+386.942755727" watchObservedRunningTime="2026-07-06 17:57:46.260442566 +0000 UTC m=+386.945049539" Jul 06 17:57:48.217886 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:48.217851 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-76c4c4d987-258bc" event={"ID":"a4d95b91-3e89-4a11-a5ad-b1e38e587571","Type":"ContainerStarted","Data":"346449c006df23328e1757e178c86ffc8f25c2c2dc847ff88a6042517f64427f"} Jul 06 17:57:48.249489 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:48.249394 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-76c4c4d987-258bc" podStartSLOduration=2.347575176 podStartE2EDuration="5.249372237s" totalImagesPullingTime="2.901797061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:57:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:57:48.248697514 +0000 UTC m=+388.933304484" watchObservedRunningTime="2026-07-06 17:57:48.249372237 +0000 UTC m=+388.933979209" Jul 06 17:57:51.513329 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:51.513299 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dn4dc"] Jul 06 17:57:51.515278 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:51.515263 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dn4dc" Jul 06 17:57:51.521959 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:51.521938 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 06 17:57:51.522230 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:51.522217 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-n2tv9\"" Jul 06 17:57:51.554633 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:51.554570 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-r4d29"] Jul 06 17:57:51.556858 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:51.556835 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dn4dc"] Jul 06 17:57:51.556993 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:51.556946 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4d29" Jul 06 17:57:51.560637 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:51.560614 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-k8w6x\"" Jul 06 17:57:51.561194 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:51.561177 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 06 17:57:51.583465 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:51.583442 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-r4d29"] Jul 06 17:57:51.606729 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:51.606706 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvgph\" (UniqueName: \"kubernetes.io/projected/4688d0ca-54e5-4e27-91fc-9891b4b7bf5e-kube-api-access-pvgph\") pod \"kserve-controller-manager-d6f4b65b8-dn4dc\" (UID: \"4688d0ca-54e5-4e27-91fc-9891b4b7bf5e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dn4dc" Jul 06 17:57:51.606821 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:51.606754 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwrfr\" (UniqueName: \"kubernetes.io/projected/bd638276-e86c-4a4c-906d-da266f83f4f8-kube-api-access-zwrfr\") pod \"llmisvc-controller-manager-777c6bd7d5-r4d29\" (UID: \"bd638276-e86c-4a4c-906d-da266f83f4f8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4d29" Jul 06 17:57:51.606821 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:51.606773 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4688d0ca-54e5-4e27-91fc-9891b4b7bf5e-cert\") pod \"kserve-controller-manager-d6f4b65b8-dn4dc\" (UID: \"4688d0ca-54e5-4e27-91fc-9891b4b7bf5e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dn4dc" Jul 06 17:57:51.606888 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:51.606837 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd638276-e86c-4a4c-906d-da266f83f4f8-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-r4d29\" (UID: \"bd638276-e86c-4a4c-906d-da266f83f4f8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4d29" Jul 06 17:57:51.707933 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:51.707901 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvgph\" (UniqueName: \"kubernetes.io/projected/4688d0ca-54e5-4e27-91fc-9891b4b7bf5e-kube-api-access-pvgph\") pod \"kserve-controller-manager-d6f4b65b8-dn4dc\" (UID: \"4688d0ca-54e5-4e27-91fc-9891b4b7bf5e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dn4dc" Jul 06 17:57:51.708116 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:51.707954 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwrfr\" (UniqueName: \"kubernetes.io/projected/bd638276-e86c-4a4c-906d-da266f83f4f8-kube-api-access-zwrfr\") pod \"llmisvc-controller-manager-777c6bd7d5-r4d29\" (UID: \"bd638276-e86c-4a4c-906d-da266f83f4f8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4d29" Jul 06 17:57:51.708116 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:51.707979 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4688d0ca-54e5-4e27-91fc-9891b4b7bf5e-cert\") pod \"kserve-controller-manager-d6f4b65b8-dn4dc\" (UID: \"4688d0ca-54e5-4e27-91fc-9891b4b7bf5e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dn4dc" Jul 06 17:57:51.708116 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:51.708016 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd638276-e86c-4a4c-906d-da266f83f4f8-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-r4d29\" (UID: \"bd638276-e86c-4a4c-906d-da266f83f4f8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4d29" Jul 06 17:57:51.710378 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:51.710350 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4688d0ca-54e5-4e27-91fc-9891b4b7bf5e-cert\") pod \"kserve-controller-manager-d6f4b65b8-dn4dc\" (UID: \"4688d0ca-54e5-4e27-91fc-9891b4b7bf5e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dn4dc" Jul 06 17:57:51.710502 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:51.710482 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd638276-e86c-4a4c-906d-da266f83f4f8-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-r4d29\" (UID: \"bd638276-e86c-4a4c-906d-da266f83f4f8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4d29" Jul 06 17:57:51.720856 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:51.720834 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwrfr\" (UniqueName: \"kubernetes.io/projected/bd638276-e86c-4a4c-906d-da266f83f4f8-kube-api-access-zwrfr\") pod \"llmisvc-controller-manager-777c6bd7d5-r4d29\" (UID: \"bd638276-e86c-4a4c-906d-da266f83f4f8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4d29" Jul 06 17:57:51.723685 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:51.723656 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvgph\" (UniqueName: \"kubernetes.io/projected/4688d0ca-54e5-4e27-91fc-9891b4b7bf5e-kube-api-access-pvgph\") pod \"kserve-controller-manager-d6f4b65b8-dn4dc\" (UID: \"4688d0ca-54e5-4e27-91fc-9891b4b7bf5e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dn4dc" Jul 06 17:57:51.824835 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:51.824758 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dn4dc" Jul 06 17:57:51.866395 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:51.866362 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4d29" Jul 06 17:57:52.000565 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:52.000530 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dn4dc"] Jul 06 17:57:52.011579 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:57:52.011555 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4688d0ca_54e5_4e27_91fc_9891b4b7bf5e.slice/crio-217176c8837478c46fe75ecbca0a80b0882a61b659dcf06728ff0f108b80f055 WatchSource:0}: Error finding container 217176c8837478c46fe75ecbca0a80b0882a61b659dcf06728ff0f108b80f055: Status 404 returned error can't find the container with id 217176c8837478c46fe75ecbca0a80b0882a61b659dcf06728ff0f108b80f055 Jul 06 17:57:52.022954 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:52.022930 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-r4d29"] Jul 06 17:57:52.024416 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:57:52.024391 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbd638276_e86c_4a4c_906d_da266f83f4f8.slice/crio-9468dca717a4bf6b9f213eab581dd97e47d179b6f89b703b24bf3449fdee5d8b WatchSource:0}: Error finding container 9468dca717a4bf6b9f213eab581dd97e47d179b6f89b703b24bf3449fdee5d8b: Status 404 returned error can't find the container with id 9468dca717a4bf6b9f213eab581dd97e47d179b6f89b703b24bf3449fdee5d8b Jul 06 17:57:52.236979 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:52.236947 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4d29" event={"ID":"bd638276-e86c-4a4c-906d-da266f83f4f8","Type":"ContainerStarted","Data":"9468dca717a4bf6b9f213eab581dd97e47d179b6f89b703b24bf3449fdee5d8b"} Jul 06 17:57:52.238070 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:52.238046 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dn4dc" event={"ID":"4688d0ca-54e5-4e27-91fc-9891b4b7bf5e","Type":"ContainerStarted","Data":"217176c8837478c46fe75ecbca0a80b0882a61b659dcf06728ff0f108b80f055"} Jul 06 17:57:54.719382 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.719348 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m"] Jul 06 17:57:54.792265 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.792234 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m"] Jul 06 17:57:54.792399 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.792353 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:57:54.796834 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.796810 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-8ld8r\"" Jul 06 17:57:54.836207 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.836176 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e621372-e4af-48df-aaa6-f6551ca138b5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-568d56697dx666m\" (UID: \"2e621372-e4af-48df-aaa6-f6551ca138b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:57:54.836320 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.836221 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e621372-e4af-48df-aaa6-f6551ca138b5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-568d56697dx666m\" (UID: \"2e621372-e4af-48df-aaa6-f6551ca138b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:57:54.836320 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.836252 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e621372-e4af-48df-aaa6-f6551ca138b5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-568d56697dx666m\" (UID: \"2e621372-e4af-48df-aaa6-f6551ca138b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:57:54.836320 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.836288 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e621372-e4af-48df-aaa6-f6551ca138b5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-568d56697dx666m\" (UID: \"2e621372-e4af-48df-aaa6-f6551ca138b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:57:54.836438 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.836322 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfbps\" (UniqueName: \"kubernetes.io/projected/2e621372-e4af-48df-aaa6-f6551ca138b5-kube-api-access-kfbps\") pod \"data-science-gateway-data-science-gateway-class-568d56697dx666m\" (UID: \"2e621372-e4af-48df-aaa6-f6551ca138b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:57:54.836438 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.836348 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e621372-e4af-48df-aaa6-f6551ca138b5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-568d56697dx666m\" (UID: \"2e621372-e4af-48df-aaa6-f6551ca138b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:57:54.836530 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.836436 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e621372-e4af-48df-aaa6-f6551ca138b5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-568d56697dx666m\" (UID: \"2e621372-e4af-48df-aaa6-f6551ca138b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:57:54.836530 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.836474 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e621372-e4af-48df-aaa6-f6551ca138b5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-568d56697dx666m\" (UID: \"2e621372-e4af-48df-aaa6-f6551ca138b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:57:54.836530 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.836512 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e621372-e4af-48df-aaa6-f6551ca138b5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-568d56697dx666m\" (UID: \"2e621372-e4af-48df-aaa6-f6551ca138b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:57:54.937562 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.937522 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e621372-e4af-48df-aaa6-f6551ca138b5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-568d56697dx666m\" (UID: \"2e621372-e4af-48df-aaa6-f6551ca138b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:57:54.937744 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.937572 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e621372-e4af-48df-aaa6-f6551ca138b5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-568d56697dx666m\" (UID: \"2e621372-e4af-48df-aaa6-f6551ca138b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:57:54.937744 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.937615 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e621372-e4af-48df-aaa6-f6551ca138b5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-568d56697dx666m\" (UID: \"2e621372-e4af-48df-aaa6-f6551ca138b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:57:54.937744 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.937659 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e621372-e4af-48df-aaa6-f6551ca138b5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-568d56697dx666m\" (UID: \"2e621372-e4af-48df-aaa6-f6551ca138b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:57:54.937744 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.937689 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e621372-e4af-48df-aaa6-f6551ca138b5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-568d56697dx666m\" (UID: \"2e621372-e4af-48df-aaa6-f6551ca138b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:57:54.937744 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.937715 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e621372-e4af-48df-aaa6-f6551ca138b5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-568d56697dx666m\" (UID: \"2e621372-e4af-48df-aaa6-f6551ca138b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:57:54.937986 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.937748 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e621372-e4af-48df-aaa6-f6551ca138b5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-568d56697dx666m\" (UID: \"2e621372-e4af-48df-aaa6-f6551ca138b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:57:54.937986 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.937783 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfbps\" (UniqueName: \"kubernetes.io/projected/2e621372-e4af-48df-aaa6-f6551ca138b5-kube-api-access-kfbps\") pod \"data-science-gateway-data-science-gateway-class-568d56697dx666m\" (UID: \"2e621372-e4af-48df-aaa6-f6551ca138b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:57:54.937986 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.937811 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e621372-e4af-48df-aaa6-f6551ca138b5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-568d56697dx666m\" (UID: \"2e621372-e4af-48df-aaa6-f6551ca138b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:57:54.938253 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.938225 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e621372-e4af-48df-aaa6-f6551ca138b5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-568d56697dx666m\" (UID: \"2e621372-e4af-48df-aaa6-f6551ca138b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:57:54.938521 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.938435 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e621372-e4af-48df-aaa6-f6551ca138b5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-568d56697dx666m\" (UID: \"2e621372-e4af-48df-aaa6-f6551ca138b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:57:54.938521 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.938466 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e621372-e4af-48df-aaa6-f6551ca138b5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-568d56697dx666m\" (UID: \"2e621372-e4af-48df-aaa6-f6551ca138b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:57:54.938521 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.938437 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e621372-e4af-48df-aaa6-f6551ca138b5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-568d56697dx666m\" (UID: \"2e621372-e4af-48df-aaa6-f6551ca138b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:57:54.938521 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.938444 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e621372-e4af-48df-aaa6-f6551ca138b5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-568d56697dx666m\" (UID: \"2e621372-e4af-48df-aaa6-f6551ca138b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:57:54.940475 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.940446 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e621372-e4af-48df-aaa6-f6551ca138b5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-568d56697dx666m\" (UID: \"2e621372-e4af-48df-aaa6-f6551ca138b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:57:54.940887 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.940863 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e621372-e4af-48df-aaa6-f6551ca138b5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-568d56697dx666m\" (UID: \"2e621372-e4af-48df-aaa6-f6551ca138b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:57:54.949769 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.949748 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfbps\" (UniqueName: \"kubernetes.io/projected/2e621372-e4af-48df-aaa6-f6551ca138b5-kube-api-access-kfbps\") pod \"data-science-gateway-data-science-gateway-class-568d56697dx666m\" (UID: \"2e621372-e4af-48df-aaa6-f6551ca138b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:57:54.951237 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:54.951217 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e621372-e4af-48df-aaa6-f6551ca138b5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-568d56697dx666m\" (UID: \"2e621372-e4af-48df-aaa6-f6551ca138b5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:57:55.103144 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:55.103058 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:57:55.756554 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:55.756512 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2"] Jul 06 17:57:56.130758 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:56.130723 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m"] Jul 06 17:57:56.255712 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:56.255679 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" event={"ID":"2e621372-e4af-48df-aaa6-f6551ca138b5","Type":"ContainerStarted","Data":"3c7c875e261cc29ae5f52d51efbcb1650a8add465a627e6c9fe1615c790cfb2b"} Jul 06 17:57:56.257013 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:56.256994 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4d29" event={"ID":"bd638276-e86c-4a4c-906d-da266f83f4f8","Type":"ContainerStarted","Data":"5447320260e33f5eed4848c4949b1a8a1fd8553ed545414065bbb41042f1b9cc"} Jul 06 17:57:56.257191 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:56.257167 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4d29" Jul 06 17:57:56.258513 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:56.258450 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dn4dc" event={"ID":"4688d0ca-54e5-4e27-91fc-9891b4b7bf5e","Type":"ContainerStarted","Data":"4bb5c6015636f7d51d96765475fc3d27fac6301ee03fa05d6404df08e1205de3"} Jul 06 17:57:56.258513 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:56.258502 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dn4dc" Jul 06 17:57:56.277344 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:56.277300 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4d29" podStartSLOduration=1.302384282 podStartE2EDuration="5.277285327s" totalImagesPullingTime="3.974901045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:57:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:57:56.277090753 +0000 UTC m=+396.961697726" watchObservedRunningTime="2026-07-06 17:57:56.277285327 +0000 UTC m=+396.961892300" Jul 06 17:57:56.299903 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:56.299854 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dn4dc" podStartSLOduration=1.30865775 podStartE2EDuration="5.299837858s" totalImagesPullingTime="3.991180108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:57:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:57:56.298921928 +0000 UTC m=+396.983528900" watchObservedRunningTime="2026-07-06 17:57:56.299837858 +0000 UTC m=+396.984444844" Jul 06 17:57:57.214869 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:57.214839 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-rjwcv" Jul 06 17:57:57.217458 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:57.217436 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-hkkq8" Jul 06 17:57:59.996869 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:59.996832 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 17:57:59.997197 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:57:59.996897 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 17:58:00.000974 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.000947 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 17:58:00.001059 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.001006 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 17:58:00.001059 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.001054 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 17:58:00.282866 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.282829 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" event={"ID":"d683efe8-0657-4db4-b2d8-186706025173","Type":"ContainerStarted","Data":"1a54d7b1424f248c72a50098250ce4b4d136b8c2696a4f2efb2bc941700e18a3"} Jul 06 17:58:00.283076 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.282892 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" podUID="d683efe8-0657-4db4-b2d8-186706025173" containerName="discovery" containerID="cri-o://1a54d7b1424f248c72a50098250ce4b4d136b8c2696a4f2efb2bc941700e18a3" gracePeriod=30 Jul 06 17:58:00.283076 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.282905 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" Jul 06 17:58:00.284492 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.284471 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" event={"ID":"2e621372-e4af-48df-aaa6-f6551ca138b5","Type":"ContainerStarted","Data":"bb751f325c458b135b5fc18cc6cb4d0129782a9d3128abcd274e1c0bc1a0363f"} Jul 06 17:58:00.327321 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.327270 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" podStartSLOduration=2.464646304 podStartE2EDuration="6.327253303s" totalImagesPullingTime="3.862606999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:57:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:58:00.326351022 +0000 UTC m=+401.010957993" watchObservedRunningTime="2026-07-06 17:58:00.327253303 +0000 UTC m=+401.011860275" Jul 06 17:58:00.327990 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.327960 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" podStartSLOduration=1.765257751 podStartE2EDuration="16.327950662s" totalImagesPullingTime="14.562692911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:57:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:58:00.306471158 +0000 UTC m=+400.991078128" watchObservedRunningTime="2026-07-06 17:58:00.327950662 +0000 UTC m=+401.012557633" Jul 06 17:58:00.527123 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.527099 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" Jul 06 17:58:00.584822 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.584745 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d683efe8-0657-4db4-b2d8-186706025173-local-certs\") pod \"d683efe8-0657-4db4-b2d8-186706025173\" (UID: \"d683efe8-0657-4db4-b2d8-186706025173\") " Jul 06 17:58:00.584822 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.584792 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d683efe8-0657-4db4-b2d8-186706025173-istio-csr-ca-configmap\") pod \"d683efe8-0657-4db4-b2d8-186706025173\" (UID: \"d683efe8-0657-4db4-b2d8-186706025173\") " Jul 06 17:58:00.584822 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.584818 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d683efe8-0657-4db4-b2d8-186706025173-istio-kubeconfig\") pod \"d683efe8-0657-4db4-b2d8-186706025173\" (UID: \"d683efe8-0657-4db4-b2d8-186706025173\") " Jul 06 17:58:00.585113 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.584893 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpfnd\" (UniqueName: \"kubernetes.io/projected/d683efe8-0657-4db4-b2d8-186706025173-kube-api-access-wpfnd\") pod \"d683efe8-0657-4db4-b2d8-186706025173\" (UID: \"d683efe8-0657-4db4-b2d8-186706025173\") " Jul 06 17:58:00.585113 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.584920 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d683efe8-0657-4db4-b2d8-186706025173-istio-token\") pod \"d683efe8-0657-4db4-b2d8-186706025173\" (UID: \"d683efe8-0657-4db4-b2d8-186706025173\") " Jul 06 17:58:00.585113 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.584961 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d683efe8-0657-4db4-b2d8-186706025173-cacerts\") pod \"d683efe8-0657-4db4-b2d8-186706025173\" (UID: \"d683efe8-0657-4db4-b2d8-186706025173\") " Jul 06 17:58:00.585113 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.584994 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d683efe8-0657-4db4-b2d8-186706025173-istio-csr-dns-cert\") pod \"d683efe8-0657-4db4-b2d8-186706025173\" (UID: \"d683efe8-0657-4db4-b2d8-186706025173\") " Jul 06 17:58:00.585304 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.585167 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d683efe8-0657-4db4-b2d8-186706025173-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "d683efe8-0657-4db4-b2d8-186706025173" (UID: "d683efe8-0657-4db4-b2d8-186706025173"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:58:00.585304 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.585264 2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d683efe8-0657-4db4-b2d8-186706025173-istio-csr-ca-configmap\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 17:58:00.587174 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.587077 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d683efe8-0657-4db4-b2d8-186706025173-local-certs" (OuterVolumeSpecName: "local-certs") pod "d683efe8-0657-4db4-b2d8-186706025173" (UID: "d683efe8-0657-4db4-b2d8-186706025173"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:58:00.587174 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.587149 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d683efe8-0657-4db4-b2d8-186706025173-kube-api-access-wpfnd" (OuterVolumeSpecName: "kube-api-access-wpfnd") pod "d683efe8-0657-4db4-b2d8-186706025173" (UID: "d683efe8-0657-4db4-b2d8-186706025173"). InnerVolumeSpecName "kube-api-access-wpfnd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:58:00.587336 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.587322 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d683efe8-0657-4db4-b2d8-186706025173-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "d683efe8-0657-4db4-b2d8-186706025173" (UID: "d683efe8-0657-4db4-b2d8-186706025173"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:58:00.587391 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.587340 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d683efe8-0657-4db4-b2d8-186706025173-istio-token" (OuterVolumeSpecName: "istio-token") pod "d683efe8-0657-4db4-b2d8-186706025173" (UID: "d683efe8-0657-4db4-b2d8-186706025173"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:58:00.587391 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.587342 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d683efe8-0657-4db4-b2d8-186706025173-cacerts" (OuterVolumeSpecName: "cacerts") pod "d683efe8-0657-4db4-b2d8-186706025173" (UID: "d683efe8-0657-4db4-b2d8-186706025173"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:58:00.587391 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.587361 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d683efe8-0657-4db4-b2d8-186706025173-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "d683efe8-0657-4db4-b2d8-186706025173" (UID: "d683efe8-0657-4db4-b2d8-186706025173"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:58:00.686381 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.686346 2578 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d683efe8-0657-4db4-b2d8-186706025173-istio-kubeconfig\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 17:58:00.686381 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.686376 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpfnd\" (UniqueName: \"kubernetes.io/projected/d683efe8-0657-4db4-b2d8-186706025173-kube-api-access-wpfnd\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 17:58:00.686381 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.686389 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d683efe8-0657-4db4-b2d8-186706025173-istio-token\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 17:58:00.686598 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.686400 2578 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d683efe8-0657-4db4-b2d8-186706025173-cacerts\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 17:58:00.686598 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.686411 2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d683efe8-0657-4db4-b2d8-186706025173-istio-csr-dns-cert\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 17:58:00.686598 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:00.686420 2578 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d683efe8-0657-4db4-b2d8-186706025173-local-certs\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 17:58:01.103554 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:01.103515 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:58:01.108234 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:01.108214 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:58:01.290178 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:01.290100 2578 generic.go:356] "Generic (PLEG): container finished" podID="d683efe8-0657-4db4-b2d8-186706025173" containerID="1a54d7b1424f248c72a50098250ce4b4d136b8c2696a4f2efb2bc941700e18a3" exitCode=2 Jul 06 17:58:01.290178 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:01.290157 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" Jul 06 17:58:01.290339 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:01.290187 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" event={"ID":"d683efe8-0657-4db4-b2d8-186706025173","Type":"ContainerDied","Data":"1a54d7b1424f248c72a50098250ce4b4d136b8c2696a4f2efb2bc941700e18a3"} Jul 06 17:58:01.290339 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:01.290254 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2" event={"ID":"d683efe8-0657-4db4-b2d8-186706025173","Type":"ContainerDied","Data":"ac2acb98e3353ce0e787d2798f29980444255663055bc9b9c56c71b6c48fb6fb"} Jul 06 17:58:01.290339 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:01.290273 2578 scope.go:117] "RemoveContainer" containerID="1a54d7b1424f248c72a50098250ce4b4d136b8c2696a4f2efb2bc941700e18a3" Jul 06 17:58:01.290508 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:01.290489 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:58:01.291592 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:01.291374 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-568d56697dx666m" Jul 06 17:58:01.298128 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:01.298111 2578 scope.go:117] "RemoveContainer" containerID="1a54d7b1424f248c72a50098250ce4b4d136b8c2696a4f2efb2bc941700e18a3" Jul 06 17:58:01.298387 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:58:01.298369 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a54d7b1424f248c72a50098250ce4b4d136b8c2696a4f2efb2bc941700e18a3\": container with ID starting with 1a54d7b1424f248c72a50098250ce4b4d136b8c2696a4f2efb2bc941700e18a3 not found: ID does not exist" containerID="1a54d7b1424f248c72a50098250ce4b4d136b8c2696a4f2efb2bc941700e18a3" Jul 06 17:58:01.298429 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:01.298394 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a54d7b1424f248c72a50098250ce4b4d136b8c2696a4f2efb2bc941700e18a3"} err="failed to get container status \"1a54d7b1424f248c72a50098250ce4b4d136b8c2696a4f2efb2bc941700e18a3\": rpc error: code = NotFound desc = could not find container \"1a54d7b1424f248c72a50098250ce4b4d136b8c2696a4f2efb2bc941700e18a3\": container with ID starting with 1a54d7b1424f248c72a50098250ce4b4d136b8c2696a4f2efb2bc941700e18a3 not found: ID does not exist" Jul 06 17:58:01.308321 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:01.308301 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2"] Jul 06 17:58:01.313292 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:01.313264 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-n6nz2"] Jul 06 17:58:02.934965 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:02.934927 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d683efe8-0657-4db4-b2d8-186706025173" path="/var/lib/kubelet/pods/d683efe8-0657-4db4-b2d8-186706025173/volumes" Jul 06 17:58:27.268174 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:27.268142 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r4d29" Jul 06 17:58:27.271121 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:27.271101 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dn4dc" Jul 06 17:58:41.093703 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:41.093671 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dqf7s"] Jul 06 17:58:41.094198 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:41.093973 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d683efe8-0657-4db4-b2d8-186706025173" containerName="discovery" Jul 06 17:58:41.094198 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:41.093986 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d683efe8-0657-4db4-b2d8-186706025173" containerName="discovery" Jul 06 17:58:41.094198 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:41.094051 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d683efe8-0657-4db4-b2d8-186706025173" containerName="discovery" Jul 06 17:58:41.102168 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:41.102146 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dqf7s" Jul 06 17:58:41.104465 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:41.104441 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-h24md\"" Jul 06 17:58:41.105258 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:41.105236 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 17:58:41.105348 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:41.105293 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 17:58:41.110354 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:41.110075 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dqf7s"] Jul 06 17:58:41.113867 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:41.113841 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md7ft\" (UniqueName: \"kubernetes.io/projected/f449c481-5883-49d4-bafa-eabce4aa4d0a-kube-api-access-md7ft\") pod \"kuadrant-operator-catalog-dqf7s\" (UID: \"f449c481-5883-49d4-bafa-eabce4aa4d0a\") " pod="kuadrant-system/kuadrant-operator-catalog-dqf7s" Jul 06 17:58:41.214536 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:41.214500 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md7ft\" (UniqueName: \"kubernetes.io/projected/f449c481-5883-49d4-bafa-eabce4aa4d0a-kube-api-access-md7ft\") pod \"kuadrant-operator-catalog-dqf7s\" (UID: \"f449c481-5883-49d4-bafa-eabce4aa4d0a\") " pod="kuadrant-system/kuadrant-operator-catalog-dqf7s" Jul 06 17:58:41.223247 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:41.223222 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-md7ft\" (UniqueName: \"kubernetes.io/projected/f449c481-5883-49d4-bafa-eabce4aa4d0a-kube-api-access-md7ft\") pod \"kuadrant-operator-catalog-dqf7s\" (UID: \"f449c481-5883-49d4-bafa-eabce4aa4d0a\") " pod="kuadrant-system/kuadrant-operator-catalog-dqf7s" Jul 06 17:58:41.373401 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:41.373323 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dqf7s"] Jul 06 17:58:41.373580 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:41.373568 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dqf7s" Jul 06 17:58:41.505790 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:41.505759 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dqf7s"] Jul 06 17:58:41.509046 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:58:41.509002 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf449c481_5883_49d4_bafa_eabce4aa4d0a.slice/crio-8b0c09b76627035cb351c18fef2bd996a39faecb247b2613fc2511353a3fb27e WatchSource:0}: Error finding container 8b0c09b76627035cb351c18fef2bd996a39faecb247b2613fc2511353a3fb27e: Status 404 returned error can't find the container with id 8b0c09b76627035cb351c18fef2bd996a39faecb247b2613fc2511353a3fb27e Jul 06 17:58:41.587830 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:41.587799 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sf8kc"] Jul 06 17:58:41.590433 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:41.590416 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sf8kc" Jul 06 17:58:41.601039 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:41.600990 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sf8kc"] Jul 06 17:58:41.617329 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:41.617301 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27sz2\" (UniqueName: \"kubernetes.io/projected/faf3b953-f640-4da3-b3d4-ab0683be26b2-kube-api-access-27sz2\") pod \"kuadrant-operator-catalog-sf8kc\" (UID: \"faf3b953-f640-4da3-b3d4-ab0683be26b2\") " pod="kuadrant-system/kuadrant-operator-catalog-sf8kc" Jul 06 17:58:41.718072 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:41.718008 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27sz2\" (UniqueName: \"kubernetes.io/projected/faf3b953-f640-4da3-b3d4-ab0683be26b2-kube-api-access-27sz2\") pod \"kuadrant-operator-catalog-sf8kc\" (UID: \"faf3b953-f640-4da3-b3d4-ab0683be26b2\") " pod="kuadrant-system/kuadrant-operator-catalog-sf8kc" Jul 06 17:58:41.731615 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:41.731586 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27sz2\" (UniqueName: \"kubernetes.io/projected/faf3b953-f640-4da3-b3d4-ab0683be26b2-kube-api-access-27sz2\") pod \"kuadrant-operator-catalog-sf8kc\" (UID: \"faf3b953-f640-4da3-b3d4-ab0683be26b2\") " pod="kuadrant-system/kuadrant-operator-catalog-sf8kc" Jul 06 17:58:41.905544 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:41.905511 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sf8kc" Jul 06 17:58:42.044328 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:42.044296 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sf8kc"] Jul 06 17:58:42.052230 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:58:42.052168 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaf3b953_f640_4da3_b3d4_ab0683be26b2.slice/crio-303c7f878d0db30ed335c9b2b339f30ee791d0611903b1cde4e13f267f1531fe WatchSource:0}: Error finding container 303c7f878d0db30ed335c9b2b339f30ee791d0611903b1cde4e13f267f1531fe: Status 404 returned error can't find the container with id 303c7f878d0db30ed335c9b2b339f30ee791d0611903b1cde4e13f267f1531fe Jul 06 17:58:42.451904 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:42.451859 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dqf7s" event={"ID":"f449c481-5883-49d4-bafa-eabce4aa4d0a","Type":"ContainerStarted","Data":"8b0c09b76627035cb351c18fef2bd996a39faecb247b2613fc2511353a3fb27e"} Jul 06 17:58:42.453323 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:42.453295 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sf8kc" event={"ID":"faf3b953-f640-4da3-b3d4-ab0683be26b2","Type":"ContainerStarted","Data":"303c7f878d0db30ed335c9b2b339f30ee791d0611903b1cde4e13f267f1531fe"} Jul 06 17:58:44.463172 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:44.463130 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dqf7s" event={"ID":"f449c481-5883-49d4-bafa-eabce4aa4d0a","Type":"ContainerStarted","Data":"cc2673fd513d833dd75f03c50cd8e6fbbd83bd4dd59df0d340f11deb4f0a50a8"} Jul 06 17:58:44.463172 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:44.463155 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-dqf7s" podUID="f449c481-5883-49d4-bafa-eabce4aa4d0a" containerName="registry-server" containerID="cri-o://cc2673fd513d833dd75f03c50cd8e6fbbd83bd4dd59df0d340f11deb4f0a50a8" gracePeriod=2 Jul 06 17:58:44.464682 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:44.464659 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sf8kc" event={"ID":"faf3b953-f640-4da3-b3d4-ab0683be26b2","Type":"ContainerStarted","Data":"6fe3528667e5cec7bd0c178bd2b3699027fe36bb664f1090fd307da4388193fc"} Jul 06 17:58:44.481236 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:44.481191 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-dqf7s" podStartSLOduration=1.5292567529999999 podStartE2EDuration="3.481176075s" totalImagesPullingTime="1.951919322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:58:44.48075381 +0000 UTC m=+445.165360807" watchObservedRunningTime="2026-07-06 17:58:44.481176075 +0000 UTC m=+445.165783047" Jul 06 17:58:44.706467 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:44.706445 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dqf7s" Jul 06 17:58:44.725721 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:44.725623 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-sf8kc" podStartSLOduration=2.308637194 podStartE2EDuration="3.725607648s" totalImagesPullingTime="1.416970454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:58:44.498837013 +0000 UTC m=+445.183443986" watchObservedRunningTime="2026-07-06 17:58:44.725607648 +0000 UTC m=+445.410214621" Jul 06 17:58:44.746622 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:44.746595 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-md7ft\" (UniqueName: \"kubernetes.io/projected/f449c481-5883-49d4-bafa-eabce4aa4d0a-kube-api-access-md7ft\") pod \"f449c481-5883-49d4-bafa-eabce4aa4d0a\" (UID: \"f449c481-5883-49d4-bafa-eabce4aa4d0a\") " Jul 06 17:58:44.748785 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:44.748756 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f449c481-5883-49d4-bafa-eabce4aa4d0a-kube-api-access-md7ft" (OuterVolumeSpecName: "kube-api-access-md7ft") pod "f449c481-5883-49d4-bafa-eabce4aa4d0a" (UID: "f449c481-5883-49d4-bafa-eabce4aa4d0a"). InnerVolumeSpecName "kube-api-access-md7ft". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:58:44.859967 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:44.859925 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-md7ft\" (UniqueName: \"kubernetes.io/projected/f449c481-5883-49d4-bafa-eabce4aa4d0a-kube-api-access-md7ft\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 17:58:45.469991 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:45.469955 2578 generic.go:356] "Generic (PLEG): container finished" podID="f449c481-5883-49d4-bafa-eabce4aa4d0a" containerID="cc2673fd513d833dd75f03c50cd8e6fbbd83bd4dd59df0d340f11deb4f0a50a8" exitCode=0 Jul 06 17:58:45.470397 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:45.469998 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dqf7s" Jul 06 17:58:45.470397 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:45.470055 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dqf7s" event={"ID":"f449c481-5883-49d4-bafa-eabce4aa4d0a","Type":"ContainerDied","Data":"cc2673fd513d833dd75f03c50cd8e6fbbd83bd4dd59df0d340f11deb4f0a50a8"} Jul 06 17:58:45.470397 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:45.470098 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dqf7s" event={"ID":"f449c481-5883-49d4-bafa-eabce4aa4d0a","Type":"ContainerDied","Data":"8b0c09b76627035cb351c18fef2bd996a39faecb247b2613fc2511353a3fb27e"} Jul 06 17:58:45.470397 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:45.470117 2578 scope.go:117] "RemoveContainer" containerID="cc2673fd513d833dd75f03c50cd8e6fbbd83bd4dd59df0d340f11deb4f0a50a8" Jul 06 17:58:45.478304 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:45.478286 2578 scope.go:117] "RemoveContainer" containerID="cc2673fd513d833dd75f03c50cd8e6fbbd83bd4dd59df0d340f11deb4f0a50a8" Jul 06 17:58:45.478551 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:58:45.478529 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc2673fd513d833dd75f03c50cd8e6fbbd83bd4dd59df0d340f11deb4f0a50a8\": container with ID starting with cc2673fd513d833dd75f03c50cd8e6fbbd83bd4dd59df0d340f11deb4f0a50a8 not found: ID does not exist" containerID="cc2673fd513d833dd75f03c50cd8e6fbbd83bd4dd59df0d340f11deb4f0a50a8" Jul 06 17:58:45.478640 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:45.478559 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc2673fd513d833dd75f03c50cd8e6fbbd83bd4dd59df0d340f11deb4f0a50a8"} err="failed to get container status \"cc2673fd513d833dd75f03c50cd8e6fbbd83bd4dd59df0d340f11deb4f0a50a8\": rpc error: code = NotFound desc = could not find container \"cc2673fd513d833dd75f03c50cd8e6fbbd83bd4dd59df0d340f11deb4f0a50a8\": container with ID starting with cc2673fd513d833dd75f03c50cd8e6fbbd83bd4dd59df0d340f11deb4f0a50a8 not found: ID does not exist" Jul 06 17:58:45.488829 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:45.488809 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dqf7s"] Jul 06 17:58:45.492733 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:45.492714 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dqf7s"] Jul 06 17:58:46.938960 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:46.938925 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f449c481-5883-49d4-bafa-eabce4aa4d0a" path="/var/lib/kubelet/pods/f449c481-5883-49d4-bafa-eabce4aa4d0a/volumes" Jul 06 17:58:51.905926 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:51.905890 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-sf8kc" Jul 06 17:58:51.906417 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:51.906071 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-sf8kc" Jul 06 17:58:51.928402 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:51.928377 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-sf8kc" Jul 06 17:58:52.518180 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:58:52.518156 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-sf8kc" Jul 06 17:59:00.802847 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.802818 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d85f469d5-2295j"] Jul 06 17:59:00.803263 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.803172 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f449c481-5883-49d4-bafa-eabce4aa4d0a" containerName="registry-server" Jul 06 17:59:00.803263 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.803199 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f449c481-5883-49d4-bafa-eabce4aa4d0a" containerName="registry-server" Jul 06 17:59:00.803263 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.803256 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f449c481-5883-49d4-bafa-eabce4aa4d0a" containerName="registry-server" Jul 06 17:59:00.805710 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.805692 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d85f469d5-2295j" Jul 06 17:59:00.815643 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.815623 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 17:59:00.816203 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.816189 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 17:59:00.816270 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.816211 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 17:59:00.816652 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.816631 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nsjbk\"" Jul 06 17:59:00.816748 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.816728 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 17:59:00.816748 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.816730 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 17:59:00.816877 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.816732 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 17:59:00.817116 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.817103 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 17:59:00.826469 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.826451 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 17:59:00.829638 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.829618 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d85f469d5-2295j"] Jul 06 17:59:00.884114 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.884085 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04da93e0-5f90-4199-992e-205353a4aad7-oauth-serving-cert\") pod \"console-5d85f469d5-2295j\" (UID: \"04da93e0-5f90-4199-992e-205353a4aad7\") " pod="openshift-console/console-5d85f469d5-2295j" Jul 06 17:59:00.884244 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.884126 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04da93e0-5f90-4199-992e-205353a4aad7-console-serving-cert\") pod \"console-5d85f469d5-2295j\" (UID: \"04da93e0-5f90-4199-992e-205353a4aad7\") " pod="openshift-console/console-5d85f469d5-2295j" Jul 06 17:59:00.884244 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.884158 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04da93e0-5f90-4199-992e-205353a4aad7-trusted-ca-bundle\") pod \"console-5d85f469d5-2295j\" (UID: \"04da93e0-5f90-4199-992e-205353a4aad7\") " pod="openshift-console/console-5d85f469d5-2295j" Jul 06 17:59:00.884244 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.884178 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68tcd\" (UniqueName: \"kubernetes.io/projected/04da93e0-5f90-4199-992e-205353a4aad7-kube-api-access-68tcd\") pod \"console-5d85f469d5-2295j\" (UID: \"04da93e0-5f90-4199-992e-205353a4aad7\") " pod="openshift-console/console-5d85f469d5-2295j" Jul 06 17:59:00.884244 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.884236 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04da93e0-5f90-4199-992e-205353a4aad7-console-config\") pod \"console-5d85f469d5-2295j\" (UID: \"04da93e0-5f90-4199-992e-205353a4aad7\") " pod="openshift-console/console-5d85f469d5-2295j" Jul 06 17:59:00.884370 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.884291 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04da93e0-5f90-4199-992e-205353a4aad7-service-ca\") pod \"console-5d85f469d5-2295j\" (UID: \"04da93e0-5f90-4199-992e-205353a4aad7\") " pod="openshift-console/console-5d85f469d5-2295j" Jul 06 17:59:00.884370 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.884332 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04da93e0-5f90-4199-992e-205353a4aad7-console-oauth-config\") pod \"console-5d85f469d5-2295j\" (UID: \"04da93e0-5f90-4199-992e-205353a4aad7\") " pod="openshift-console/console-5d85f469d5-2295j" Jul 06 17:59:00.984881 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.984851 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04da93e0-5f90-4199-992e-205353a4aad7-console-oauth-config\") pod \"console-5d85f469d5-2295j\" (UID: \"04da93e0-5f90-4199-992e-205353a4aad7\") " pod="openshift-console/console-5d85f469d5-2295j" Jul 06 17:59:00.985079 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.984886 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04da93e0-5f90-4199-992e-205353a4aad7-oauth-serving-cert\") pod \"console-5d85f469d5-2295j\" (UID: \"04da93e0-5f90-4199-992e-205353a4aad7\") " pod="openshift-console/console-5d85f469d5-2295j" Jul 06 17:59:00.985079 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.984911 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04da93e0-5f90-4199-992e-205353a4aad7-console-serving-cert\") pod \"console-5d85f469d5-2295j\" (UID: \"04da93e0-5f90-4199-992e-205353a4aad7\") " pod="openshift-console/console-5d85f469d5-2295j" Jul 06 17:59:00.985079 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.984927 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04da93e0-5f90-4199-992e-205353a4aad7-trusted-ca-bundle\") pod \"console-5d85f469d5-2295j\" (UID: \"04da93e0-5f90-4199-992e-205353a4aad7\") " pod="openshift-console/console-5d85f469d5-2295j" Jul 06 17:59:00.985079 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.984944 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68tcd\" (UniqueName: \"kubernetes.io/projected/04da93e0-5f90-4199-992e-205353a4aad7-kube-api-access-68tcd\") pod \"console-5d85f469d5-2295j\" (UID: \"04da93e0-5f90-4199-992e-205353a4aad7\") " pod="openshift-console/console-5d85f469d5-2295j" Jul 06 17:59:00.985079 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.984994 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04da93e0-5f90-4199-992e-205353a4aad7-console-config\") pod \"console-5d85f469d5-2295j\" (UID: \"04da93e0-5f90-4199-992e-205353a4aad7\") " pod="openshift-console/console-5d85f469d5-2295j" Jul 06 17:59:00.985079 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.985053 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04da93e0-5f90-4199-992e-205353a4aad7-service-ca\") pod \"console-5d85f469d5-2295j\" (UID: \"04da93e0-5f90-4199-992e-205353a4aad7\") " pod="openshift-console/console-5d85f469d5-2295j" Jul 06 17:59:00.985792 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.985769 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04da93e0-5f90-4199-992e-205353a4aad7-console-config\") pod \"console-5d85f469d5-2295j\" (UID: \"04da93e0-5f90-4199-992e-205353a4aad7\") " pod="openshift-console/console-5d85f469d5-2295j" Jul 06 17:59:00.985891 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.985857 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04da93e0-5f90-4199-992e-205353a4aad7-service-ca\") pod \"console-5d85f469d5-2295j\" (UID: \"04da93e0-5f90-4199-992e-205353a4aad7\") " pod="openshift-console/console-5d85f469d5-2295j" Jul 06 17:59:00.985977 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.985954 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04da93e0-5f90-4199-992e-205353a4aad7-oauth-serving-cert\") pod \"console-5d85f469d5-2295j\" (UID: \"04da93e0-5f90-4199-992e-205353a4aad7\") " pod="openshift-console/console-5d85f469d5-2295j" Jul 06 17:59:00.986297 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.986274 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04da93e0-5f90-4199-992e-205353a4aad7-trusted-ca-bundle\") pod \"console-5d85f469d5-2295j\" (UID: \"04da93e0-5f90-4199-992e-205353a4aad7\") " pod="openshift-console/console-5d85f469d5-2295j" Jul 06 17:59:00.987409 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.987389 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04da93e0-5f90-4199-992e-205353a4aad7-console-oauth-config\") pod \"console-5d85f469d5-2295j\" (UID: \"04da93e0-5f90-4199-992e-205353a4aad7\") " pod="openshift-console/console-5d85f469d5-2295j" Jul 06 17:59:00.987526 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.987510 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04da93e0-5f90-4199-992e-205353a4aad7-console-serving-cert\") pod \"console-5d85f469d5-2295j\" (UID: \"04da93e0-5f90-4199-992e-205353a4aad7\") " pod="openshift-console/console-5d85f469d5-2295j" Jul 06 17:59:00.995085 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:00.995066 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68tcd\" (UniqueName: \"kubernetes.io/projected/04da93e0-5f90-4199-992e-205353a4aad7-kube-api-access-68tcd\") pod \"console-5d85f469d5-2295j\" (UID: \"04da93e0-5f90-4199-992e-205353a4aad7\") " pod="openshift-console/console-5d85f469d5-2295j" Jul 06 17:59:01.114569 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:01.114476 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d85f469d5-2295j" Jul 06 17:59:01.243383 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:01.243350 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d85f469d5-2295j"] Jul 06 17:59:01.246246 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:59:01.246216 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04da93e0_5f90_4199_992e_205353a4aad7.slice/crio-e92f353a4e6a9f4c44729b6fe13faf86174aec515bfca7a732752747203c58aa WatchSource:0}: Error finding container e92f353a4e6a9f4c44729b6fe13faf86174aec515bfca7a732752747203c58aa: Status 404 returned error can't find the container with id e92f353a4e6a9f4c44729b6fe13faf86174aec515bfca7a732752747203c58aa Jul 06 17:59:01.534925 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:01.534881 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d85f469d5-2295j" event={"ID":"04da93e0-5f90-4199-992e-205353a4aad7","Type":"ContainerStarted","Data":"1371fc063039aceabb9a3cf3b63f45b30d874a728f50fb8997c0fdb87caa783a"} Jul 06 17:59:01.535144 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:01.534942 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d85f469d5-2295j" event={"ID":"04da93e0-5f90-4199-992e-205353a4aad7","Type":"ContainerStarted","Data":"e92f353a4e6a9f4c44729b6fe13faf86174aec515bfca7a732752747203c58aa"} Jul 06 17:59:01.556594 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:01.556545 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d85f469d5-2295j" podStartSLOduration=1.5565263169999999 podStartE2EDuration="1.556526317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:59:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:59:01.55589135 +0000 UTC m=+462.240498362" watchObservedRunningTime="2026-07-06 17:59:01.556526317 +0000 UTC m=+462.241133292" Jul 06 17:59:11.114887 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:11.114855 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d85f469d5-2295j" Jul 06 17:59:11.115321 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:11.114913 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d85f469d5-2295j" Jul 06 17:59:11.119611 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:11.119585 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d85f469d5-2295j" Jul 06 17:59:11.580450 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:11.580423 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d85f469d5-2295j" Jul 06 17:59:12.747001 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:12.746965 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdk5r"] Jul 06 17:59:12.749415 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:12.749393 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdk5r" Jul 06 17:59:12.751762 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:12.751742 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 06 17:59:12.751889 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:12.751807 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-n24nx\"" Jul 06 17:59:12.761434 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:12.761402 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdk5r"] Jul 06 17:59:12.891446 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:12.891413 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6z8s\" (UniqueName: \"kubernetes.io/projected/e852b45e-c7f5-45c3-8080-e387bb535e17-kube-api-access-f6z8s\") pod \"dns-operator-controller-manager-864dd78c4c-bdk5r\" (UID: \"e852b45e-c7f5-45c3-8080-e387bb535e17\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdk5r" Jul 06 17:59:12.992013 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:12.991975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6z8s\" (UniqueName: \"kubernetes.io/projected/e852b45e-c7f5-45c3-8080-e387bb535e17-kube-api-access-f6z8s\") pod \"dns-operator-controller-manager-864dd78c4c-bdk5r\" (UID: \"e852b45e-c7f5-45c3-8080-e387bb535e17\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdk5r" Jul 06 17:59:13.002723 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:13.002648 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6z8s\" (UniqueName: \"kubernetes.io/projected/e852b45e-c7f5-45c3-8080-e387bb535e17-kube-api-access-f6z8s\") pod \"dns-operator-controller-manager-864dd78c4c-bdk5r\" (UID: \"e852b45e-c7f5-45c3-8080-e387bb535e17\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdk5r" Jul 06 17:59:13.060605 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:13.060564 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdk5r" Jul 06 17:59:13.194724 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:13.194701 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdk5r"] Jul 06 17:59:13.197240 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:59:13.197215 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode852b45e_c7f5_45c3_8080_e387bb535e17.slice/crio-de2c03abe54338f62f1895f7990846e91387e8378dd52f71f3501edc384c926e WatchSource:0}: Error finding container de2c03abe54338f62f1895f7990846e91387e8378dd52f71f3501edc384c926e: Status 404 returned error can't find the container with id de2c03abe54338f62f1895f7990846e91387e8378dd52f71f3501edc384c926e Jul 06 17:59:13.585981 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:13.585946 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdk5r" event={"ID":"e852b45e-c7f5-45c3-8080-e387bb535e17","Type":"ContainerStarted","Data":"de2c03abe54338f62f1895f7990846e91387e8378dd52f71f3501edc384c926e"} Jul 06 17:59:15.597516 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:15.597472 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdk5r" event={"ID":"e852b45e-c7f5-45c3-8080-e387bb535e17","Type":"ContainerStarted","Data":"5ac5f97ad92b67a1d8bb757a6eae6acb9eba0a5f573a3732234bea6f93093369"} Jul 06 17:59:15.597959 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:15.597549 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdk5r" Jul 06 17:59:15.616262 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:15.616217 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdk5r" podStartSLOduration=1.392819776 podStartE2EDuration="3.616202091s" totalImagesPullingTime="2.223382315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:59:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:59:15.614953735 +0000 UTC m=+476.299560726" watchObservedRunningTime="2026-07-06 17:59:15.616202091 +0000 UTC m=+476.300809064" Jul 06 17:59:17.863078 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:17.863042 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr64g"] Jul 06 17:59:17.865357 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:17.865337 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr64g" Jul 06 17:59:17.867874 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:17.867857 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-w2lq6\"" Jul 06 17:59:17.881727 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:17.881707 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr64g"] Jul 06 17:59:18.032841 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:18.032808 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r24xf\" (UniqueName: \"kubernetes.io/projected/41dbdfef-71e9-404d-961d-b4dd8c6630dd-kube-api-access-r24xf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vr64g\" (UID: \"41dbdfef-71e9-404d-961d-b4dd8c6630dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr64g" Jul 06 17:59:18.033080 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:18.032887 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/41dbdfef-71e9-404d-961d-b4dd8c6630dd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vr64g\" (UID: \"41dbdfef-71e9-404d-961d-b4dd8c6630dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr64g" Jul 06 17:59:18.133906 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:18.133839 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r24xf\" (UniqueName: \"kubernetes.io/projected/41dbdfef-71e9-404d-961d-b4dd8c6630dd-kube-api-access-r24xf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vr64g\" (UID: \"41dbdfef-71e9-404d-961d-b4dd8c6630dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr64g" Jul 06 17:59:18.133906 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:18.133902 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/41dbdfef-71e9-404d-961d-b4dd8c6630dd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vr64g\" (UID: \"41dbdfef-71e9-404d-961d-b4dd8c6630dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr64g" Jul 06 17:59:18.134280 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:18.134262 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/41dbdfef-71e9-404d-961d-b4dd8c6630dd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vr64g\" (UID: \"41dbdfef-71e9-404d-961d-b4dd8c6630dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr64g" Jul 06 17:59:18.149366 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:18.149337 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r24xf\" (UniqueName: \"kubernetes.io/projected/41dbdfef-71e9-404d-961d-b4dd8c6630dd-kube-api-access-r24xf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vr64g\" (UID: \"41dbdfef-71e9-404d-961d-b4dd8c6630dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr64g" Jul 06 17:59:18.174906 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:18.174876 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr64g" Jul 06 17:59:18.313737 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:18.313714 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr64g"] Jul 06 17:59:18.316242 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:59:18.316214 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41dbdfef_71e9_404d_961d_b4dd8c6630dd.slice/crio-7b692e448602e401ea90b67b8655c728cf11f5e778208b3e87e8f8e864fb5950 WatchSource:0}: Error finding container 7b692e448602e401ea90b67b8655c728cf11f5e778208b3e87e8f8e864fb5950: Status 404 returned error can't find the container with id 7b692e448602e401ea90b67b8655c728cf11f5e778208b3e87e8f8e864fb5950 Jul 06 17:59:18.610925 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:18.610892 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr64g" event={"ID":"41dbdfef-71e9-404d-961d-b4dd8c6630dd","Type":"ContainerStarted","Data":"7b692e448602e401ea90b67b8655c728cf11f5e778208b3e87e8f8e864fb5950"} Jul 06 17:59:20.877749 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:20.877717 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m9k6s"] Jul 06 17:59:20.880771 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:20.880748 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m9k6s" Jul 06 17:59:20.883749 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:20.883726 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-787xb\"" Jul 06 17:59:20.891147 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:20.891121 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m9k6s"] Jul 06 17:59:21.058797 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:21.058755 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hb8z\" (UniqueName: \"kubernetes.io/projected/af0d72b3-6f7c-449e-a86c-cd79d48439ac-kube-api-access-6hb8z\") pod \"limitador-operator-controller-manager-859d7b78bd-m9k6s\" (UID: \"af0d72b3-6f7c-449e-a86c-cd79d48439ac\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m9k6s" Jul 06 17:59:21.159636 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:21.159558 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hb8z\" (UniqueName: \"kubernetes.io/projected/af0d72b3-6f7c-449e-a86c-cd79d48439ac-kube-api-access-6hb8z\") pod \"limitador-operator-controller-manager-859d7b78bd-m9k6s\" (UID: \"af0d72b3-6f7c-449e-a86c-cd79d48439ac\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m9k6s" Jul 06 17:59:21.173212 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:21.173182 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hb8z\" (UniqueName: \"kubernetes.io/projected/af0d72b3-6f7c-449e-a86c-cd79d48439ac-kube-api-access-6hb8z\") pod \"limitador-operator-controller-manager-859d7b78bd-m9k6s\" (UID: \"af0d72b3-6f7c-449e-a86c-cd79d48439ac\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m9k6s" Jul 06 17:59:21.190971 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:21.190936 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m9k6s" Jul 06 17:59:21.328789 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:21.328759 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m9k6s"] Jul 06 17:59:21.331512 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:59:21.331485 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf0d72b3_6f7c_449e_a86c_cd79d48439ac.slice/crio-94229bfda385c495c4db4b170bbc6a7f395215df0da3d800e017b8322b14728b WatchSource:0}: Error finding container 94229bfda385c495c4db4b170bbc6a7f395215df0da3d800e017b8322b14728b: Status 404 returned error can't find the container with id 94229bfda385c495c4db4b170bbc6a7f395215df0da3d800e017b8322b14728b Jul 06 17:59:21.631317 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:21.631284 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m9k6s" event={"ID":"af0d72b3-6f7c-449e-a86c-cd79d48439ac","Type":"ContainerStarted","Data":"94229bfda385c495c4db4b170bbc6a7f395215df0da3d800e017b8322b14728b"} Jul 06 17:59:23.644090 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:23.643990 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m9k6s" event={"ID":"af0d72b3-6f7c-449e-a86c-cd79d48439ac","Type":"ContainerStarted","Data":"4faa50dee660e34dac2f458487983c88eb3c3a65f35c389c3359c977d77897e3"} Jul 06 17:59:23.644090 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:23.644080 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m9k6s" Jul 06 17:59:23.662967 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:23.662915 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m9k6s" podStartSLOduration=1.757526039 podStartE2EDuration="3.662899728s" totalImagesPullingTime="1.905373689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:59:23.660264743 +0000 UTC m=+484.344871735" watchObservedRunningTime="2026-07-06 17:59:23.662899728 +0000 UTC m=+484.347506701" Jul 06 17:59:24.915094 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:24.915060 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bkjfg"] Jul 06 17:59:24.918216 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:24.918199 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bkjfg" Jul 06 17:59:24.920583 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:24.920560 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-s5dx7\"" Jul 06 17:59:24.927839 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:24.927817 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bkjfg"] Jul 06 17:59:24.994700 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:24.994629 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c78c\" (UniqueName: \"kubernetes.io/projected/13e24a1c-1a3e-42c7-b4b2-2f1ec25ddd9d-kube-api-access-5c78c\") pod \"authorino-operator-75cc8d5cb7-bkjfg\" (UID: \"13e24a1c-1a3e-42c7-b4b2-2f1ec25ddd9d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bkjfg" Jul 06 17:59:25.095797 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:25.095763 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c78c\" (UniqueName: \"kubernetes.io/projected/13e24a1c-1a3e-42c7-b4b2-2f1ec25ddd9d-kube-api-access-5c78c\") pod \"authorino-operator-75cc8d5cb7-bkjfg\" (UID: \"13e24a1c-1a3e-42c7-b4b2-2f1ec25ddd9d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bkjfg" Jul 06 17:59:25.109400 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:25.109372 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c78c\" (UniqueName: \"kubernetes.io/projected/13e24a1c-1a3e-42c7-b4b2-2f1ec25ddd9d-kube-api-access-5c78c\") pod \"authorino-operator-75cc8d5cb7-bkjfg\" (UID: \"13e24a1c-1a3e-42c7-b4b2-2f1ec25ddd9d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bkjfg" Jul 06 17:59:25.228042 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:25.228001 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bkjfg" Jul 06 17:59:25.359830 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:25.357298 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bkjfg"] Jul 06 17:59:25.363006 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:59:25.362976 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13e24a1c_1a3e_42c7_b4b2_2f1ec25ddd9d.slice/crio-2c40444a8674e42f79f96505734c87ae8e1b85c30c9d1c1c74e9119ccafa3271 WatchSource:0}: Error finding container 2c40444a8674e42f79f96505734c87ae8e1b85c30c9d1c1c74e9119ccafa3271: Status 404 returned error can't find the container with id 2c40444a8674e42f79f96505734c87ae8e1b85c30c9d1c1c74e9119ccafa3271 Jul 06 17:59:25.654365 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:25.654273 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bkjfg" event={"ID":"13e24a1c-1a3e-42c7-b4b2-2f1ec25ddd9d","Type":"ContainerStarted","Data":"2c40444a8674e42f79f96505734c87ae8e1b85c30c9d1c1c74e9119ccafa3271"} Jul 06 17:59:25.655853 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:25.655824 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr64g" event={"ID":"41dbdfef-71e9-404d-961d-b4dd8c6630dd","Type":"ContainerStarted","Data":"0a948b8fb93877d025abda0f4890291aeb388f9d22fc1c6ab0f865ce883cf321"} Jul 06 17:59:25.655982 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:25.655909 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr64g" Jul 06 17:59:25.676767 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:25.676722 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr64g" podStartSLOduration=2.314239862 podStartE2EDuration="8.676708245s" totalImagesPullingTime="6.362468383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:59:25.675788366 +0000 UTC m=+486.360395365" watchObservedRunningTime="2026-07-06 17:59:25.676708245 +0000 UTC m=+486.361315217" Jul 06 17:59:26.604558 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:26.604525 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdk5r" Jul 06 17:59:28.676254 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:28.676220 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bkjfg" event={"ID":"13e24a1c-1a3e-42c7-b4b2-2f1ec25ddd9d","Type":"ContainerStarted","Data":"98a6f27cda6880d77887a19bbd200592f9e30388ff22e2da41393e25550055ad"} Jul 06 17:59:28.676695 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:28.676346 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bkjfg" Jul 06 17:59:28.694737 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:28.694682 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bkjfg" podStartSLOduration=2.157289993 podStartE2EDuration="4.694667678s" totalImagesPullingTime="2.537377685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:59:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:59:28.694098457 +0000 UTC m=+489.378705428" watchObservedRunningTime="2026-07-06 17:59:28.694667678 +0000 UTC m=+489.379274650" Jul 06 17:59:34.651158 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:34.651119 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m9k6s" Jul 06 17:59:36.666060 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:36.666015 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr64g" Jul 06 17:59:38.462007 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.461974 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr64g"] Jul 06 17:59:38.462495 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.462229 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr64g" podUID="41dbdfef-71e9-404d-961d-b4dd8c6630dd" containerName="manager" containerID="cri-o://0a948b8fb93877d025abda0f4890291aeb388f9d22fc1c6ab0f865ce883cf321" gracePeriod=2 Jul 06 17:59:38.471176 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.471147 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr64g"] Jul 06 17:59:38.472175 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:59:38.472135 2578 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"41dbdfef-71e9-404d-961d-b4dd8c6630dd\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-vr64g\": pods \"kuadrant-operator-controller-manager-8684c9ff49-vr64g\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr64g" Jul 06 17:59:38.484851 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.484827 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkmzz"] Jul 06 17:59:38.485275 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.485258 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41dbdfef-71e9-404d-961d-b4dd8c6630dd" containerName="manager" Jul 06 17:59:38.485275 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.485276 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="41dbdfef-71e9-404d-961d-b4dd8c6630dd" containerName="manager" Jul 06 17:59:38.485360 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.485344 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="41dbdfef-71e9-404d-961d-b4dd8c6630dd" containerName="manager" Jul 06 17:59:38.488534 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.488520 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m9k6s"] Jul 06 17:59:38.488682 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.488652 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m9k6s" podUID="af0d72b3-6f7c-449e-a86c-cd79d48439ac" containerName="manager" containerID="cri-o://4faa50dee660e34dac2f458487983c88eb3c3a65f35c389c3359c977d77897e3" gracePeriod=2 Jul 06 17:59:38.488780 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.488759 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkmzz" Jul 06 17:59:38.496165 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.496144 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m9k6s"] Jul 06 17:59:38.533803 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.533745 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkmzz"] Jul 06 17:59:38.534597 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:59:38.534445 2578 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"af0d72b3-6f7c-449e-a86c-cd79d48439ac\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-m9k6s\": pods \"limitador-operator-controller-manager-859d7b78bd-m9k6s\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m9k6s" Jul 06 17:59:38.537428 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:59:38.537398 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vr64g\" is forbidden: User \"system:node:ip-10-0-130-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-37.ec2.internal' and this object" podUID="41dbdfef-71e9-404d-961d-b4dd8c6630dd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr64g" Jul 06 17:59:38.543198 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:59:38.543162 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vr64g\" is forbidden: User \"system:node:ip-10-0-130-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-37.ec2.internal' and this object" podUID="41dbdfef-71e9-404d-961d-b4dd8c6630dd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr64g" Jul 06 17:59:38.557885 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.557855 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsxwv"] Jul 06 17:59:38.558223 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.558206 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af0d72b3-6f7c-449e-a86c-cd79d48439ac" containerName="manager" Jul 06 17:59:38.558305 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.558225 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="af0d72b3-6f7c-449e-a86c-cd79d48439ac" containerName="manager" Jul 06 17:59:38.558305 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.558298 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="af0d72b3-6f7c-449e-a86c-cd79d48439ac" containerName="manager" Jul 06 17:59:38.561184 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.561167 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsxwv" Jul 06 17:59:38.574082 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.574061 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsxwv"] Jul 06 17:59:38.585669 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:59:38.585626 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m9k6s\" is forbidden: User \"system:node:ip-10-0-130-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-37.ec2.internal' and this object" podUID="af0d72b3-6f7c-449e-a86c-cd79d48439ac" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m9k6s" Jul 06 17:59:38.608492 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:59:38.608459 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vr64g\" is forbidden: User \"system:node:ip-10-0-130-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-37.ec2.internal' and this object" podUID="41dbdfef-71e9-404d-961d-b4dd8c6630dd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr64g" Jul 06 17:59:38.609729 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.609699 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw8zj\" (UniqueName: \"kubernetes.io/projected/13482247-76ba-44e9-b3b8-af18ad469902-kube-api-access-tw8zj\") pod \"limitador-operator-controller-manager-859d7b78bd-zsxwv\" (UID: \"13482247-76ba-44e9-b3b8-af18ad469902\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsxwv" Jul 06 17:59:38.609820 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.609745 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mxl5\" (UniqueName: \"kubernetes.io/projected/947f8d58-d3f1-4525-b5a0-6fce455db8cc-kube-api-access-4mxl5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tkmzz\" (UID: \"947f8d58-d3f1-4525-b5a0-6fce455db8cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkmzz" Jul 06 17:59:38.609888 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.609819 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/947f8d58-d3f1-4525-b5a0-6fce455db8cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tkmzz\" (UID: \"947f8d58-d3f1-4525-b5a0-6fce455db8cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkmzz" Jul 06 17:59:38.610297 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:59:38.610267 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m9k6s\" is forbidden: User \"system:node:ip-10-0-130-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-37.ec2.internal' and this object" podUID="af0d72b3-6f7c-449e-a86c-cd79d48439ac" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m9k6s" Jul 06 17:59:38.710727 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.710696 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/947f8d58-d3f1-4525-b5a0-6fce455db8cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tkmzz\" (UID: \"947f8d58-d3f1-4525-b5a0-6fce455db8cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkmzz" Jul 06 17:59:38.710975 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.710781 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw8zj\" (UniqueName: \"kubernetes.io/projected/13482247-76ba-44e9-b3b8-af18ad469902-kube-api-access-tw8zj\") pod \"limitador-operator-controller-manager-859d7b78bd-zsxwv\" (UID: \"13482247-76ba-44e9-b3b8-af18ad469902\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsxwv" Jul 06 17:59:38.710975 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.710809 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mxl5\" (UniqueName: \"kubernetes.io/projected/947f8d58-d3f1-4525-b5a0-6fce455db8cc-kube-api-access-4mxl5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tkmzz\" (UID: \"947f8d58-d3f1-4525-b5a0-6fce455db8cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkmzz" Jul 06 17:59:38.711190 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.711169 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/947f8d58-d3f1-4525-b5a0-6fce455db8cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tkmzz\" (UID: \"947f8d58-d3f1-4525-b5a0-6fce455db8cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkmzz" Jul 06 17:59:38.719516 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.719492 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw8zj\" (UniqueName: \"kubernetes.io/projected/13482247-76ba-44e9-b3b8-af18ad469902-kube-api-access-tw8zj\") pod \"limitador-operator-controller-manager-859d7b78bd-zsxwv\" (UID: \"13482247-76ba-44e9-b3b8-af18ad469902\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsxwv" Jul 06 17:59:38.719736 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.719710 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mxl5\" (UniqueName: \"kubernetes.io/projected/947f8d58-d3f1-4525-b5a0-6fce455db8cc-kube-api-access-4mxl5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tkmzz\" (UID: \"947f8d58-d3f1-4525-b5a0-6fce455db8cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkmzz" Jul 06 17:59:38.721112 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.721088 2578 generic.go:356] "Generic (PLEG): container finished" podID="41dbdfef-71e9-404d-961d-b4dd8c6630dd" containerID="0a948b8fb93877d025abda0f4890291aeb388f9d22fc1c6ab0f865ce883cf321" exitCode=0 Jul 06 17:59:38.721215 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.721166 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b692e448602e401ea90b67b8655c728cf11f5e778208b3e87e8f8e864fb5950" Jul 06 17:59:38.722503 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.722478 2578 generic.go:356] "Generic (PLEG): container finished" podID="af0d72b3-6f7c-449e-a86c-cd79d48439ac" containerID="4faa50dee660e34dac2f458487983c88eb3c3a65f35c389c3359c977d77897e3" exitCode=0 Jul 06 17:59:38.722587 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.722555 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94229bfda385c495c4db4b170bbc6a7f395215df0da3d800e017b8322b14728b" Jul 06 17:59:38.734346 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.734328 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr64g" Jul 06 17:59:38.736410 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.736393 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m9k6s" Jul 06 17:59:38.736658 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:59:38.736636 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vr64g\" is forbidden: User \"system:node:ip-10-0-130-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-37.ec2.internal' and this object" podUID="41dbdfef-71e9-404d-961d-b4dd8c6630dd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr64g" Jul 06 17:59:38.738789 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:59:38.738767 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m9k6s\" is forbidden: User \"system:node:ip-10-0-130-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-37.ec2.internal' and this object" podUID="af0d72b3-6f7c-449e-a86c-cd79d48439ac" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m9k6s" Jul 06 17:59:38.740983 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:59:38.740963 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vr64g\" is forbidden: User \"system:node:ip-10-0-130-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-37.ec2.internal' and this object" podUID="41dbdfef-71e9-404d-961d-b4dd8c6630dd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr64g" Jul 06 17:59:38.743286 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:59:38.743267 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-m9k6s\" is forbidden: User \"system:node:ip-10-0-130-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-37.ec2.internal' and this object" podUID="af0d72b3-6f7c-449e-a86c-cd79d48439ac" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m9k6s" Jul 06 17:59:38.811745 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.811720 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hb8z\" (UniqueName: \"kubernetes.io/projected/af0d72b3-6f7c-449e-a86c-cd79d48439ac-kube-api-access-6hb8z\") pod \"af0d72b3-6f7c-449e-a86c-cd79d48439ac\" (UID: \"af0d72b3-6f7c-449e-a86c-cd79d48439ac\") " Jul 06 17:59:38.811844 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.811786 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/41dbdfef-71e9-404d-961d-b4dd8c6630dd-extensions-socket-volume\") pod \"41dbdfef-71e9-404d-961d-b4dd8c6630dd\" (UID: \"41dbdfef-71e9-404d-961d-b4dd8c6630dd\") " Jul 06 17:59:38.811844 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.811837 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r24xf\" (UniqueName: \"kubernetes.io/projected/41dbdfef-71e9-404d-961d-b4dd8c6630dd-kube-api-access-r24xf\") pod \"41dbdfef-71e9-404d-961d-b4dd8c6630dd\" (UID: \"41dbdfef-71e9-404d-961d-b4dd8c6630dd\") " Jul 06 17:59:38.812309 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.812284 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41dbdfef-71e9-404d-961d-b4dd8c6630dd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "41dbdfef-71e9-404d-961d-b4dd8c6630dd" (UID: "41dbdfef-71e9-404d-961d-b4dd8c6630dd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:59:38.813867 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.813845 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af0d72b3-6f7c-449e-a86c-cd79d48439ac-kube-api-access-6hb8z" (OuterVolumeSpecName: "kube-api-access-6hb8z") pod "af0d72b3-6f7c-449e-a86c-cd79d48439ac" (UID: "af0d72b3-6f7c-449e-a86c-cd79d48439ac"). InnerVolumeSpecName "kube-api-access-6hb8z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:59:38.813867 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.813853 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41dbdfef-71e9-404d-961d-b4dd8c6630dd-kube-api-access-r24xf" (OuterVolumeSpecName: "kube-api-access-r24xf") pod "41dbdfef-71e9-404d-961d-b4dd8c6630dd" (UID: "41dbdfef-71e9-404d-961d-b4dd8c6630dd"). InnerVolumeSpecName "kube-api-access-r24xf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:59:38.908406 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.908381 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkmzz" Jul 06 17:59:38.912535 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.912512 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hb8z\" (UniqueName: \"kubernetes.io/projected/af0d72b3-6f7c-449e-a86c-cd79d48439ac-kube-api-access-6hb8z\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 17:59:38.912588 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.912538 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/41dbdfef-71e9-404d-961d-b4dd8c6630dd-extensions-socket-volume\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 17:59:38.912588 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.912547 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r24xf\" (UniqueName: \"kubernetes.io/projected/41dbdfef-71e9-404d-961d-b4dd8c6630dd-kube-api-access-r24xf\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 17:59:38.916489 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.916472 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsxwv" Jul 06 17:59:38.935810 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.935781 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41dbdfef-71e9-404d-961d-b4dd8c6630dd" path="/var/lib/kubelet/pods/41dbdfef-71e9-404d-961d-b4dd8c6630dd/volumes" Jul 06 17:59:38.936195 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:38.936179 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af0d72b3-6f7c-449e-a86c-cd79d48439ac" path="/var/lib/kubelet/pods/af0d72b3-6f7c-449e-a86c-cd79d48439ac/volumes" Jul 06 17:59:39.057341 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:39.057313 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkmzz"] Jul 06 17:59:39.058924 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:59:39.058898 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod947f8d58_d3f1_4525_b5a0_6fce455db8cc.slice/crio-858037cb8e4897baf8aaf4947d8ef50a5ed77dfb0bc0ccbff41c236ead114c16 WatchSource:0}: Error finding container 858037cb8e4897baf8aaf4947d8ef50a5ed77dfb0bc0ccbff41c236ead114c16: Status 404 returned error can't find the container with id 858037cb8e4897baf8aaf4947d8ef50a5ed77dfb0bc0ccbff41c236ead114c16 Jul 06 17:59:39.083692 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:39.083574 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsxwv"] Jul 06 17:59:39.095121 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:59:39.095094 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13482247_76ba_44e9_b3b8_af18ad469902.slice/crio-dcf88ad28704fc400fcbdc4a5fe99880f724f6340d585a023755be8705ffe534 WatchSource:0}: Error finding container dcf88ad28704fc400fcbdc4a5fe99880f724f6340d585a023755be8705ffe534: Status 404 returned error can't find the container with id dcf88ad28704fc400fcbdc4a5fe99880f724f6340d585a023755be8705ffe534 Jul 06 17:59:39.683220 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:39.683189 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bkjfg" Jul 06 17:59:39.729041 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:39.729005 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsxwv" event={"ID":"13482247-76ba-44e9-b3b8-af18ad469902","Type":"ContainerStarted","Data":"d969ab61798973587c2d2f4af46e40e9bd2a11dfbfde658d64aecf753b8b8e84"} Jul 06 17:59:39.729189 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:39.729071 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsxwv" event={"ID":"13482247-76ba-44e9-b3b8-af18ad469902","Type":"ContainerStarted","Data":"dcf88ad28704fc400fcbdc4a5fe99880f724f6340d585a023755be8705ffe534"} Jul 06 17:59:39.729189 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:39.729121 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsxwv" Jul 06 17:59:39.730629 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:39.730606 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkmzz" event={"ID":"947f8d58-d3f1-4525-b5a0-6fce455db8cc","Type":"ContainerStarted","Data":"98966c74822b4a51083593efdeedc68fe517ca00c96555cfb5727b6988b64570"} Jul 06 17:59:39.730629 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:39.730634 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-m9k6s" Jul 06 17:59:39.730805 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:39.730642 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkmzz" event={"ID":"947f8d58-d3f1-4525-b5a0-6fce455db8cc","Type":"ContainerStarted","Data":"858037cb8e4897baf8aaf4947d8ef50a5ed77dfb0bc0ccbff41c236ead114c16"} Jul 06 17:59:39.730805 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:39.730634 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vr64g" Jul 06 17:59:39.730805 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:39.730805 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkmzz" Jul 06 17:59:39.748306 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:39.748207 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsxwv" podStartSLOduration=1.748193901 podStartE2EDuration="1.748193901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:59:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:59:39.74795398 +0000 UTC m=+500.432560955" watchObservedRunningTime="2026-07-06 17:59:39.748193901 +0000 UTC m=+500.432800873" Jul 06 17:59:39.777656 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:39.777609 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkmzz" podStartSLOduration=1.777594018 podStartE2EDuration="1.777594018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:59:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:59:39.776153127 +0000 UTC m=+500.460760113" watchObservedRunningTime="2026-07-06 17:59:39.777594018 +0000 UTC m=+500.462200991" Jul 06 17:59:50.738113 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:50.738082 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsxwv" Jul 06 17:59:50.738568 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:50.738154 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkmzz" Jul 06 17:59:55.176439 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:55.176392 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkmzz"] Jul 06 17:59:55.176873 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:55.176624 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkmzz" podUID="947f8d58-d3f1-4525-b5a0-6fce455db8cc" containerName="manager" containerID="cri-o://98966c74822b4a51083593efdeedc68fe517ca00c96555cfb5727b6988b64570" gracePeriod=10 Jul 06 17:59:55.419557 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:55.419528 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rlgs9"] Jul 06 17:59:55.426811 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:55.426757 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rlgs9" Jul 06 17:59:55.427631 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:55.427612 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkmzz" Jul 06 17:59:55.439932 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:55.439907 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rlgs9"] Jul 06 17:59:55.546949 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:55.546919 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mxl5\" (UniqueName: \"kubernetes.io/projected/947f8d58-d3f1-4525-b5a0-6fce455db8cc-kube-api-access-4mxl5\") pod \"947f8d58-d3f1-4525-b5a0-6fce455db8cc\" (UID: \"947f8d58-d3f1-4525-b5a0-6fce455db8cc\") " Jul 06 17:59:55.547112 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:55.546960 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/947f8d58-d3f1-4525-b5a0-6fce455db8cc-extensions-socket-volume\") pod \"947f8d58-d3f1-4525-b5a0-6fce455db8cc\" (UID: \"947f8d58-d3f1-4525-b5a0-6fce455db8cc\") " Jul 06 17:59:55.547155 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:55.547110 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt5fk\" (UniqueName: \"kubernetes.io/projected/65ab8864-4b09-4b03-8808-222e123b3f97-kube-api-access-dt5fk\") pod \"kuadrant-operator-controller-manager-86878c769f-rlgs9\" (UID: \"65ab8864-4b09-4b03-8808-222e123b3f97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rlgs9" Jul 06 17:59:55.547155 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:55.547151 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65ab8864-4b09-4b03-8808-222e123b3f97-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rlgs9\" (UID: \"65ab8864-4b09-4b03-8808-222e123b3f97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rlgs9" Jul 06 17:59:55.547383 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:55.547355 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/947f8d58-d3f1-4525-b5a0-6fce455db8cc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "947f8d58-d3f1-4525-b5a0-6fce455db8cc" (UID: "947f8d58-d3f1-4525-b5a0-6fce455db8cc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:59:55.548944 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:55.548918 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/947f8d58-d3f1-4525-b5a0-6fce455db8cc-kube-api-access-4mxl5" (OuterVolumeSpecName: "kube-api-access-4mxl5") pod "947f8d58-d3f1-4525-b5a0-6fce455db8cc" (UID: "947f8d58-d3f1-4525-b5a0-6fce455db8cc"). InnerVolumeSpecName "kube-api-access-4mxl5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:59:55.648264 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:55.648229 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt5fk\" (UniqueName: \"kubernetes.io/projected/65ab8864-4b09-4b03-8808-222e123b3f97-kube-api-access-dt5fk\") pod \"kuadrant-operator-controller-manager-86878c769f-rlgs9\" (UID: \"65ab8864-4b09-4b03-8808-222e123b3f97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rlgs9" Jul 06 17:59:55.648415 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:55.648276 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65ab8864-4b09-4b03-8808-222e123b3f97-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rlgs9\" (UID: \"65ab8864-4b09-4b03-8808-222e123b3f97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rlgs9" Jul 06 17:59:55.648415 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:55.648307 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mxl5\" (UniqueName: \"kubernetes.io/projected/947f8d58-d3f1-4525-b5a0-6fce455db8cc-kube-api-access-4mxl5\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 17:59:55.648415 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:55.648318 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/947f8d58-d3f1-4525-b5a0-6fce455db8cc-extensions-socket-volume\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 17:59:55.648607 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:55.648592 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65ab8864-4b09-4b03-8808-222e123b3f97-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rlgs9\" (UID: \"65ab8864-4b09-4b03-8808-222e123b3f97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rlgs9" Jul 06 17:59:55.656881 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:55.656851 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt5fk\" (UniqueName: \"kubernetes.io/projected/65ab8864-4b09-4b03-8808-222e123b3f97-kube-api-access-dt5fk\") pod \"kuadrant-operator-controller-manager-86878c769f-rlgs9\" (UID: \"65ab8864-4b09-4b03-8808-222e123b3f97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rlgs9" Jul 06 17:59:55.735987 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:55.735919 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rlgs9" Jul 06 17:59:55.801677 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:55.801170 2578 generic.go:356] "Generic (PLEG): container finished" podID="947f8d58-d3f1-4525-b5a0-6fce455db8cc" containerID="98966c74822b4a51083593efdeedc68fe517ca00c96555cfb5727b6988b64570" exitCode=0 Jul 06 17:59:55.801677 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:55.801288 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkmzz" event={"ID":"947f8d58-d3f1-4525-b5a0-6fce455db8cc","Type":"ContainerDied","Data":"98966c74822b4a51083593efdeedc68fe517ca00c96555cfb5727b6988b64570"} Jul 06 17:59:55.801677 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:55.801334 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkmzz" event={"ID":"947f8d58-d3f1-4525-b5a0-6fce455db8cc","Type":"ContainerDied","Data":"858037cb8e4897baf8aaf4947d8ef50a5ed77dfb0bc0ccbff41c236ead114c16"} Jul 06 17:59:55.801677 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:55.801361 2578 scope.go:117] "RemoveContainer" containerID="98966c74822b4a51083593efdeedc68fe517ca00c96555cfb5727b6988b64570" Jul 06 17:59:55.801677 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:55.801515 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkmzz" Jul 06 17:59:55.811958 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:55.811578 2578 scope.go:117] "RemoveContainer" containerID="98966c74822b4a51083593efdeedc68fe517ca00c96555cfb5727b6988b64570" Jul 06 17:59:55.812048 ip-10-0-130-37 kubenswrapper[2578]: E0706 17:59:55.811953 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98966c74822b4a51083593efdeedc68fe517ca00c96555cfb5727b6988b64570\": container with ID starting with 98966c74822b4a51083593efdeedc68fe517ca00c96555cfb5727b6988b64570 not found: ID does not exist" containerID="98966c74822b4a51083593efdeedc68fe517ca00c96555cfb5727b6988b64570" Jul 06 17:59:55.812048 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:55.811987 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98966c74822b4a51083593efdeedc68fe517ca00c96555cfb5727b6988b64570"} err="failed to get container status \"98966c74822b4a51083593efdeedc68fe517ca00c96555cfb5727b6988b64570\": rpc error: code = NotFound desc = could not find container \"98966c74822b4a51083593efdeedc68fe517ca00c96555cfb5727b6988b64570\": container with ID starting with 98966c74822b4a51083593efdeedc68fe517ca00c96555cfb5727b6988b64570 not found: ID does not exist" Jul 06 17:59:55.829819 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:55.829794 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkmzz"] Jul 06 17:59:55.837386 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:55.837364 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkmzz"] Jul 06 17:59:55.897371 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:55.897341 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rlgs9"] Jul 06 17:59:55.900451 ip-10-0-130-37 kubenswrapper[2578]: W0706 17:59:55.900424 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65ab8864_4b09_4b03_8808_222e123b3f97.slice/crio-706766de5f8dfe4e7e4e86a1bd5754a0ffe3bf4635157d3a11b87a9c77070086 WatchSource:0}: Error finding container 706766de5f8dfe4e7e4e86a1bd5754a0ffe3bf4635157d3a11b87a9c77070086: Status 404 returned error can't find the container with id 706766de5f8dfe4e7e4e86a1bd5754a0ffe3bf4635157d3a11b87a9c77070086 Jul 06 17:59:56.806851 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:56.806807 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rlgs9" event={"ID":"65ab8864-4b09-4b03-8808-222e123b3f97","Type":"ContainerStarted","Data":"f92a3721e8260be0ccdf42d3bbcfd033b0a1ca3b4ed3487fab7075d4f516602e"} Jul 06 17:59:56.807296 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:56.806864 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rlgs9" event={"ID":"65ab8864-4b09-4b03-8808-222e123b3f97","Type":"ContainerStarted","Data":"706766de5f8dfe4e7e4e86a1bd5754a0ffe3bf4635157d3a11b87a9c77070086"} Jul 06 17:59:56.807296 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:56.806946 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rlgs9" Jul 06 17:59:56.829116 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:56.829060 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rlgs9" podStartSLOduration=1.82904529 podStartE2EDuration="1.82904529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:59:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:59:56.826524229 +0000 UTC m=+517.511131220" watchObservedRunningTime="2026-07-06 17:59:56.82904529 +0000 UTC m=+517.513652252" Jul 06 17:59:56.940189 ip-10-0-130-37 kubenswrapper[2578]: I0706 17:59:56.940152 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="947f8d58-d3f1-4525-b5a0-6fce455db8cc" path="/var/lib/kubelet/pods/947f8d58-d3f1-4525-b5a0-6fce455db8cc/volumes" Jul 06 18:00:07.814628 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:07.814598 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rlgs9" Jul 06 18:00:11.627375 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.627340 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b"] Jul 06 18:00:11.627764 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.627673 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="947f8d58-d3f1-4525-b5a0-6fce455db8cc" containerName="manager" Jul 06 18:00:11.627764 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.627686 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="947f8d58-d3f1-4525-b5a0-6fce455db8cc" containerName="manager" Jul 06 18:00:11.627764 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.627752 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="947f8d58-d3f1-4525-b5a0-6fce455db8cc" containerName="manager" Jul 06 18:00:11.632427 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.632403 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:11.635858 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.635836 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-sbkvn\"" Jul 06 18:00:11.655534 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.655503 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b"] Jul 06 18:00:11.782208 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.782178 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-595pw\" (UniqueName: \"kubernetes.io/projected/df84e41f-b630-463d-be34-180d0fd49f80-kube-api-access-595pw\") pod \"maas-default-gateway-openshift-default-5dfc694f5c-k589b\" (UID: \"df84e41f-b630-463d-be34-180d0fd49f80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:11.782406 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.782214 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df84e41f-b630-463d-be34-180d0fd49f80-istio-envoy\") pod \"maas-default-gateway-openshift-default-5dfc694f5c-k589b\" (UID: \"df84e41f-b630-463d-be34-180d0fd49f80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:11.782406 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.782237 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df84e41f-b630-463d-be34-180d0fd49f80-istio-token\") pod \"maas-default-gateway-openshift-default-5dfc694f5c-k589b\" (UID: \"df84e41f-b630-463d-be34-180d0fd49f80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:11.782406 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.782253 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df84e41f-b630-463d-be34-180d0fd49f80-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5dfc694f5c-k589b\" (UID: \"df84e41f-b630-463d-be34-180d0fd49f80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:11.782406 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.782319 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df84e41f-b630-463d-be34-180d0fd49f80-credential-socket\") pod \"maas-default-gateway-openshift-default-5dfc694f5c-k589b\" (UID: \"df84e41f-b630-463d-be34-180d0fd49f80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:11.782406 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.782387 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df84e41f-b630-463d-be34-180d0fd49f80-workload-socket\") pod \"maas-default-gateway-openshift-default-5dfc694f5c-k589b\" (UID: \"df84e41f-b630-463d-be34-180d0fd49f80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:11.782639 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.782446 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df84e41f-b630-463d-be34-180d0fd49f80-istio-data\") pod \"maas-default-gateway-openshift-default-5dfc694f5c-k589b\" (UID: \"df84e41f-b630-463d-be34-180d0fd49f80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:11.782639 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.782485 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df84e41f-b630-463d-be34-180d0fd49f80-workload-certs\") pod \"maas-default-gateway-openshift-default-5dfc694f5c-k589b\" (UID: \"df84e41f-b630-463d-be34-180d0fd49f80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:11.782639 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.782521 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df84e41f-b630-463d-be34-180d0fd49f80-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5dfc694f5c-k589b\" (UID: \"df84e41f-b630-463d-be34-180d0fd49f80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:11.883329 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.883240 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-595pw\" (UniqueName: \"kubernetes.io/projected/df84e41f-b630-463d-be34-180d0fd49f80-kube-api-access-595pw\") pod \"maas-default-gateway-openshift-default-5dfc694f5c-k589b\" (UID: \"df84e41f-b630-463d-be34-180d0fd49f80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:11.883329 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.883278 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df84e41f-b630-463d-be34-180d0fd49f80-istio-envoy\") pod \"maas-default-gateway-openshift-default-5dfc694f5c-k589b\" (UID: \"df84e41f-b630-463d-be34-180d0fd49f80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:11.883329 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.883305 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df84e41f-b630-463d-be34-180d0fd49f80-istio-token\") pod \"maas-default-gateway-openshift-default-5dfc694f5c-k589b\" (UID: \"df84e41f-b630-463d-be34-180d0fd49f80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:11.883329 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.883324 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df84e41f-b630-463d-be34-180d0fd49f80-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5dfc694f5c-k589b\" (UID: \"df84e41f-b630-463d-be34-180d0fd49f80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:11.883745 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.883446 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df84e41f-b630-463d-be34-180d0fd49f80-credential-socket\") pod \"maas-default-gateway-openshift-default-5dfc694f5c-k589b\" (UID: \"df84e41f-b630-463d-be34-180d0fd49f80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:11.883745 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.883505 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df84e41f-b630-463d-be34-180d0fd49f80-workload-socket\") pod \"maas-default-gateway-openshift-default-5dfc694f5c-k589b\" (UID: \"df84e41f-b630-463d-be34-180d0fd49f80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:11.883745 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.883568 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df84e41f-b630-463d-be34-180d0fd49f80-istio-data\") pod \"maas-default-gateway-openshift-default-5dfc694f5c-k589b\" (UID: \"df84e41f-b630-463d-be34-180d0fd49f80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:11.883745 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.883614 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df84e41f-b630-463d-be34-180d0fd49f80-workload-certs\") pod \"maas-default-gateway-openshift-default-5dfc694f5c-k589b\" (UID: \"df84e41f-b630-463d-be34-180d0fd49f80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:11.883745 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.883674 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df84e41f-b630-463d-be34-180d0fd49f80-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5dfc694f5c-k589b\" (UID: \"df84e41f-b630-463d-be34-180d0fd49f80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:11.883992 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.883818 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df84e41f-b630-463d-be34-180d0fd49f80-credential-socket\") pod \"maas-default-gateway-openshift-default-5dfc694f5c-k589b\" (UID: \"df84e41f-b630-463d-be34-180d0fd49f80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:11.883992 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.883897 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df84e41f-b630-463d-be34-180d0fd49f80-workload-socket\") pod \"maas-default-gateway-openshift-default-5dfc694f5c-k589b\" (UID: \"df84e41f-b630-463d-be34-180d0fd49f80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:11.884139 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.883987 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df84e41f-b630-463d-be34-180d0fd49f80-workload-certs\") pod \"maas-default-gateway-openshift-default-5dfc694f5c-k589b\" (UID: \"df84e41f-b630-463d-be34-180d0fd49f80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:11.884139 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.884006 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df84e41f-b630-463d-be34-180d0fd49f80-istio-data\") pod \"maas-default-gateway-openshift-default-5dfc694f5c-k589b\" (UID: \"df84e41f-b630-463d-be34-180d0fd49f80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:11.884299 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.884280 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df84e41f-b630-463d-be34-180d0fd49f80-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5dfc694f5c-k589b\" (UID: \"df84e41f-b630-463d-be34-180d0fd49f80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:11.885634 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.885610 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df84e41f-b630-463d-be34-180d0fd49f80-istio-envoy\") pod \"maas-default-gateway-openshift-default-5dfc694f5c-k589b\" (UID: \"df84e41f-b630-463d-be34-180d0fd49f80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:11.885839 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.885824 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df84e41f-b630-463d-be34-180d0fd49f80-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5dfc694f5c-k589b\" (UID: \"df84e41f-b630-463d-be34-180d0fd49f80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:11.891270 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.891250 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df84e41f-b630-463d-be34-180d0fd49f80-istio-token\") pod \"maas-default-gateway-openshift-default-5dfc694f5c-k589b\" (UID: \"df84e41f-b630-463d-be34-180d0fd49f80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:11.891756 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.891727 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-595pw\" (UniqueName: \"kubernetes.io/projected/df84e41f-b630-463d-be34-180d0fd49f80-kube-api-access-595pw\") pod \"maas-default-gateway-openshift-default-5dfc694f5c-k589b\" (UID: \"df84e41f-b630-463d-be34-180d0fd49f80\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:11.942418 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:11.942387 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:12.088090 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:12.088067 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b"] Jul 06 18:00:12.090484 ip-10-0-130-37 kubenswrapper[2578]: W0706 18:00:12.090462 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf84e41f_b630_463d_be34_180d0fd49f80.slice/crio-5db6046d91d3ae09db6b45b4486b4b3f25bb16d3caf845fc196efdb4782a5a61 WatchSource:0}: Error finding container 5db6046d91d3ae09db6b45b4486b4b3f25bb16d3caf845fc196efdb4782a5a61: Status 404 returned error can't find the container with id 5db6046d91d3ae09db6b45b4486b4b3f25bb16d3caf845fc196efdb4782a5a61 Jul 06 18:00:12.092832 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:12.092799 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:00:12.092929 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:12.092885 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:00:12.092929 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:12.092915 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:00:12.878816 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:12.878777 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" event={"ID":"df84e41f-b630-463d-be34-180d0fd49f80","Type":"ContainerStarted","Data":"707a587b6206de749459884de110041d729def0ae23aaf55ea97730ce2020256"} Jul 06 18:00:12.879232 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:12.878836 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" event={"ID":"df84e41f-b630-463d-be34-180d0fd49f80","Type":"ContainerStarted","Data":"5db6046d91d3ae09db6b45b4486b4b3f25bb16d3caf845fc196efdb4782a5a61"} Jul 06 18:00:12.921974 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:12.921919 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" podStartSLOduration=1.921900442 podStartE2EDuration="1.921900442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:00:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:00:12.92037887 +0000 UTC m=+533.604985856" watchObservedRunningTime="2026-07-06 18:00:12.921900442 +0000 UTC m=+533.606507414" Jul 06 18:00:12.943050 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:12.942998 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:13.947473 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:13.947445 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:14.892759 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:14.892722 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:14.893651 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:14.893632 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:00:25.677153 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:25.677117 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-b2kl2"] Jul 06 18:00:25.681432 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:25.681407 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-b2kl2" Jul 06 18:00:25.683878 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:25.683855 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xsv2n\"" Jul 06 18:00:25.689526 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:25.688992 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-b2kl2"] Jul 06 18:00:25.695182 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:25.695154 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlc97\" (UniqueName: \"kubernetes.io/projected/126033ed-8e5f-46f2-a43d-a32f0139ba38-kube-api-access-zlc97\") pod \"authorino-58cd955675-b2kl2\" (UID: \"126033ed-8e5f-46f2-a43d-a32f0139ba38\") " pod="kuadrant-system/authorino-58cd955675-b2kl2" Jul 06 18:00:25.796430 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:25.796394 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlc97\" (UniqueName: \"kubernetes.io/projected/126033ed-8e5f-46f2-a43d-a32f0139ba38-kube-api-access-zlc97\") pod \"authorino-58cd955675-b2kl2\" (UID: \"126033ed-8e5f-46f2-a43d-a32f0139ba38\") " pod="kuadrant-system/authorino-58cd955675-b2kl2" Jul 06 18:00:25.804996 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:25.804965 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlc97\" (UniqueName: \"kubernetes.io/projected/126033ed-8e5f-46f2-a43d-a32f0139ba38-kube-api-access-zlc97\") pod \"authorino-58cd955675-b2kl2\" (UID: \"126033ed-8e5f-46f2-a43d-a32f0139ba38\") " pod="kuadrant-system/authorino-58cd955675-b2kl2" Jul 06 18:00:25.846637 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:25.846606 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-jknq4"] Jul 06 18:00:25.853949 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:25.853922 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jknq4" Jul 06 18:00:25.855529 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:25.855501 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jknq4"] Jul 06 18:00:25.897692 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:25.897661 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g28wv\" (UniqueName: \"kubernetes.io/projected/d6113196-c769-44ec-bb21-20d1a014b3bd-kube-api-access-g28wv\") pod \"authorino-75d556bd77-jknq4\" (UID: \"d6113196-c769-44ec-bb21-20d1a014b3bd\") " pod="kuadrant-system/authorino-75d556bd77-jknq4" Jul 06 18:00:25.992298 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:25.992219 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-b2kl2" Jul 06 18:00:25.998250 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:25.998230 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g28wv\" (UniqueName: \"kubernetes.io/projected/d6113196-c769-44ec-bb21-20d1a014b3bd-kube-api-access-g28wv\") pod \"authorino-75d556bd77-jknq4\" (UID: \"d6113196-c769-44ec-bb21-20d1a014b3bd\") " pod="kuadrant-system/authorino-75d556bd77-jknq4" Jul 06 18:00:26.006943 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:26.006921 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g28wv\" (UniqueName: \"kubernetes.io/projected/d6113196-c769-44ec-bb21-20d1a014b3bd-kube-api-access-g28wv\") pod \"authorino-75d556bd77-jknq4\" (UID: \"d6113196-c769-44ec-bb21-20d1a014b3bd\") " pod="kuadrant-system/authorino-75d556bd77-jknq4" Jul 06 18:00:26.122365 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:26.122343 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-b2kl2"] Jul 06 18:00:26.124987 ip-10-0-130-37 kubenswrapper[2578]: W0706 18:00:26.124958 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod126033ed_8e5f_46f2_a43d_a32f0139ba38.slice/crio-c2ba6b42a55c58d72aca175425da203ac562de57c77297541189a87ba890e232 WatchSource:0}: Error finding container c2ba6b42a55c58d72aca175425da203ac562de57c77297541189a87ba890e232: Status 404 returned error can't find the container with id c2ba6b42a55c58d72aca175425da203ac562de57c77297541189a87ba890e232 Jul 06 18:00:26.164676 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:26.164645 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jknq4" Jul 06 18:00:26.294302 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:26.294254 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jknq4"] Jul 06 18:00:26.296326 ip-10-0-130-37 kubenswrapper[2578]: W0706 18:00:26.296298 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6113196_c769_44ec_bb21_20d1a014b3bd.slice/crio-2267047f36a30388f9634a1d337ab7a7be81e3916e0bdea4f21f73b0d855a285 WatchSource:0}: Error finding container 2267047f36a30388f9634a1d337ab7a7be81e3916e0bdea4f21f73b0d855a285: Status 404 returned error can't find the container with id 2267047f36a30388f9634a1d337ab7a7be81e3916e0bdea4f21f73b0d855a285 Jul 06 18:00:26.944775 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:26.944741 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jknq4" event={"ID":"d6113196-c769-44ec-bb21-20d1a014b3bd","Type":"ContainerStarted","Data":"2267047f36a30388f9634a1d337ab7a7be81e3916e0bdea4f21f73b0d855a285"} Jul 06 18:00:26.945740 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:26.945718 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-b2kl2" event={"ID":"126033ed-8e5f-46f2-a43d-a32f0139ba38","Type":"ContainerStarted","Data":"c2ba6b42a55c58d72aca175425da203ac562de57c77297541189a87ba890e232"} Jul 06 18:00:30.971111 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:30.971059 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-b2kl2" event={"ID":"126033ed-8e5f-46f2-a43d-a32f0139ba38","Type":"ContainerStarted","Data":"30ca0faacff294385d2c1131eda33a5a9ca919a58c0169fed4bc1de50175c74d"} Jul 06 18:00:30.972425 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:30.972398 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jknq4" event={"ID":"d6113196-c769-44ec-bb21-20d1a014b3bd","Type":"ContainerStarted","Data":"6d6a9eb889ced65b94ee17161e2f0c4d5c4ceb9ed2ca92bea595804a71fc7b94"} Jul 06 18:00:30.986703 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:30.986661 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-b2kl2" podStartSLOduration=1.990542283 podStartE2EDuration="5.986647176s" totalImagesPullingTime="3.996104893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:00:30.985228436 +0000 UTC m=+551.669835409" watchObservedRunningTime="2026-07-06 18:00:30.986647176 +0000 UTC m=+551.671254150" Jul 06 18:00:31.003921 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:31.003867 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-jknq4" podStartSLOduration=2.191389734 podStartE2EDuration="6.003849349s" totalImagesPullingTime="3.812459615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:00:31.003559652 +0000 UTC m=+551.688166625" watchObservedRunningTime="2026-07-06 18:00:31.003849349 +0000 UTC m=+551.688456324" Jul 06 18:00:31.030379 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:31.030351 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-b2kl2"] Jul 06 18:00:32.980633 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:32.980573 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-b2kl2" podUID="126033ed-8e5f-46f2-a43d-a32f0139ba38" containerName="authorino" containerID="cri-o://30ca0faacff294385d2c1131eda33a5a9ca919a58c0169fed4bc1de50175c74d" gracePeriod=30 Jul 06 18:00:33.223662 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:33.223638 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-b2kl2" Jul 06 18:00:33.269975 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:33.269911 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlc97\" (UniqueName: \"kubernetes.io/projected/126033ed-8e5f-46f2-a43d-a32f0139ba38-kube-api-access-zlc97\") pod \"126033ed-8e5f-46f2-a43d-a32f0139ba38\" (UID: \"126033ed-8e5f-46f2-a43d-a32f0139ba38\") " Jul 06 18:00:33.271918 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:33.271894 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/126033ed-8e5f-46f2-a43d-a32f0139ba38-kube-api-access-zlc97" (OuterVolumeSpecName: "kube-api-access-zlc97") pod "126033ed-8e5f-46f2-a43d-a32f0139ba38" (UID: "126033ed-8e5f-46f2-a43d-a32f0139ba38"). InnerVolumeSpecName "kube-api-access-zlc97". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:00:33.370594 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:33.370554 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlc97\" (UniqueName: \"kubernetes.io/projected/126033ed-8e5f-46f2-a43d-a32f0139ba38-kube-api-access-zlc97\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:00:33.985861 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:33.985829 2578 generic.go:356] "Generic (PLEG): container finished" podID="126033ed-8e5f-46f2-a43d-a32f0139ba38" containerID="30ca0faacff294385d2c1131eda33a5a9ca919a58c0169fed4bc1de50175c74d" exitCode=0 Jul 06 18:00:33.986278 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:33.985868 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-b2kl2" Jul 06 18:00:33.986278 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:33.985891 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-b2kl2" event={"ID":"126033ed-8e5f-46f2-a43d-a32f0139ba38","Type":"ContainerDied","Data":"30ca0faacff294385d2c1131eda33a5a9ca919a58c0169fed4bc1de50175c74d"} Jul 06 18:00:33.986278 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:33.985920 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-b2kl2" event={"ID":"126033ed-8e5f-46f2-a43d-a32f0139ba38","Type":"ContainerDied","Data":"c2ba6b42a55c58d72aca175425da203ac562de57c77297541189a87ba890e232"} Jul 06 18:00:33.986278 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:33.985936 2578 scope.go:117] "RemoveContainer" containerID="30ca0faacff294385d2c1131eda33a5a9ca919a58c0169fed4bc1de50175c74d" Jul 06 18:00:33.993989 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:33.993973 2578 scope.go:117] "RemoveContainer" containerID="30ca0faacff294385d2c1131eda33a5a9ca919a58c0169fed4bc1de50175c74d" Jul 06 18:00:33.994301 ip-10-0-130-37 kubenswrapper[2578]: E0706 18:00:33.994281 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30ca0faacff294385d2c1131eda33a5a9ca919a58c0169fed4bc1de50175c74d\": container with ID starting with 30ca0faacff294385d2c1131eda33a5a9ca919a58c0169fed4bc1de50175c74d not found: ID does not exist" containerID="30ca0faacff294385d2c1131eda33a5a9ca919a58c0169fed4bc1de50175c74d" Jul 06 18:00:33.994352 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:33.994309 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30ca0faacff294385d2c1131eda33a5a9ca919a58c0169fed4bc1de50175c74d"} err="failed to get container status \"30ca0faacff294385d2c1131eda33a5a9ca919a58c0169fed4bc1de50175c74d\": rpc error: code = NotFound desc = could not find container \"30ca0faacff294385d2c1131eda33a5a9ca919a58c0169fed4bc1de50175c74d\": container with ID starting with 30ca0faacff294385d2c1131eda33a5a9ca919a58c0169fed4bc1de50175c74d not found: ID does not exist" Jul 06 18:00:34.007500 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:34.007478 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-b2kl2"] Jul 06 18:00:34.011444 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:34.011424 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-b2kl2"] Jul 06 18:00:34.934814 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:34.934782 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="126033ed-8e5f-46f2-a43d-a32f0139ba38" path="/var/lib/kubelet/pods/126033ed-8e5f-46f2-a43d-a32f0139ba38/volumes" Jul 06 18:00:58.012491 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:58.012457 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-72xbk"] Jul 06 18:00:58.012974 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:58.012774 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="126033ed-8e5f-46f2-a43d-a32f0139ba38" containerName="authorino" Jul 06 18:00:58.012974 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:58.012790 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="126033ed-8e5f-46f2-a43d-a32f0139ba38" containerName="authorino" Jul 06 18:00:58.012974 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:58.012857 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="126033ed-8e5f-46f2-a43d-a32f0139ba38" containerName="authorino" Jul 06 18:00:58.015888 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:58.015870 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-72xbk" Jul 06 18:00:58.024424 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:58.024401 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-72xbk"] Jul 06 18:00:58.174437 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:58.174406 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h7q6\" (UniqueName: \"kubernetes.io/projected/22f9cdde-37f3-47a9-a1aa-996a3ee2ce48-kube-api-access-4h7q6\") pod \"authorino-5d4b67c446-72xbk\" (UID: \"22f9cdde-37f3-47a9-a1aa-996a3ee2ce48\") " pod="kuadrant-system/authorino-5d4b67c446-72xbk" Jul 06 18:00:58.244550 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:58.244518 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-72xbk"] Jul 06 18:00:58.244783 ip-10-0-130-37 kubenswrapper[2578]: E0706 18:00:58.244765 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-4h7q6], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-72xbk" podUID="22f9cdde-37f3-47a9-a1aa-996a3ee2ce48" Jul 06 18:00:58.275191 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:58.275112 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h7q6\" (UniqueName: \"kubernetes.io/projected/22f9cdde-37f3-47a9-a1aa-996a3ee2ce48-kube-api-access-4h7q6\") pod \"authorino-5d4b67c446-72xbk\" (UID: \"22f9cdde-37f3-47a9-a1aa-996a3ee2ce48\") " pod="kuadrant-system/authorino-5d4b67c446-72xbk" Jul 06 18:00:58.279195 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:58.279173 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76c5494df8-gd828"] Jul 06 18:00:58.282423 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:58.282408 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76c5494df8-gd828" Jul 06 18:00:58.285247 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:58.285220 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h7q6\" (UniqueName: \"kubernetes.io/projected/22f9cdde-37f3-47a9-a1aa-996a3ee2ce48-kube-api-access-4h7q6\") pod \"authorino-5d4b67c446-72xbk\" (UID: \"22f9cdde-37f3-47a9-a1aa-996a3ee2ce48\") " pod="kuadrant-system/authorino-5d4b67c446-72xbk" Jul 06 18:00:58.293802 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:58.293776 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76c5494df8-gd828"] Jul 06 18:00:58.367786 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:58.367753 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76c5494df8-gd828"] Jul 06 18:00:58.368040 ip-10-0-130-37 kubenswrapper[2578]: E0706 18:00:58.368004 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-xmf9b], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-76c5494df8-gd828" podUID="27c2cdbe-d564-480d-9842-4237cb1550c1" Jul 06 18:00:58.376535 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:58.376511 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmf9b\" (UniqueName: \"kubernetes.io/projected/27c2cdbe-d564-480d-9842-4237cb1550c1-kube-api-access-xmf9b\") pod \"authorino-76c5494df8-gd828\" (UID: \"27c2cdbe-d564-480d-9842-4237cb1550c1\") " pod="kuadrant-system/authorino-76c5494df8-gd828" Jul 06 18:00:58.404039 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:58.403999 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-77cbdbd9d-vtfjr"] Jul 06 18:00:58.407323 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:58.407305 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77cbdbd9d-vtfjr" Jul 06 18:00:58.409771 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:58.409752 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 06 18:00:58.416180 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:58.416158 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77cbdbd9d-vtfjr"] Jul 06 18:00:58.477330 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:58.477296 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4b6b447f-ffb0-4c48-8fbe-fcb6570e316c-tls-cert\") pod \"authorino-77cbdbd9d-vtfjr\" (UID: \"4b6b447f-ffb0-4c48-8fbe-fcb6570e316c\") " pod="kuadrant-system/authorino-77cbdbd9d-vtfjr" Jul 06 18:00:58.477496 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:58.477334 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxd82\" (UniqueName: \"kubernetes.io/projected/4b6b447f-ffb0-4c48-8fbe-fcb6570e316c-kube-api-access-wxd82\") pod \"authorino-77cbdbd9d-vtfjr\" (UID: \"4b6b447f-ffb0-4c48-8fbe-fcb6570e316c\") " pod="kuadrant-system/authorino-77cbdbd9d-vtfjr" Jul 06 18:00:58.477496 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:58.477404 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmf9b\" (UniqueName: \"kubernetes.io/projected/27c2cdbe-d564-480d-9842-4237cb1550c1-kube-api-access-xmf9b\") pod \"authorino-76c5494df8-gd828\" (UID: \"27c2cdbe-d564-480d-9842-4237cb1550c1\") " pod="kuadrant-system/authorino-76c5494df8-gd828" Jul 06 18:00:58.486184 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:58.486161 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmf9b\" (UniqueName: \"kubernetes.io/projected/27c2cdbe-d564-480d-9842-4237cb1550c1-kube-api-access-xmf9b\") pod \"authorino-76c5494df8-gd828\" (UID: \"27c2cdbe-d564-480d-9842-4237cb1550c1\") " pod="kuadrant-system/authorino-76c5494df8-gd828" Jul 06 18:00:58.578419 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:58.578342 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4b6b447f-ffb0-4c48-8fbe-fcb6570e316c-tls-cert\") pod \"authorino-77cbdbd9d-vtfjr\" (UID: \"4b6b447f-ffb0-4c48-8fbe-fcb6570e316c\") " pod="kuadrant-system/authorino-77cbdbd9d-vtfjr" Jul 06 18:00:58.578419 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:58.578381 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxd82\" (UniqueName: \"kubernetes.io/projected/4b6b447f-ffb0-4c48-8fbe-fcb6570e316c-kube-api-access-wxd82\") pod \"authorino-77cbdbd9d-vtfjr\" (UID: \"4b6b447f-ffb0-4c48-8fbe-fcb6570e316c\") " pod="kuadrant-system/authorino-77cbdbd9d-vtfjr" Jul 06 18:00:58.580843 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:58.580806 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4b6b447f-ffb0-4c48-8fbe-fcb6570e316c-tls-cert\") pod \"authorino-77cbdbd9d-vtfjr\" (UID: \"4b6b447f-ffb0-4c48-8fbe-fcb6570e316c\") " pod="kuadrant-system/authorino-77cbdbd9d-vtfjr" Jul 06 18:00:58.586373 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:58.586351 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxd82\" (UniqueName: \"kubernetes.io/projected/4b6b447f-ffb0-4c48-8fbe-fcb6570e316c-kube-api-access-wxd82\") pod \"authorino-77cbdbd9d-vtfjr\" (UID: \"4b6b447f-ffb0-4c48-8fbe-fcb6570e316c\") " pod="kuadrant-system/authorino-77cbdbd9d-vtfjr" Jul 06 18:00:58.716657 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:58.716623 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77cbdbd9d-vtfjr" Jul 06 18:00:58.842103 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:58.842076 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77cbdbd9d-vtfjr"] Jul 06 18:00:58.843977 ip-10-0-130-37 kubenswrapper[2578]: W0706 18:00:58.843950 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b6b447f_ffb0_4c48_8fbe_fcb6570e316c.slice/crio-1a3e6b23df615b6b5a42267b377cc4ac6de3f2e13b34fbabd075d70854854ab6 WatchSource:0}: Error finding container 1a3e6b23df615b6b5a42267b377cc4ac6de3f2e13b34fbabd075d70854854ab6: Status 404 returned error can't find the container with id 1a3e6b23df615b6b5a42267b377cc4ac6de3f2e13b34fbabd075d70854854ab6 Jul 06 18:00:59.096714 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:59.096633 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77cbdbd9d-vtfjr" event={"ID":"4b6b447f-ffb0-4c48-8fbe-fcb6570e316c","Type":"ContainerStarted","Data":"1a3e6b23df615b6b5a42267b377cc4ac6de3f2e13b34fbabd075d70854854ab6"} Jul 06 18:00:59.096714 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:59.096653 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76c5494df8-gd828" Jul 06 18:00:59.096714 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:59.096666 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-72xbk" Jul 06 18:00:59.104558 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:59.104539 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76c5494df8-gd828" Jul 06 18:00:59.106439 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:59.106426 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-72xbk" Jul 06 18:00:59.183684 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:59.183633 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4h7q6\" (UniqueName: \"kubernetes.io/projected/22f9cdde-37f3-47a9-a1aa-996a3ee2ce48-kube-api-access-4h7q6\") pod \"22f9cdde-37f3-47a9-a1aa-996a3ee2ce48\" (UID: \"22f9cdde-37f3-47a9-a1aa-996a3ee2ce48\") " Jul 06 18:00:59.183854 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:59.183692 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmf9b\" (UniqueName: \"kubernetes.io/projected/27c2cdbe-d564-480d-9842-4237cb1550c1-kube-api-access-xmf9b\") pod \"27c2cdbe-d564-480d-9842-4237cb1550c1\" (UID: \"27c2cdbe-d564-480d-9842-4237cb1550c1\") " Jul 06 18:00:59.185631 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:59.185605 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22f9cdde-37f3-47a9-a1aa-996a3ee2ce48-kube-api-access-4h7q6" (OuterVolumeSpecName: "kube-api-access-4h7q6") pod "22f9cdde-37f3-47a9-a1aa-996a3ee2ce48" (UID: "22f9cdde-37f3-47a9-a1aa-996a3ee2ce48"). InnerVolumeSpecName "kube-api-access-4h7q6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:00:59.185631 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:59.185619 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27c2cdbe-d564-480d-9842-4237cb1550c1-kube-api-access-xmf9b" (OuterVolumeSpecName: "kube-api-access-xmf9b") pod "27c2cdbe-d564-480d-9842-4237cb1550c1" (UID: "27c2cdbe-d564-480d-9842-4237cb1550c1"). InnerVolumeSpecName "kube-api-access-xmf9b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:00:59.284290 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:59.284241 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4h7q6\" (UniqueName: \"kubernetes.io/projected/22f9cdde-37f3-47a9-a1aa-996a3ee2ce48-kube-api-access-4h7q6\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:00:59.284290 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:00:59.284283 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmf9b\" (UniqueName: \"kubernetes.io/projected/27c2cdbe-d564-480d-9842-4237cb1550c1-kube-api-access-xmf9b\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:01:00.101204 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:00.101179 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-72xbk" Jul 06 18:01:00.101517 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:00.101228 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76c5494df8-gd828" Jul 06 18:01:00.157588 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:00.157540 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-72xbk"] Jul 06 18:01:00.168360 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:00.168337 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-72xbk"] Jul 06 18:01:00.225301 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:00.225270 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76c5494df8-gd828"] Jul 06 18:01:00.228992 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:00.228962 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76c5494df8-gd828"] Jul 06 18:01:00.935307 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:00.935268 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22f9cdde-37f3-47a9-a1aa-996a3ee2ce48" path="/var/lib/kubelet/pods/22f9cdde-37f3-47a9-a1aa-996a3ee2ce48/volumes" Jul 06 18:01:00.935574 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:00.935556 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27c2cdbe-d564-480d-9842-4237cb1550c1" path="/var/lib/kubelet/pods/27c2cdbe-d564-480d-9842-4237cb1550c1/volumes" Jul 06 18:01:01.107477 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:01.107433 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77cbdbd9d-vtfjr" event={"ID":"4b6b447f-ffb0-4c48-8fbe-fcb6570e316c","Type":"ContainerStarted","Data":"3d9ef4b2cb79575b9dfa97d0e22b5848eb003fef93f9aee15962562299054241"} Jul 06 18:01:01.131579 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:01.131535 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-77cbdbd9d-vtfjr" podStartSLOduration=1.917028862 podStartE2EDuration="3.131520404s" totalImagesPullingTime="1.214491542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:01:01.130144037 +0000 UTC m=+581.814751009" watchObservedRunningTime="2026-07-06 18:01:01.131520404 +0000 UTC m=+581.816127402" Jul 06 18:01:01.160635 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:01.160603 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jknq4"] Jul 06 18:01:01.160808 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:01.160760 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-jknq4" podUID="d6113196-c769-44ec-bb21-20d1a014b3bd" containerName="authorino" containerID="cri-o://6d6a9eb889ced65b94ee17161e2f0c4d5c4ceb9ed2ca92bea595804a71fc7b94" gracePeriod=30 Jul 06 18:01:01.409266 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:01.409237 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jknq4" Jul 06 18:01:01.501751 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:01.501721 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g28wv\" (UniqueName: \"kubernetes.io/projected/d6113196-c769-44ec-bb21-20d1a014b3bd-kube-api-access-g28wv\") pod \"d6113196-c769-44ec-bb21-20d1a014b3bd\" (UID: \"d6113196-c769-44ec-bb21-20d1a014b3bd\") " Jul 06 18:01:01.503744 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:01.503713 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6113196-c769-44ec-bb21-20d1a014b3bd-kube-api-access-g28wv" (OuterVolumeSpecName: "kube-api-access-g28wv") pod "d6113196-c769-44ec-bb21-20d1a014b3bd" (UID: "d6113196-c769-44ec-bb21-20d1a014b3bd"). InnerVolumeSpecName "kube-api-access-g28wv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:01:01.602408 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:01.602326 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g28wv\" (UniqueName: \"kubernetes.io/projected/d6113196-c769-44ec-bb21-20d1a014b3bd-kube-api-access-g28wv\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:01:02.112639 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:02.112601 2578 generic.go:356] "Generic (PLEG): container finished" podID="d6113196-c769-44ec-bb21-20d1a014b3bd" containerID="6d6a9eb889ced65b94ee17161e2f0c4d5c4ceb9ed2ca92bea595804a71fc7b94" exitCode=0 Jul 06 18:01:02.112639 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:02.112641 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jknq4" Jul 06 18:01:02.113196 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:02.112685 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jknq4" event={"ID":"d6113196-c769-44ec-bb21-20d1a014b3bd","Type":"ContainerDied","Data":"6d6a9eb889ced65b94ee17161e2f0c4d5c4ceb9ed2ca92bea595804a71fc7b94"} Jul 06 18:01:02.113196 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:02.112721 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jknq4" event={"ID":"d6113196-c769-44ec-bb21-20d1a014b3bd","Type":"ContainerDied","Data":"2267047f36a30388f9634a1d337ab7a7be81e3916e0bdea4f21f73b0d855a285"} Jul 06 18:01:02.113196 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:02.112738 2578 scope.go:117] "RemoveContainer" containerID="6d6a9eb889ced65b94ee17161e2f0c4d5c4ceb9ed2ca92bea595804a71fc7b94" Jul 06 18:01:02.121378 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:02.121362 2578 scope.go:117] "RemoveContainer" containerID="6d6a9eb889ced65b94ee17161e2f0c4d5c4ceb9ed2ca92bea595804a71fc7b94" Jul 06 18:01:02.121630 ip-10-0-130-37 kubenswrapper[2578]: E0706 18:01:02.121611 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d6a9eb889ced65b94ee17161e2f0c4d5c4ceb9ed2ca92bea595804a71fc7b94\": container with ID starting with 6d6a9eb889ced65b94ee17161e2f0c4d5c4ceb9ed2ca92bea595804a71fc7b94 not found: ID does not exist" containerID="6d6a9eb889ced65b94ee17161e2f0c4d5c4ceb9ed2ca92bea595804a71fc7b94" Jul 06 18:01:02.121674 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:02.121641 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d6a9eb889ced65b94ee17161e2f0c4d5c4ceb9ed2ca92bea595804a71fc7b94"} err="failed to get container status \"6d6a9eb889ced65b94ee17161e2f0c4d5c4ceb9ed2ca92bea595804a71fc7b94\": rpc error: code = NotFound desc = could not find container \"6d6a9eb889ced65b94ee17161e2f0c4d5c4ceb9ed2ca92bea595804a71fc7b94\": container with ID starting with 6d6a9eb889ced65b94ee17161e2f0c4d5c4ceb9ed2ca92bea595804a71fc7b94 not found: ID does not exist" Jul 06 18:01:02.134157 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:02.134132 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jknq4"] Jul 06 18:01:02.139899 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:02.139879 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jknq4"] Jul 06 18:01:02.934910 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:02.934880 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6113196-c769-44ec-bb21-20d1a014b3bd" path="/var/lib/kubelet/pods/d6113196-c769-44ec-bb21-20d1a014b3bd/volumes" Jul 06 18:01:49.328088 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:49.328016 2578 generic.go:356] "Generic (PLEG): container finished" podID="df84e41f-b630-463d-be34-180d0fd49f80" containerID="707a587b6206de749459884de110041d729def0ae23aaf55ea97730ce2020256" exitCode=0 Jul 06 18:01:49.328666 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:49.328089 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" event={"ID":"df84e41f-b630-463d-be34-180d0fd49f80","Type":"ContainerDied","Data":"707a587b6206de749459884de110041d729def0ae23aaf55ea97730ce2020256"} Jul 06 18:01:49.328666 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:49.328457 2578 scope.go:117] "RemoveContainer" containerID="707a587b6206de749459884de110041d729def0ae23aaf55ea97730ce2020256" Jul 06 18:01:49.329449 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:49.329422 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:01:49.329552 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:49.329507 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:01:49.329611 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:49.329553 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:01:50.335320 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:50.335275 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" event={"ID":"df84e41f-b630-463d-be34-180d0fd49f80","Type":"ContainerStarted","Data":"78ef08bc2a3e7052426266be38479a296596554badad3503846ccd384367812e"} Jul 06 18:01:50.943868 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:50.943826 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:01:50.944096 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:50.943952 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5dfc694f5c-k589b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jul 06 18:01:50.944096 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:50.944000 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" podUID="df84e41f-b630-463d-be34-180d0fd49f80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jul 06 18:01:51.943525 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:51.943488 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5dfc694f5c-k589b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jul 06 18:01:51.944307 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:51.944275 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" podUID="df84e41f-b630-463d-be34-180d0fd49f80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jul 06 18:01:52.943813 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:52.943776 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5dfc694f5c-k589b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jul 06 18:01:52.944397 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:52.944354 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" podUID="df84e41f-b630-463d-be34-180d0fd49f80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jul 06 18:01:53.943321 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:53.943275 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5dfc694f5c-k589b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jul 06 18:01:53.943517 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:53.943344 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" podUID="df84e41f-b630-463d-be34-180d0fd49f80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jul 06 18:01:54.946686 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:54.946658 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:01:54.947100 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:54.946991 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:01:54.947659 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:01:54.947638 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5dfc694f5c-k589b" Jul 06 18:02:12.592391 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:12.592356 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf"] Jul 06 18:02:12.593483 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:12.593453 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6113196-c769-44ec-bb21-20d1a014b3bd" containerName="authorino" Jul 06 18:02:12.593483 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:12.593482 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6113196-c769-44ec-bb21-20d1a014b3bd" containerName="authorino" Jul 06 18:02:12.593670 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:12.593577 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6113196-c769-44ec-bb21-20d1a014b3bd" containerName="authorino" Jul 06 18:02:12.596895 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:12.596872 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf" Jul 06 18:02:12.601286 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:12.601263 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-l6szp\"" Jul 06 18:02:12.601493 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:12.601272 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 06 18:02:12.601585 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:12.601272 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 18:02:12.601641 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:12.601324 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 18:02:12.608764 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:12.608743 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf"] Jul 06 18:02:12.695996 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:12.695964 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f319be9c-4bea-4b59-bcbb-767112b3c0c8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mzvcf\" (UID: \"f319be9c-4bea-4b59-bcbb-767112b3c0c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf" Jul 06 18:02:12.696180 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:12.696008 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f319be9c-4bea-4b59-bcbb-767112b3c0c8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mzvcf\" (UID: \"f319be9c-4bea-4b59-bcbb-767112b3c0c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf" Jul 06 18:02:12.696180 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:12.696068 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f319be9c-4bea-4b59-bcbb-767112b3c0c8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mzvcf\" (UID: \"f319be9c-4bea-4b59-bcbb-767112b3c0c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf" Jul 06 18:02:12.696180 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:12.696123 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwnmb\" (UniqueName: \"kubernetes.io/projected/f319be9c-4bea-4b59-bcbb-767112b3c0c8-kube-api-access-qwnmb\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mzvcf\" (UID: \"f319be9c-4bea-4b59-bcbb-767112b3c0c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf" Jul 06 18:02:12.696286 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:12.696191 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f319be9c-4bea-4b59-bcbb-767112b3c0c8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mzvcf\" (UID: \"f319be9c-4bea-4b59-bcbb-767112b3c0c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf" Jul 06 18:02:12.696286 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:12.696213 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f319be9c-4bea-4b59-bcbb-767112b3c0c8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mzvcf\" (UID: \"f319be9c-4bea-4b59-bcbb-767112b3c0c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf" Jul 06 18:02:12.797260 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:12.797227 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f319be9c-4bea-4b59-bcbb-767112b3c0c8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mzvcf\" (UID: \"f319be9c-4bea-4b59-bcbb-767112b3c0c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf" Jul 06 18:02:12.797462 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:12.797285 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f319be9c-4bea-4b59-bcbb-767112b3c0c8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mzvcf\" (UID: \"f319be9c-4bea-4b59-bcbb-767112b3c0c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf" Jul 06 18:02:12.797462 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:12.797326 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f319be9c-4bea-4b59-bcbb-767112b3c0c8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mzvcf\" (UID: \"f319be9c-4bea-4b59-bcbb-767112b3c0c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf" Jul 06 18:02:12.797462 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:12.797350 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwnmb\" (UniqueName: \"kubernetes.io/projected/f319be9c-4bea-4b59-bcbb-767112b3c0c8-kube-api-access-qwnmb\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mzvcf\" (UID: \"f319be9c-4bea-4b59-bcbb-767112b3c0c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf" Jul 06 18:02:12.797462 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:12.797397 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f319be9c-4bea-4b59-bcbb-767112b3c0c8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mzvcf\" (UID: \"f319be9c-4bea-4b59-bcbb-767112b3c0c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf" Jul 06 18:02:12.797462 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:12.797423 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f319be9c-4bea-4b59-bcbb-767112b3c0c8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mzvcf\" (UID: \"f319be9c-4bea-4b59-bcbb-767112b3c0c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf" Jul 06 18:02:12.797754 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:12.797669 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f319be9c-4bea-4b59-bcbb-767112b3c0c8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mzvcf\" (UID: \"f319be9c-4bea-4b59-bcbb-767112b3c0c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf" Jul 06 18:02:12.797754 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:12.797736 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f319be9c-4bea-4b59-bcbb-767112b3c0c8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mzvcf\" (UID: \"f319be9c-4bea-4b59-bcbb-767112b3c0c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf" Jul 06 18:02:12.797862 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:12.797763 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f319be9c-4bea-4b59-bcbb-767112b3c0c8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mzvcf\" (UID: \"f319be9c-4bea-4b59-bcbb-767112b3c0c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf" Jul 06 18:02:12.799756 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:12.799732 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f319be9c-4bea-4b59-bcbb-767112b3c0c8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mzvcf\" (UID: \"f319be9c-4bea-4b59-bcbb-767112b3c0c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf" Jul 06 18:02:12.800071 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:12.800052 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f319be9c-4bea-4b59-bcbb-767112b3c0c8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mzvcf\" (UID: \"f319be9c-4bea-4b59-bcbb-767112b3c0c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf" Jul 06 18:02:12.805182 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:12.805158 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwnmb\" (UniqueName: \"kubernetes.io/projected/f319be9c-4bea-4b59-bcbb-767112b3c0c8-kube-api-access-qwnmb\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mzvcf\" (UID: \"f319be9c-4bea-4b59-bcbb-767112b3c0c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf" Jul 06 18:02:12.908477 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:12.908388 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf" Jul 06 18:02:13.050184 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:13.050158 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf"] Jul 06 18:02:13.052942 ip-10-0-130-37 kubenswrapper[2578]: W0706 18:02:13.052918 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf319be9c_4bea_4b59_bcbb_767112b3c0c8.slice/crio-405b65ea10a26ceb6f494420ab9864dad92816e27af2ec4053ee4904398a3582 WatchSource:0}: Error finding container 405b65ea10a26ceb6f494420ab9864dad92816e27af2ec4053ee4904398a3582: Status 404 returned error can't find the container with id 405b65ea10a26ceb6f494420ab9864dad92816e27af2ec4053ee4904398a3582 Jul 06 18:02:13.054297 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:13.054278 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 18:02:13.457858 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:13.457804 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf" event={"ID":"f319be9c-4bea-4b59-bcbb-767112b3c0c8","Type":"ContainerStarted","Data":"405b65ea10a26ceb6f494420ab9864dad92816e27af2ec4053ee4904398a3582"} Jul 06 18:02:14.464738 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:14.464703 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf" event={"ID":"f319be9c-4bea-4b59-bcbb-767112b3c0c8","Type":"ContainerStarted","Data":"569b2fd4bf000eb8ae5eed241eed9c0db0c839c7201f5ecef4c781c6437a0fe7"} Jul 06 18:02:14.484753 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:14.484710 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf" podStartSLOduration=1.260025834 podStartE2EDuration="2.484691793s" totalImagesPullingTime="1.224665959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:02:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:02:14.482296604 +0000 UTC m=+655.166903577" watchObservedRunningTime="2026-07-06 18:02:14.484691793 +0000 UTC m=+655.169298766" Jul 06 18:02:22.909351 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:22.909308 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf" Jul 06 18:02:22.909846 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:22.909385 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf" Jul 06 18:02:22.921272 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:22.921241 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf" Jul 06 18:02:23.092545 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:23.092512 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv"] Jul 06 18:02:23.100798 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:23.100768 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv" Jul 06 18:02:23.103523 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:23.103503 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 06 18:02:23.112331 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:23.112310 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv"] Jul 06 18:02:23.184683 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:23.184659 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/350a1045-a388-473e-8c60-9fa5d00cfe4b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-st5wv\" (UID: \"350a1045-a388-473e-8c60-9fa5d00cfe4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv" Jul 06 18:02:23.184859 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:23.184703 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/350a1045-a388-473e-8c60-9fa5d00cfe4b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-st5wv\" (UID: \"350a1045-a388-473e-8c60-9fa5d00cfe4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv" Jul 06 18:02:23.184859 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:23.184750 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/350a1045-a388-473e-8c60-9fa5d00cfe4b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-st5wv\" (UID: \"350a1045-a388-473e-8c60-9fa5d00cfe4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv" Jul 06 18:02:23.184859 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:23.184769 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/350a1045-a388-473e-8c60-9fa5d00cfe4b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-st5wv\" (UID: \"350a1045-a388-473e-8c60-9fa5d00cfe4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv" Jul 06 18:02:23.184859 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:23.184790 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/350a1045-a388-473e-8c60-9fa5d00cfe4b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-st5wv\" (UID: \"350a1045-a388-473e-8c60-9fa5d00cfe4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv" Jul 06 18:02:23.184859 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:23.184819 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlv72\" (UniqueName: \"kubernetes.io/projected/350a1045-a388-473e-8c60-9fa5d00cfe4b-kube-api-access-xlv72\") pod \"e2e-trlp-test-simulated-kserve-598466548d-st5wv\" (UID: \"350a1045-a388-473e-8c60-9fa5d00cfe4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv" Jul 06 18:02:23.285304 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:23.285271 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/350a1045-a388-473e-8c60-9fa5d00cfe4b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-st5wv\" (UID: \"350a1045-a388-473e-8c60-9fa5d00cfe4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv" Jul 06 18:02:23.285497 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:23.285318 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/350a1045-a388-473e-8c60-9fa5d00cfe4b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-st5wv\" (UID: \"350a1045-a388-473e-8c60-9fa5d00cfe4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv" Jul 06 18:02:23.285497 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:23.285354 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/350a1045-a388-473e-8c60-9fa5d00cfe4b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-st5wv\" (UID: \"350a1045-a388-473e-8c60-9fa5d00cfe4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv" Jul 06 18:02:23.285497 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:23.285373 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/350a1045-a388-473e-8c60-9fa5d00cfe4b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-st5wv\" (UID: \"350a1045-a388-473e-8c60-9fa5d00cfe4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv" Jul 06 18:02:23.285497 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:23.285393 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/350a1045-a388-473e-8c60-9fa5d00cfe4b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-st5wv\" (UID: \"350a1045-a388-473e-8c60-9fa5d00cfe4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv" Jul 06 18:02:23.285497 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:23.285432 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlv72\" (UniqueName: \"kubernetes.io/projected/350a1045-a388-473e-8c60-9fa5d00cfe4b-kube-api-access-xlv72\") pod \"e2e-trlp-test-simulated-kserve-598466548d-st5wv\" (UID: \"350a1045-a388-473e-8c60-9fa5d00cfe4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv" Jul 06 18:02:23.285870 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:23.285844 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/350a1045-a388-473e-8c60-9fa5d00cfe4b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-st5wv\" (UID: \"350a1045-a388-473e-8c60-9fa5d00cfe4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv" Jul 06 18:02:23.285937 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:23.285873 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/350a1045-a388-473e-8c60-9fa5d00cfe4b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-st5wv\" (UID: \"350a1045-a388-473e-8c60-9fa5d00cfe4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv" Jul 06 18:02:23.285937 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:23.285904 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/350a1045-a388-473e-8c60-9fa5d00cfe4b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-st5wv\" (UID: \"350a1045-a388-473e-8c60-9fa5d00cfe4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv" Jul 06 18:02:23.287684 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:23.287644 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/350a1045-a388-473e-8c60-9fa5d00cfe4b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-st5wv\" (UID: \"350a1045-a388-473e-8c60-9fa5d00cfe4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv" Jul 06 18:02:23.287845 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:23.287826 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/350a1045-a388-473e-8c60-9fa5d00cfe4b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-st5wv\" (UID: \"350a1045-a388-473e-8c60-9fa5d00cfe4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv" Jul 06 18:02:23.293202 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:23.293184 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlv72\" (UniqueName: \"kubernetes.io/projected/350a1045-a388-473e-8c60-9fa5d00cfe4b-kube-api-access-xlv72\") pod \"e2e-trlp-test-simulated-kserve-598466548d-st5wv\" (UID: \"350a1045-a388-473e-8c60-9fa5d00cfe4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv" Jul 06 18:02:23.411278 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:23.411245 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv" Jul 06 18:02:23.517012 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:23.516985 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mzvcf" Jul 06 18:02:23.542611 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:23.542586 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv"] Jul 06 18:02:23.545555 ip-10-0-130-37 kubenswrapper[2578]: W0706 18:02:23.545524 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod350a1045_a388_473e_8c60_9fa5d00cfe4b.slice/crio-950f544147c075b4e9df6c0debae72f05cc00200872cb717e96a0a904aeafab6 WatchSource:0}: Error finding container 950f544147c075b4e9df6c0debae72f05cc00200872cb717e96a0a904aeafab6: Status 404 returned error can't find the container with id 950f544147c075b4e9df6c0debae72f05cc00200872cb717e96a0a904aeafab6 Jul 06 18:02:24.510533 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:24.510499 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv" event={"ID":"350a1045-a388-473e-8c60-9fa5d00cfe4b","Type":"ContainerStarted","Data":"81763fc0a32e221a3c38be92d5c991c0e0eda9ea734040dadcf5b27418cb96ed"} Jul 06 18:02:24.510944 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:24.510553 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv" event={"ID":"350a1045-a388-473e-8c60-9fa5d00cfe4b","Type":"ContainerStarted","Data":"950f544147c075b4e9df6c0debae72f05cc00200872cb717e96a0a904aeafab6"} Jul 06 18:02:24.530337 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:24.530288 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv" podStartSLOduration=1.258835408 podStartE2EDuration="1.530274278s" totalImagesPullingTime="271.43887ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:02:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:02:24.529254175 +0000 UTC m=+665.213861162" watchObservedRunningTime="2026-07-06 18:02:24.530274278 +0000 UTC m=+665.214881250" Jul 06 18:02:33.411383 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:33.411348 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv" Jul 06 18:02:33.412058 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:33.411438 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv" Jul 06 18:02:33.423899 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:33.423876 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv" Jul 06 18:02:33.564056 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:33.564010 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-st5wv" Jul 06 18:02:59.601223 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:59.601186 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s"] Jul 06 18:02:59.603716 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:59.603697 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s" Jul 06 18:02:59.606505 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:59.606475 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 06 18:02:59.615800 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:59.615777 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s"] Jul 06 18:02:59.706331 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:59.706299 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69813dc9-45ef-46fa-8db5-6790a646110b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s\" (UID: \"69813dc9-45ef-46fa-8db5-6790a646110b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s" Jul 06 18:02:59.706331 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:59.706336 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69813dc9-45ef-46fa-8db5-6790a646110b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s\" (UID: \"69813dc9-45ef-46fa-8db5-6790a646110b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s" Jul 06 18:02:59.706574 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:59.706358 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69813dc9-45ef-46fa-8db5-6790a646110b-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s\" (UID: \"69813dc9-45ef-46fa-8db5-6790a646110b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s" Jul 06 18:02:59.706574 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:59.706443 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69813dc9-45ef-46fa-8db5-6790a646110b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s\" (UID: \"69813dc9-45ef-46fa-8db5-6790a646110b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s" Jul 06 18:02:59.706574 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:59.706480 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwlw7\" (UniqueName: \"kubernetes.io/projected/69813dc9-45ef-46fa-8db5-6790a646110b-kube-api-access-dwlw7\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s\" (UID: \"69813dc9-45ef-46fa-8db5-6790a646110b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s" Jul 06 18:02:59.706574 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:59.706562 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69813dc9-45ef-46fa-8db5-6790a646110b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s\" (UID: \"69813dc9-45ef-46fa-8db5-6790a646110b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s" Jul 06 18:02:59.807523 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:59.807474 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69813dc9-45ef-46fa-8db5-6790a646110b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s\" (UID: \"69813dc9-45ef-46fa-8db5-6790a646110b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s" Jul 06 18:02:59.807523 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:59.807525 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69813dc9-45ef-46fa-8db5-6790a646110b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s\" (UID: \"69813dc9-45ef-46fa-8db5-6790a646110b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s" Jul 06 18:02:59.807770 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:59.807650 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69813dc9-45ef-46fa-8db5-6790a646110b-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s\" (UID: \"69813dc9-45ef-46fa-8db5-6790a646110b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s" Jul 06 18:02:59.807770 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:59.807749 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69813dc9-45ef-46fa-8db5-6790a646110b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s\" (UID: \"69813dc9-45ef-46fa-8db5-6790a646110b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s" Jul 06 18:02:59.807862 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:59.807775 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwlw7\" (UniqueName: \"kubernetes.io/projected/69813dc9-45ef-46fa-8db5-6790a646110b-kube-api-access-dwlw7\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s\" (UID: \"69813dc9-45ef-46fa-8db5-6790a646110b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s" Jul 06 18:02:59.807862 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:59.807833 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69813dc9-45ef-46fa-8db5-6790a646110b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s\" (UID: \"69813dc9-45ef-46fa-8db5-6790a646110b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s" Jul 06 18:02:59.808164 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:59.808139 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69813dc9-45ef-46fa-8db5-6790a646110b-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s\" (UID: \"69813dc9-45ef-46fa-8db5-6790a646110b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s" Jul 06 18:02:59.808293 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:59.808203 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69813dc9-45ef-46fa-8db5-6790a646110b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s\" (UID: \"69813dc9-45ef-46fa-8db5-6790a646110b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s" Jul 06 18:02:59.808293 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:59.808259 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69813dc9-45ef-46fa-8db5-6790a646110b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s\" (UID: \"69813dc9-45ef-46fa-8db5-6790a646110b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s" Jul 06 18:02:59.809975 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:59.809955 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69813dc9-45ef-46fa-8db5-6790a646110b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s\" (UID: \"69813dc9-45ef-46fa-8db5-6790a646110b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s" Jul 06 18:02:59.810279 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:59.810260 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69813dc9-45ef-46fa-8db5-6790a646110b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s\" (UID: \"69813dc9-45ef-46fa-8db5-6790a646110b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s" Jul 06 18:02:59.817368 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:59.817344 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwlw7\" (UniqueName: \"kubernetes.io/projected/69813dc9-45ef-46fa-8db5-6790a646110b-kube-api-access-dwlw7\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s\" (UID: \"69813dc9-45ef-46fa-8db5-6790a646110b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s" Jul 06 18:02:59.913110 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:02:59.913062 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s" Jul 06 18:03:00.049360 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:03:00.049336 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s"] Jul 06 18:03:00.051515 ip-10-0-130-37 kubenswrapper[2578]: W0706 18:03:00.051484 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69813dc9_45ef_46fa_8db5_6790a646110b.slice/crio-77a1cd847d6b8afc8f85775fbf1dc55e9841925a9309db366a3267b1dcacdd6e WatchSource:0}: Error finding container 77a1cd847d6b8afc8f85775fbf1dc55e9841925a9309db366a3267b1dcacdd6e: Status 404 returned error can't find the container with id 77a1cd847d6b8afc8f85775fbf1dc55e9841925a9309db366a3267b1dcacdd6e Jul 06 18:03:00.682816 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:03:00.682779 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s" event={"ID":"69813dc9-45ef-46fa-8db5-6790a646110b","Type":"ContainerStarted","Data":"f97d4a1bf5343050ae424026fa1a46cfb5e87188613537962a8f728e4e8d92e5"} Jul 06 18:03:00.683226 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:03:00.682822 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s" event={"ID":"69813dc9-45ef-46fa-8db5-6790a646110b","Type":"ContainerStarted","Data":"77a1cd847d6b8afc8f85775fbf1dc55e9841925a9309db366a3267b1dcacdd6e"} Jul 06 18:03:00.705501 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:03:00.705455 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s" podStartSLOduration=1.480956211 podStartE2EDuration="1.705441838s" totalImagesPullingTime="224.485627ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:02:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:03:00.703785644 +0000 UTC m=+701.388392618" watchObservedRunningTime="2026-07-06 18:03:00.705441838 +0000 UTC m=+701.390048919" Jul 06 18:03:09.913888 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:03:09.913848 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s" Jul 06 18:03:09.914376 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:03:09.913900 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s" Jul 06 18:03:09.926439 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:03:09.926402 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s" Jul 06 18:03:10.741216 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:03:10.741181 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s" Jul 06 18:04:27.902478 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:27.902443 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bf5958d55-fvwkg"] Jul 06 18:04:27.905092 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:27.905075 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bf5958d55-fvwkg" Jul 06 18:04:27.917640 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:27.917617 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bf5958d55-fvwkg"] Jul 06 18:04:28.077704 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:28.077670 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmlj8\" (UniqueName: \"kubernetes.io/projected/cfdae435-11cd-4728-831b-ec7f388d5b0e-kube-api-access-zmlj8\") pod \"authorino-7bf5958d55-fvwkg\" (UID: \"cfdae435-11cd-4728-831b-ec7f388d5b0e\") " pod="kuadrant-system/authorino-7bf5958d55-fvwkg" Jul 06 18:04:28.077857 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:28.077734 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cfdae435-11cd-4728-831b-ec7f388d5b0e-tls-cert\") pod \"authorino-7bf5958d55-fvwkg\" (UID: \"cfdae435-11cd-4728-831b-ec7f388d5b0e\") " pod="kuadrant-system/authorino-7bf5958d55-fvwkg" Jul 06 18:04:28.178721 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:28.178694 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cfdae435-11cd-4728-831b-ec7f388d5b0e-tls-cert\") pod \"authorino-7bf5958d55-fvwkg\" (UID: \"cfdae435-11cd-4728-831b-ec7f388d5b0e\") " pod="kuadrant-system/authorino-7bf5958d55-fvwkg" Jul 06 18:04:28.178860 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:28.178761 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmlj8\" (UniqueName: \"kubernetes.io/projected/cfdae435-11cd-4728-831b-ec7f388d5b0e-kube-api-access-zmlj8\") pod \"authorino-7bf5958d55-fvwkg\" (UID: \"cfdae435-11cd-4728-831b-ec7f388d5b0e\") " pod="kuadrant-system/authorino-7bf5958d55-fvwkg" Jul 06 18:04:28.181081 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:28.181060 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cfdae435-11cd-4728-831b-ec7f388d5b0e-tls-cert\") pod \"authorino-7bf5958d55-fvwkg\" (UID: \"cfdae435-11cd-4728-831b-ec7f388d5b0e\") " pod="kuadrant-system/authorino-7bf5958d55-fvwkg" Jul 06 18:04:28.187222 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:28.187200 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmlj8\" (UniqueName: \"kubernetes.io/projected/cfdae435-11cd-4728-831b-ec7f388d5b0e-kube-api-access-zmlj8\") pod \"authorino-7bf5958d55-fvwkg\" (UID: \"cfdae435-11cd-4728-831b-ec7f388d5b0e\") " pod="kuadrant-system/authorino-7bf5958d55-fvwkg" Jul 06 18:04:28.214104 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:28.214083 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bf5958d55-fvwkg" Jul 06 18:04:28.344391 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:28.344360 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bf5958d55-fvwkg"] Jul 06 18:04:28.348167 ip-10-0-130-37 kubenswrapper[2578]: W0706 18:04:28.348139 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcfdae435_11cd_4728_831b_ec7f388d5b0e.slice/crio-1b9dac00930dd917e3c1c30123b4db55e647683afdb0cee84bf43bbec2563aea WatchSource:0}: Error finding container 1b9dac00930dd917e3c1c30123b4db55e647683afdb0cee84bf43bbec2563aea: Status 404 returned error can't find the container with id 1b9dac00930dd917e3c1c30123b4db55e647683afdb0cee84bf43bbec2563aea Jul 06 18:04:29.093647 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:29.093558 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bf5958d55-fvwkg" event={"ID":"cfdae435-11cd-4728-831b-ec7f388d5b0e","Type":"ContainerStarted","Data":"102cab2bd26715739e833a3021cdd826f836b0081fb95c8ceb7da79c6d52fdd0"} Jul 06 18:04:29.093647 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:29.093606 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bf5958d55-fvwkg" event={"ID":"cfdae435-11cd-4728-831b-ec7f388d5b0e","Type":"ContainerStarted","Data":"1b9dac00930dd917e3c1c30123b4db55e647683afdb0cee84bf43bbec2563aea"} Jul 06 18:04:29.117983 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:29.117908 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bf5958d55-fvwkg" podStartSLOduration=1.769707193 podStartE2EDuration="2.117885379s" totalImagesPullingTime="348.178186ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:04:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:04:29.115533804 +0000 UTC m=+789.800140779" watchObservedRunningTime="2026-07-06 18:04:29.117885379 +0000 UTC m=+789.802492376" Jul 06 18:04:29.156324 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:29.154665 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77cbdbd9d-vtfjr"] Jul 06 18:04:29.156324 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:29.154923 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-77cbdbd9d-vtfjr" podUID="4b6b447f-ffb0-4c48-8fbe-fcb6570e316c" containerName="authorino" containerID="cri-o://3d9ef4b2cb79575b9dfa97d0e22b5848eb003fef93f9aee15962562299054241" gracePeriod=30 Jul 06 18:04:29.411640 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:29.411609 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77cbdbd9d-vtfjr" Jul 06 18:04:29.591377 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:29.591342 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4b6b447f-ffb0-4c48-8fbe-fcb6570e316c-tls-cert\") pod \"4b6b447f-ffb0-4c48-8fbe-fcb6570e316c\" (UID: \"4b6b447f-ffb0-4c48-8fbe-fcb6570e316c\") " Jul 06 18:04:29.591546 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:29.591432 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxd82\" (UniqueName: \"kubernetes.io/projected/4b6b447f-ffb0-4c48-8fbe-fcb6570e316c-kube-api-access-wxd82\") pod \"4b6b447f-ffb0-4c48-8fbe-fcb6570e316c\" (UID: \"4b6b447f-ffb0-4c48-8fbe-fcb6570e316c\") " Jul 06 18:04:29.593466 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:29.593430 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b6b447f-ffb0-4c48-8fbe-fcb6570e316c-kube-api-access-wxd82" (OuterVolumeSpecName: "kube-api-access-wxd82") pod "4b6b447f-ffb0-4c48-8fbe-fcb6570e316c" (UID: "4b6b447f-ffb0-4c48-8fbe-fcb6570e316c"). InnerVolumeSpecName "kube-api-access-wxd82". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:04:29.601350 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:29.601324 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b6b447f-ffb0-4c48-8fbe-fcb6570e316c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "4b6b447f-ffb0-4c48-8fbe-fcb6570e316c" (UID: "4b6b447f-ffb0-4c48-8fbe-fcb6570e316c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 18:04:29.692427 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:29.692396 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxd82\" (UniqueName: \"kubernetes.io/projected/4b6b447f-ffb0-4c48-8fbe-fcb6570e316c-kube-api-access-wxd82\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:04:29.692427 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:29.692423 2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4b6b447f-ffb0-4c48-8fbe-fcb6570e316c-tls-cert\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:04:30.100047 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:30.099942 2578 generic.go:356] "Generic (PLEG): container finished" podID="4b6b447f-ffb0-4c48-8fbe-fcb6570e316c" containerID="3d9ef4b2cb79575b9dfa97d0e22b5848eb003fef93f9aee15962562299054241" exitCode=0 Jul 06 18:04:30.100047 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:30.099980 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77cbdbd9d-vtfjr" Jul 06 18:04:30.100047 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:30.100038 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77cbdbd9d-vtfjr" event={"ID":"4b6b447f-ffb0-4c48-8fbe-fcb6570e316c","Type":"ContainerDied","Data":"3d9ef4b2cb79575b9dfa97d0e22b5848eb003fef93f9aee15962562299054241"} Jul 06 18:04:30.100652 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:30.100077 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77cbdbd9d-vtfjr" event={"ID":"4b6b447f-ffb0-4c48-8fbe-fcb6570e316c","Type":"ContainerDied","Data":"1a3e6b23df615b6b5a42267b377cc4ac6de3f2e13b34fbabd075d70854854ab6"} Jul 06 18:04:30.100652 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:30.100094 2578 scope.go:117] "RemoveContainer" containerID="3d9ef4b2cb79575b9dfa97d0e22b5848eb003fef93f9aee15962562299054241" Jul 06 18:04:30.109197 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:30.109178 2578 scope.go:117] "RemoveContainer" containerID="3d9ef4b2cb79575b9dfa97d0e22b5848eb003fef93f9aee15962562299054241" Jul 06 18:04:30.109495 ip-10-0-130-37 kubenswrapper[2578]: E0706 18:04:30.109474 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d9ef4b2cb79575b9dfa97d0e22b5848eb003fef93f9aee15962562299054241\": container with ID starting with 3d9ef4b2cb79575b9dfa97d0e22b5848eb003fef93f9aee15962562299054241 not found: ID does not exist" containerID="3d9ef4b2cb79575b9dfa97d0e22b5848eb003fef93f9aee15962562299054241" Jul 06 18:04:30.109586 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:30.109515 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d9ef4b2cb79575b9dfa97d0e22b5848eb003fef93f9aee15962562299054241"} err="failed to get container status \"3d9ef4b2cb79575b9dfa97d0e22b5848eb003fef93f9aee15962562299054241\": rpc error: code = NotFound desc = could not find container \"3d9ef4b2cb79575b9dfa97d0e22b5848eb003fef93f9aee15962562299054241\": container with ID starting with 3d9ef4b2cb79575b9dfa97d0e22b5848eb003fef93f9aee15962562299054241 not found: ID does not exist" Jul 06 18:04:30.122904 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:30.122876 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77cbdbd9d-vtfjr"] Jul 06 18:04:30.127105 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:30.127079 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-77cbdbd9d-vtfjr"] Jul 06 18:04:30.935710 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:04:30.935666 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b6b447f-ffb0-4c48-8fbe-fcb6570e316c" path="/var/lib/kubelet/pods/4b6b447f-ffb0-4c48-8fbe-fcb6570e316c/volumes" Jul 06 18:06:19.826405 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:06:19.826324 2578 scope.go:117] "RemoveContainer" containerID="4faa50dee660e34dac2f458487983c88eb3c3a65f35c389c3359c977d77897e3" Jul 06 18:06:19.849688 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:06:19.849666 2578 scope.go:117] "RemoveContainer" containerID="0a948b8fb93877d025abda0f4890291aeb388f9d22fc1c6ab0f865ce883cf321" Jul 06 18:10:50.636076 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:10:50.635979 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rlgs9"] Jul 06 18:10:50.636631 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:10:50.636272 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rlgs9" podUID="65ab8864-4b09-4b03-8808-222e123b3f97" containerName="manager" containerID="cri-o://f92a3721e8260be0ccdf42d3bbcfd033b0a1ca3b4ed3487fab7075d4f516602e" gracePeriod=10 Jul 06 18:10:54.382208 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:10:54.382182 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rlgs9" Jul 06 18:10:54.425006 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:10:54.424963 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dt5fk\" (UniqueName: \"kubernetes.io/projected/65ab8864-4b09-4b03-8808-222e123b3f97-kube-api-access-dt5fk\") pod \"65ab8864-4b09-4b03-8808-222e123b3f97\" (UID: \"65ab8864-4b09-4b03-8808-222e123b3f97\") " Jul 06 18:10:54.425188 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:10:54.425012 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65ab8864-4b09-4b03-8808-222e123b3f97-extensions-socket-volume\") pod \"65ab8864-4b09-4b03-8808-222e123b3f97\" (UID: \"65ab8864-4b09-4b03-8808-222e123b3f97\") " Jul 06 18:10:54.425353 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:10:54.425330 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65ab8864-4b09-4b03-8808-222e123b3f97-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "65ab8864-4b09-4b03-8808-222e123b3f97" (UID: "65ab8864-4b09-4b03-8808-222e123b3f97"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:10:54.426965 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:10:54.426940 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65ab8864-4b09-4b03-8808-222e123b3f97-kube-api-access-dt5fk" (OuterVolumeSpecName: "kube-api-access-dt5fk") pod "65ab8864-4b09-4b03-8808-222e123b3f97" (UID: "65ab8864-4b09-4b03-8808-222e123b3f97"). InnerVolumeSpecName "kube-api-access-dt5fk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:10:54.526430 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:10:54.526343 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dt5fk\" (UniqueName: \"kubernetes.io/projected/65ab8864-4b09-4b03-8808-222e123b3f97-kube-api-access-dt5fk\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:10:54.526430 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:10:54.526385 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65ab8864-4b09-4b03-8808-222e123b3f97-extensions-socket-volume\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:10:54.881019 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:10:54.880928 2578 generic.go:356] "Generic (PLEG): container finished" podID="65ab8864-4b09-4b03-8808-222e123b3f97" containerID="f92a3721e8260be0ccdf42d3bbcfd033b0a1ca3b4ed3487fab7075d4f516602e" exitCode=0 Jul 06 18:10:54.881019 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:10:54.880967 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rlgs9" event={"ID":"65ab8864-4b09-4b03-8808-222e123b3f97","Type":"ContainerDied","Data":"f92a3721e8260be0ccdf42d3bbcfd033b0a1ca3b4ed3487fab7075d4f516602e"} Jul 06 18:10:54.881019 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:10:54.880977 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rlgs9" Jul 06 18:10:54.881019 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:10:54.881007 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rlgs9" event={"ID":"65ab8864-4b09-4b03-8808-222e123b3f97","Type":"ContainerDied","Data":"706766de5f8dfe4e7e4e86a1bd5754a0ffe3bf4635157d3a11b87a9c77070086"} Jul 06 18:10:54.881355 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:10:54.881045 2578 scope.go:117] "RemoveContainer" containerID="f92a3721e8260be0ccdf42d3bbcfd033b0a1ca3b4ed3487fab7075d4f516602e" Jul 06 18:10:54.890342 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:10:54.890325 2578 scope.go:117] "RemoveContainer" containerID="f92a3721e8260be0ccdf42d3bbcfd033b0a1ca3b4ed3487fab7075d4f516602e" Jul 06 18:10:54.890618 ip-10-0-130-37 kubenswrapper[2578]: E0706 18:10:54.890596 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f92a3721e8260be0ccdf42d3bbcfd033b0a1ca3b4ed3487fab7075d4f516602e\": container with ID starting with f92a3721e8260be0ccdf42d3bbcfd033b0a1ca3b4ed3487fab7075d4f516602e not found: ID does not exist" containerID="f92a3721e8260be0ccdf42d3bbcfd033b0a1ca3b4ed3487fab7075d4f516602e" Jul 06 18:10:54.890667 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:10:54.890627 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f92a3721e8260be0ccdf42d3bbcfd033b0a1ca3b4ed3487fab7075d4f516602e"} err="failed to get container status \"f92a3721e8260be0ccdf42d3bbcfd033b0a1ca3b4ed3487fab7075d4f516602e\": rpc error: code = NotFound desc = could not find container \"f92a3721e8260be0ccdf42d3bbcfd033b0a1ca3b4ed3487fab7075d4f516602e\": container with ID starting with f92a3721e8260be0ccdf42d3bbcfd033b0a1ca3b4ed3487fab7075d4f516602e not found: ID does not exist" Jul 06 18:10:54.920473 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:10:54.920447 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rlgs9"] Jul 06 18:10:54.925730 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:10:54.925709 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rlgs9"] Jul 06 18:10:54.934546 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:10:54.934525 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65ab8864-4b09-4b03-8808-222e123b3f97" path="/var/lib/kubelet/pods/65ab8864-4b09-4b03-8808-222e123b3f97/volumes" Jul 06 18:11:51.872283 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:11:51.872248 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvwml"] Jul 06 18:11:51.872742 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:11:51.872572 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65ab8864-4b09-4b03-8808-222e123b3f97" containerName="manager" Jul 06 18:11:51.872742 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:11:51.872582 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="65ab8864-4b09-4b03-8808-222e123b3f97" containerName="manager" Jul 06 18:11:51.872742 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:11:51.872591 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b6b447f-ffb0-4c48-8fbe-fcb6570e316c" containerName="authorino" Jul 06 18:11:51.872742 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:11:51.872596 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b6b447f-ffb0-4c48-8fbe-fcb6570e316c" containerName="authorino" Jul 06 18:11:51.872742 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:11:51.872652 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="65ab8864-4b09-4b03-8808-222e123b3f97" containerName="manager" Jul 06 18:11:51.872742 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:11:51.872660 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b6b447f-ffb0-4c48-8fbe-fcb6570e316c" containerName="authorino" Jul 06 18:11:51.875428 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:11:51.875412 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvwml" Jul 06 18:11:51.880166 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:11:51.880147 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-w2lq6\"" Jul 06 18:11:51.891651 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:11:51.891631 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvwml"] Jul 06 18:11:51.899877 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:11:51.899851 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2588a3c-3682-412f-ad1d-cf83dd0ee181-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wvwml\" (UID: \"f2588a3c-3682-412f-ad1d-cf83dd0ee181\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvwml" Jul 06 18:11:51.899998 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:11:51.899979 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mntzg\" (UniqueName: \"kubernetes.io/projected/f2588a3c-3682-412f-ad1d-cf83dd0ee181-kube-api-access-mntzg\") pod \"kuadrant-operator-controller-manager-86878c769f-wvwml\" (UID: \"f2588a3c-3682-412f-ad1d-cf83dd0ee181\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvwml" Jul 06 18:11:52.000693 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:11:52.000655 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2588a3c-3682-412f-ad1d-cf83dd0ee181-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wvwml\" (UID: \"f2588a3c-3682-412f-ad1d-cf83dd0ee181\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvwml" Jul 06 18:11:52.000871 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:11:52.000758 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mntzg\" (UniqueName: \"kubernetes.io/projected/f2588a3c-3682-412f-ad1d-cf83dd0ee181-kube-api-access-mntzg\") pod \"kuadrant-operator-controller-manager-86878c769f-wvwml\" (UID: \"f2588a3c-3682-412f-ad1d-cf83dd0ee181\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvwml" Jul 06 18:11:52.001148 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:11:52.001122 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2588a3c-3682-412f-ad1d-cf83dd0ee181-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wvwml\" (UID: \"f2588a3c-3682-412f-ad1d-cf83dd0ee181\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvwml" Jul 06 18:11:52.011940 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:11:52.011919 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mntzg\" (UniqueName: \"kubernetes.io/projected/f2588a3c-3682-412f-ad1d-cf83dd0ee181-kube-api-access-mntzg\") pod \"kuadrant-operator-controller-manager-86878c769f-wvwml\" (UID: \"f2588a3c-3682-412f-ad1d-cf83dd0ee181\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvwml" Jul 06 18:11:52.185307 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:11:52.185279 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvwml" Jul 06 18:11:52.321674 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:11:52.321648 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvwml"] Jul 06 18:11:52.323769 ip-10-0-130-37 kubenswrapper[2578]: W0706 18:11:52.323743 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2588a3c_3682_412f_ad1d_cf83dd0ee181.slice/crio-609f4675f960d151d0bb0b18709d8935d20c60d04c06c0c293158c0351c910df WatchSource:0}: Error finding container 609f4675f960d151d0bb0b18709d8935d20c60d04c06c0c293158c0351c910df: Status 404 returned error can't find the container with id 609f4675f960d151d0bb0b18709d8935d20c60d04c06c0c293158c0351c910df Jul 06 18:11:53.144934 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:11:53.144894 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvwml" event={"ID":"f2588a3c-3682-412f-ad1d-cf83dd0ee181","Type":"ContainerStarted","Data":"b6662ccc6bdd36d0d8f169209a156c3e1cb4d6fb2ba4b5f990c6c7f33f1eca83"} Jul 06 18:11:53.145451 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:11:53.144955 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvwml" event={"ID":"f2588a3c-3682-412f-ad1d-cf83dd0ee181","Type":"ContainerStarted","Data":"609f4675f960d151d0bb0b18709d8935d20c60d04c06c0c293158c0351c910df"} Jul 06 18:11:53.145451 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:11:53.145046 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvwml" Jul 06 18:11:53.172769 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:11:53.172716 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvwml" podStartSLOduration=2.172702343 podStartE2EDuration="2.172702343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:11:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:11:53.169804635 +0000 UTC m=+1233.854411629" watchObservedRunningTime="2026-07-06 18:11:53.172702343 +0000 UTC m=+1233.857309315" Jul 06 18:12:04.152338 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:12:04.152306 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wvwml" Jul 06 18:14:40.026818 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:14:40.026774 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kube-system/konnectivity-agent-vg7jb" podUID="ba941728-b986-47c7-b4d9-468ccf455c1f" containerName="konnectivity-agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 18:14:40.027333 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:14:40.026880 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vg7jb" Jul 06 18:14:40.027655 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:14:40.027628 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kube-system/konnectivity-agent-vg7jb" podUID="ba941728-b986-47c7-b4d9-468ccf455c1f" containerName="konnectivity-agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 18:15:10.028083 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:15:10.028050 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vg7jb" Jul 06 18:18:26.296441 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.296369 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm"] Jul 06 18:18:26.299896 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.299879 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:26.302682 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.302665 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-341d8081-openshift-default-dockercfg-rsb6z\"" Jul 06 18:18:26.322825 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.322799 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm"] Jul 06 18:18:26.400130 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.400093 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cmnc\" (UniqueName: \"kubernetes.io/projected/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-kube-api-access-7cmnc\") pod \"e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:26.400130 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.400127 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-workload-certs\") pod \"e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:26.400358 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.400144 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istio-token\") pod \"e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:26.400358 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.400234 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istio-podinfo\") pod \"e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:26.400358 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.400250 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istiod-ca-cert\") pod \"e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:26.400358 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.400303 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istio-envoy\") pod \"e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:26.400358 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.400339 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-workload-socket\") pod \"e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:26.400624 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.400362 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-credential-socket\") pod \"e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:26.400624 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.400377 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istio-data\") pod \"e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:26.500973 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.500941 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istio-podinfo\") pod \"e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:26.500973 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.500974 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istiod-ca-cert\") pod \"e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:26.501188 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.500991 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istio-envoy\") pod \"e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:26.501188 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.501108 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-workload-socket\") pod \"e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:26.501188 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.501144 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-credential-socket\") pod \"e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:26.501188 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.501161 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istio-data\") pod \"e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:26.501375 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.501199 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cmnc\" (UniqueName: \"kubernetes.io/projected/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-kube-api-access-7cmnc\") pod \"e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:26.501375 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.501228 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-workload-certs\") pod \"e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:26.501537 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.501514 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istio-token\") pod \"e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:26.501625 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.501541 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-credential-socket\") pod \"e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:26.501625 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.501585 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-workload-socket\") pod \"e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:26.501698 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.501621 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istio-data\") pod \"e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:26.501845 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.501817 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istiod-ca-cert\") pod \"e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:26.501845 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.501833 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-workload-certs\") pod \"e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:26.503398 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.503375 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istio-envoy\") pod \"e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:26.503488 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.503470 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istio-podinfo\") pod \"e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:26.511734 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.511712 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istio-token\") pod \"e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:26.511827 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.511780 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cmnc\" (UniqueName: \"kubernetes.io/projected/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-kube-api-access-7cmnc\") pod \"e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:26.611850 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.611779 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:26.748007 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.747985 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm"] Jul 06 18:18:26.749728 ip-10-0-130-37 kubenswrapper[2578]: W0706 18:18:26.749700 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf77b6cf1_2cab_43d8_a15a_a64dca8e2222.slice/crio-afd94a1deb8b0ab872c10c64f44b23608747c9ee4bd8b4a4e0e5947f98a0fdad WatchSource:0}: Error finding container afd94a1deb8b0ab872c10c64f44b23608747c9ee4bd8b4a4e0e5947f98a0fdad: Status 404 returned error can't find the container with id afd94a1deb8b0ab872c10c64f44b23608747c9ee4bd8b4a4e0e5947f98a0fdad Jul 06 18:18:26.751728 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.751695 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:18:26.751799 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.751761 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:18:26.751799 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.751787 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:18:26.968857 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.968806 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" event={"ID":"f77b6cf1-2cab-43d8-a15a-a64dca8e2222","Type":"ContainerStarted","Data":"7535d263b2cbad2603afed4c2217a6bb058b9170d792dae47d5712e818a3e0dc"} Jul 06 18:18:26.969069 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.968875 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" event={"ID":"f77b6cf1-2cab-43d8-a15a-a64dca8e2222","Type":"ContainerStarted","Data":"afd94a1deb8b0ab872c10c64f44b23608747c9ee4bd8b4a4e0e5947f98a0fdad"} Jul 06 18:18:26.992161 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:26.992111 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" podStartSLOduration=0.992093825 podStartE2EDuration="992.093825ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:18:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:18:26.990779385 +0000 UTC m=+1627.675386375" watchObservedRunningTime="2026-07-06 18:18:26.992093825 +0000 UTC m=+1627.676700826" Jul 06 18:18:27.612096 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:27.612063 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:27.620749 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:27.620713 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:27.974181 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:27.974149 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:27.975163 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:27.975144 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:32.947506 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:32.947473 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm"] Jul 06 18:18:32.947999 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:32.947705 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" podUID="f77b6cf1-2cab-43d8-a15a-a64dca8e2222" containerName="istio-proxy" containerID="cri-o://7535d263b2cbad2603afed4c2217a6bb058b9170d792dae47d5712e818a3e0dc" gracePeriod=30 Jul 06 18:18:38.709654 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:38.709625 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:38.831180 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:38.831095 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istio-data\") pod \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " Jul 06 18:18:38.831180 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:38.831154 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-workload-certs\") pod \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " Jul 06 18:18:38.831409 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:38.831184 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istiod-ca-cert\") pod \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " Jul 06 18:18:38.831409 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:38.831216 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cmnc\" (UniqueName: \"kubernetes.io/projected/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-kube-api-access-7cmnc\") pod \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " Jul 06 18:18:38.831409 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:38.831243 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-workload-socket\") pod \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " Jul 06 18:18:38.831409 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:38.831286 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istio-podinfo\") pod \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " Jul 06 18:18:38.831409 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:38.831349 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istio-envoy\") pod \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " Jul 06 18:18:38.831409 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:38.831399 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-credential-socket\") pod \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " Jul 06 18:18:38.832559 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:38.831429 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istio-token\") pod \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\" (UID: \"f77b6cf1-2cab-43d8-a15a-a64dca8e2222\") " Jul 06 18:18:38.832559 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:38.831474 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f77b6cf1-2cab-43d8-a15a-a64dca8e2222" (UID: "f77b6cf1-2cab-43d8-a15a-a64dca8e2222"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:18:38.832559 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:38.831637 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f77b6cf1-2cab-43d8-a15a-a64dca8e2222" (UID: "f77b6cf1-2cab-43d8-a15a-a64dca8e2222"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:18:38.832559 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:38.831779 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-workload-certs\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:18:38.832559 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:38.831797 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istiod-ca-cert\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:18:38.832559 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:38.831840 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istio-data" (OuterVolumeSpecName: "istio-data") pod "f77b6cf1-2cab-43d8-a15a-a64dca8e2222" (UID: "f77b6cf1-2cab-43d8-a15a-a64dca8e2222"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:18:38.832559 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:38.832110 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f77b6cf1-2cab-43d8-a15a-a64dca8e2222" (UID: "f77b6cf1-2cab-43d8-a15a-a64dca8e2222"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:18:38.832559 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:38.832257 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f77b6cf1-2cab-43d8-a15a-a64dca8e2222" (UID: "f77b6cf1-2cab-43d8-a15a-a64dca8e2222"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:18:38.833966 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:38.833927 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f77b6cf1-2cab-43d8-a15a-a64dca8e2222" (UID: "f77b6cf1-2cab-43d8-a15a-a64dca8e2222"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 18:18:38.834094 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:38.834054 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istio-token" (OuterVolumeSpecName: "istio-token") pod "f77b6cf1-2cab-43d8-a15a-a64dca8e2222" (UID: "f77b6cf1-2cab-43d8-a15a-a64dca8e2222"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:18:38.834158 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:38.834130 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-kube-api-access-7cmnc" (OuterVolumeSpecName: "kube-api-access-7cmnc") pod "f77b6cf1-2cab-43d8-a15a-a64dca8e2222" (UID: "f77b6cf1-2cab-43d8-a15a-a64dca8e2222"). InnerVolumeSpecName "kube-api-access-7cmnc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:18:38.834224 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:38.834189 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f77b6cf1-2cab-43d8-a15a-a64dca8e2222" (UID: "f77b6cf1-2cab-43d8-a15a-a64dca8e2222"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:18:38.932248 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:38.932223 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istio-data\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:18:38.932248 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:38.932246 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cmnc\" (UniqueName: \"kubernetes.io/projected/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-kube-api-access-7cmnc\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:18:38.932405 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:38.932256 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-workload-socket\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:18:38.932405 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:38.932265 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istio-podinfo\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:18:38.932405 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:38.932273 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istio-envoy\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:18:38.932405 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:38.932280 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-credential-socket\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:18:38.932405 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:38.932291 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f77b6cf1-2cab-43d8-a15a-a64dca8e2222-istio-token\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:18:39.026614 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.026576 2578 generic.go:356] "Generic (PLEG): container finished" podID="f77b6cf1-2cab-43d8-a15a-a64dca8e2222" containerID="7535d263b2cbad2603afed4c2217a6bb058b9170d792dae47d5712e818a3e0dc" exitCode=0 Jul 06 18:18:39.026805 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.026620 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" Jul 06 18:18:39.026805 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.026662 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" event={"ID":"f77b6cf1-2cab-43d8-a15a-a64dca8e2222","Type":"ContainerDied","Data":"7535d263b2cbad2603afed4c2217a6bb058b9170d792dae47d5712e818a3e0dc"} Jul 06 18:18:39.026805 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.026719 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm" event={"ID":"f77b6cf1-2cab-43d8-a15a-a64dca8e2222","Type":"ContainerDied","Data":"afd94a1deb8b0ab872c10c64f44b23608747c9ee4bd8b4a4e0e5947f98a0fdad"} Jul 06 18:18:39.026805 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.026749 2578 scope.go:117] "RemoveContainer" containerID="7535d263b2cbad2603afed4c2217a6bb058b9170d792dae47d5712e818a3e0dc" Jul 06 18:18:39.035581 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.035563 2578 scope.go:117] "RemoveContainer" containerID="7535d263b2cbad2603afed4c2217a6bb058b9170d792dae47d5712e818a3e0dc" Jul 06 18:18:39.035843 ip-10-0-130-37 kubenswrapper[2578]: E0706 18:18:39.035818 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7535d263b2cbad2603afed4c2217a6bb058b9170d792dae47d5712e818a3e0dc\": container with ID starting with 7535d263b2cbad2603afed4c2217a6bb058b9170d792dae47d5712e818a3e0dc not found: ID does not exist" containerID="7535d263b2cbad2603afed4c2217a6bb058b9170d792dae47d5712e818a3e0dc" Jul 06 18:18:39.035898 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.035854 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7535d263b2cbad2603afed4c2217a6bb058b9170d792dae47d5712e818a3e0dc"} err="failed to get container status \"7535d263b2cbad2603afed4c2217a6bb058b9170d792dae47d5712e818a3e0dc\": rpc error: code = NotFound desc = could not find container \"7535d263b2cbad2603afed4c2217a6bb058b9170d792dae47d5712e818a3e0dc\": container with ID starting with 7535d263b2cbad2603afed4c2217a6bb058b9170d792dae47d5712e818a3e0dc not found: ID does not exist" Jul 06 18:18:39.043507 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.043487 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm"] Jul 06 18:18:39.048296 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.048274 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-341d8081-openshift-default-f4dc5c57c-nxvqm"] Jul 06 18:18:39.664986 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.664954 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2"] Jul 06 18:18:39.665345 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.665326 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f77b6cf1-2cab-43d8-a15a-a64dca8e2222" containerName="istio-proxy" Jul 06 18:18:39.665345 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.665344 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f77b6cf1-2cab-43d8-a15a-a64dca8e2222" containerName="istio-proxy" Jul 06 18:18:39.665507 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.665411 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f77b6cf1-2cab-43d8-a15a-a64dca8e2222" containerName="istio-proxy" Jul 06 18:18:39.668271 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.668248 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:39.671039 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.671002 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a68cb1d3-openshift-default-dockercfg-8jdsj\"" Jul 06 18:18:39.684876 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.684851 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2"] Jul 06 18:18:39.737248 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.737219 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istiod-ca-cert\") pod \"e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:39.737248 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.737249 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istio-podinfo\") pod \"e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:39.737644 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.737303 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-credential-socket\") pod \"e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:39.737644 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.737335 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-workload-certs\") pod \"e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:39.737644 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.737364 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istio-envoy\") pod \"e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:39.737644 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.737388 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ngm9\" (UniqueName: \"kubernetes.io/projected/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-kube-api-access-2ngm9\") pod \"e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:39.737644 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.737412 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istio-token\") pod \"e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:39.737644 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.737440 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-workload-socket\") pod \"e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:39.737644 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.737462 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istio-data\") pod \"e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:39.838477 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.838439 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-workload-socket\") pod \"e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:39.838656 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.838486 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istio-data\") pod \"e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:39.838656 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.838520 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istiod-ca-cert\") pod \"e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:39.838656 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.838544 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istio-podinfo\") pod \"e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:39.838656 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.838597 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-credential-socket\") pod \"e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:39.838656 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.838642 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-workload-certs\") pod \"e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:39.838907 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.838676 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istio-envoy\") pod \"e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:39.838907 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.838701 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ngm9\" (UniqueName: \"kubernetes.io/projected/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-kube-api-access-2ngm9\") pod \"e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:39.838907 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.838805 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istio-token\") pod \"e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:39.838907 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.838883 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-workload-socket\") pod \"e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:39.839127 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.838988 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istio-data\") pod \"e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:39.839127 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.839001 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-credential-socket\") pod \"e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:39.839233 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.839165 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-workload-certs\") pod \"e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:39.839427 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.839405 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istiod-ca-cert\") pod \"e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:39.841070 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.841048 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istio-podinfo\") pod \"e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:39.841155 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.841078 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istio-envoy\") pod \"e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:39.847017 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.846984 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istio-token\") pod \"e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:39.847194 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.847175 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ngm9\" (UniqueName: \"kubernetes.io/projected/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-kube-api-access-2ngm9\") pod \"e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:39.979513 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:39.979481 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:40.116415 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:40.116386 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2"] Jul 06 18:18:40.118062 ip-10-0-130-37 kubenswrapper[2578]: W0706 18:18:40.118032 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod297dd056_4e24_40b1_a417_c1fdaa9f4e2c.slice/crio-6df888c1411a7f8ad75d82c69f8296afe247f2e11e7a025949c6abaa86ab9820 WatchSource:0}: Error finding container 6df888c1411a7f8ad75d82c69f8296afe247f2e11e7a025949c6abaa86ab9820: Status 404 returned error can't find the container with id 6df888c1411a7f8ad75d82c69f8296afe247f2e11e7a025949c6abaa86ab9820 Jul 06 18:18:40.120157 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:40.120128 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:18:40.120235 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:40.120186 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:18:40.120235 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:40.120215 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:18:40.936325 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:40.936288 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f77b6cf1-2cab-43d8-a15a-a64dca8e2222" path="/var/lib/kubelet/pods/f77b6cf1-2cab-43d8-a15a-a64dca8e2222/volumes" Jul 06 18:18:41.043954 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:41.043912 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" event={"ID":"297dd056-4e24-40b1-a417-c1fdaa9f4e2c","Type":"ContainerStarted","Data":"4a8100c2d2064f0cf327961c7183df0772e5fda4cf4d76f06d4479d8ae0d09c5"} Jul 06 18:18:41.044162 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:41.043975 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" event={"ID":"297dd056-4e24-40b1-a417-c1fdaa9f4e2c","Type":"ContainerStarted","Data":"6df888c1411a7f8ad75d82c69f8296afe247f2e11e7a025949c6abaa86ab9820"} Jul 06 18:18:41.068809 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:41.068762 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" podStartSLOduration=2.068746441 podStartE2EDuration="2.068746441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:18:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:18:41.067315941 +0000 UTC m=+1641.751922944" watchObservedRunningTime="2026-07-06 18:18:41.068746441 +0000 UTC m=+1641.753353413" Jul 06 18:18:41.979614 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:41.979572 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:41.984172 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:41.984151 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:42.049204 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:42.049169 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:42.050123 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:42.050103 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:51.095194 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:51.095156 2578 generic.go:356] "Generic (PLEG): container finished" podID="297dd056-4e24-40b1-a417-c1fdaa9f4e2c" containerID="4a8100c2d2064f0cf327961c7183df0772e5fda4cf4d76f06d4479d8ae0d09c5" exitCode=0 Jul 06 18:18:51.095611 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:51.095236 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" event={"ID":"297dd056-4e24-40b1-a417-c1fdaa9f4e2c","Type":"ContainerDied","Data":"4a8100c2d2064f0cf327961c7183df0772e5fda4cf4d76f06d4479d8ae0d09c5"} Jul 06 18:18:51.095662 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:51.095630 2578 scope.go:117] "RemoveContainer" containerID="4a8100c2d2064f0cf327961c7183df0772e5fda4cf4d76f06d4479d8ae0d09c5" Jul 06 18:18:51.096680 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:51.096655 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:18:51.096747 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:51.096719 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:18:51.096798 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:51.096749 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:18:52.101277 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:52.101246 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" event={"ID":"297dd056-4e24-40b1-a417-c1fdaa9f4e2c","Type":"ContainerStarted","Data":"e823bee4e641acf37189165bc0d1fd3d78b28d7158309c22e40d156ab4c027d5"} Jul 06 18:18:52.101673 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:52.101612 2578 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" secret="" err="secret \"e2e-ait-a68cb1d3-openshift-default-dockercfg-8jdsj\" not found" Jul 06 18:18:52.109365 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:52.109342 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2"] Jul 06 18:18:52.980332 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:52.980294 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:52.984855 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:52.984832 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:53.106123 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:53.106079 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" podUID="297dd056-4e24-40b1-a417-c1fdaa9f4e2c" containerName="istio-proxy" containerID="cri-o://e823bee4e641acf37189165bc0d1fd3d78b28d7158309c22e40d156ab4c027d5" gracePeriod=30 Jul 06 18:18:53.106499 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:53.106174 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:53.107171 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:53.107147 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:58.361349 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.361326 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:58.497855 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.497822 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f"] Jul 06 18:18:58.498189 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.498174 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="297dd056-4e24-40b1-a417-c1fdaa9f4e2c" containerName="istio-proxy" Jul 06 18:18:58.498189 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.498191 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="297dd056-4e24-40b1-a417-c1fdaa9f4e2c" containerName="istio-proxy" Jul 06 18:18:58.498323 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.498261 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="297dd056-4e24-40b1-a417-c1fdaa9f4e2c" containerName="istio-proxy" Jul 06 18:18:58.498323 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.498269 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="297dd056-4e24-40b1-a417-c1fdaa9f4e2c" containerName="istio-proxy" Jul 06 18:18:58.500423 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.500404 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:58.503240 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.503214 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-bce7a316-openshift-default-dockercfg-jb8z2\"" Jul 06 18:18:58.512733 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.512353 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istio-token\") pod \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " Jul 06 18:18:58.512733 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.512414 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istio-data\") pod \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " Jul 06 18:18:58.512733 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.512471 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-credential-socket\") pod \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " Jul 06 18:18:58.512733 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.512521 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-workload-certs\") pod \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " Jul 06 18:18:58.512733 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.512548 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istio-podinfo\") pod \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " Jul 06 18:18:58.512733 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.512573 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istio-envoy\") pod \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " Jul 06 18:18:58.512733 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.512636 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ngm9\" (UniqueName: \"kubernetes.io/projected/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-kube-api-access-2ngm9\") pod \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " Jul 06 18:18:58.512733 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.512699 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istiod-ca-cert\") pod \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " Jul 06 18:18:58.512733 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.512726 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-workload-socket\") pod \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\" (UID: \"297dd056-4e24-40b1-a417-c1fdaa9f4e2c\") " Jul 06 18:18:58.513306 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.513261 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "297dd056-4e24-40b1-a417-c1fdaa9f4e2c" (UID: "297dd056-4e24-40b1-a417-c1fdaa9f4e2c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:18:58.513734 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.513487 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "297dd056-4e24-40b1-a417-c1fdaa9f4e2c" (UID: "297dd056-4e24-40b1-a417-c1fdaa9f4e2c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:18:58.513734 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.513568 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "297dd056-4e24-40b1-a417-c1fdaa9f4e2c" (UID: "297dd056-4e24-40b1-a417-c1fdaa9f4e2c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:18:58.513919 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.513798 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "297dd056-4e24-40b1-a417-c1fdaa9f4e2c" (UID: "297dd056-4e24-40b1-a417-c1fdaa9f4e2c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:18:58.514556 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.514526 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istio-data" (OuterVolumeSpecName: "istio-data") pod "297dd056-4e24-40b1-a417-c1fdaa9f4e2c" (UID: "297dd056-4e24-40b1-a417-c1fdaa9f4e2c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:18:58.514731 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.514709 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f"] Jul 06 18:18:58.515320 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.515295 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istio-token" (OuterVolumeSpecName: "istio-token") pod "297dd056-4e24-40b1-a417-c1fdaa9f4e2c" (UID: "297dd056-4e24-40b1-a417-c1fdaa9f4e2c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:18:58.515876 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.515850 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "297dd056-4e24-40b1-a417-c1fdaa9f4e2c" (UID: "297dd056-4e24-40b1-a417-c1fdaa9f4e2c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 18:18:58.516611 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.516552 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "297dd056-4e24-40b1-a417-c1fdaa9f4e2c" (UID: "297dd056-4e24-40b1-a417-c1fdaa9f4e2c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:18:58.516714 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.516596 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-kube-api-access-2ngm9" (OuterVolumeSpecName: "kube-api-access-2ngm9") pod "297dd056-4e24-40b1-a417-c1fdaa9f4e2c" (UID: "297dd056-4e24-40b1-a417-c1fdaa9f4e2c"). InnerVolumeSpecName "kube-api-access-2ngm9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:18:58.614528 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.614495 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istio-token\") pod \"e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:58.614528 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.614541 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istio-podinfo\") pod \"e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:58.614732 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.614564 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-workload-socket\") pod \"e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:58.614732 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.614639 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istio-envoy\") pod \"e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:58.614732 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.614668 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr7cd\" (UniqueName: \"kubernetes.io/projected/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-kube-api-access-dr7cd\") pod \"e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:58.614732 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.614694 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-workload-certs\") pod \"e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:58.614732 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.614712 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istiod-ca-cert\") pod \"e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:58.614889 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.614754 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-credential-socket\") pod \"e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:58.614889 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.614821 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istio-data\") pod \"e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:58.614889 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.614884 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istiod-ca-cert\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:18:58.614982 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.614894 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-workload-socket\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:18:58.614982 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.614909 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istio-token\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:18:58.614982 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.614919 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istio-data\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:18:58.614982 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.614928 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-credential-socket\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:18:58.614982 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.614936 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-workload-certs\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:18:58.614982 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.614943 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istio-podinfo\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:18:58.614982 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.614950 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-istio-envoy\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:18:58.614982 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.614960 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ngm9\" (UniqueName: \"kubernetes.io/projected/297dd056-4e24-40b1-a417-c1fdaa9f4e2c-kube-api-access-2ngm9\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:18:58.715488 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.715447 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-workload-socket\") pod \"e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:58.715694 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.715501 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istio-envoy\") pod \"e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:58.715694 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.715621 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr7cd\" (UniqueName: \"kubernetes.io/projected/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-kube-api-access-dr7cd\") pod \"e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:58.715694 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.715677 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-workload-certs\") pod \"e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:58.715818 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.715704 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istiod-ca-cert\") pod \"e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:58.715818 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.715731 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-credential-socket\") pod \"e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:58.715909 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.715883 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istio-data\") pod \"e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:58.715997 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.715981 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istio-token\") pod \"e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:58.716078 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.716065 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istio-podinfo\") pod \"e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:58.716137 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.716072 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-workload-socket\") pod \"e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:58.716137 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.716107 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-credential-socket\") pod \"e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:58.716281 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.716258 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istio-data\") pod \"e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:58.716380 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.716362 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-workload-certs\") pod \"e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:58.716660 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.716634 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istiod-ca-cert\") pod \"e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:58.717913 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.717891 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istio-envoy\") pod \"e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:58.718278 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.718261 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istio-podinfo\") pod \"e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:58.724045 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.724003 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istio-token\") pod \"e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:58.724141 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.724009 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr7cd\" (UniqueName: \"kubernetes.io/projected/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-kube-api-access-dr7cd\") pod \"e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:58.811292 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.811192 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:58.943863 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.943827 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f"] Jul 06 18:18:58.946749 ip-10-0-130-37 kubenswrapper[2578]: W0706 18:18:58.946726 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d57be21_cc58_4f3a_b9f8_5b418f0900bc.slice/crio-4fc2630fdedd2e1c6abb3530719c34cf26754a56f8582d6dfd481598dadcceb6 WatchSource:0}: Error finding container 4fc2630fdedd2e1c6abb3530719c34cf26754a56f8582d6dfd481598dadcceb6: Status 404 returned error can't find the container with id 4fc2630fdedd2e1c6abb3530719c34cf26754a56f8582d6dfd481598dadcceb6 Jul 06 18:18:58.948721 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.948696 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:18:58.948780 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.948767 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:18:58.948851 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:58.948793 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:18:59.137609 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:59.137518 2578 generic.go:356] "Generic (PLEG): container finished" podID="297dd056-4e24-40b1-a417-c1fdaa9f4e2c" containerID="e823bee4e641acf37189165bc0d1fd3d78b28d7158309c22e40d156ab4c027d5" exitCode=0 Jul 06 18:18:59.137609 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:59.137583 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" Jul 06 18:18:59.137819 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:59.137608 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" event={"ID":"297dd056-4e24-40b1-a417-c1fdaa9f4e2c","Type":"ContainerDied","Data":"e823bee4e641acf37189165bc0d1fd3d78b28d7158309c22e40d156ab4c027d5"} Jul 06 18:18:59.137819 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:59.137659 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2" event={"ID":"297dd056-4e24-40b1-a417-c1fdaa9f4e2c","Type":"ContainerDied","Data":"6df888c1411a7f8ad75d82c69f8296afe247f2e11e7a025949c6abaa86ab9820"} Jul 06 18:18:59.137819 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:59.137689 2578 scope.go:117] "RemoveContainer" containerID="e823bee4e641acf37189165bc0d1fd3d78b28d7158309c22e40d156ab4c027d5" Jul 06 18:18:59.140979 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:59.139975 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" event={"ID":"9d57be21-cc58-4f3a-b9f8-5b418f0900bc","Type":"ContainerStarted","Data":"ae5806093a79323882fb87b43be70f31a9c0e853fe4706fab33a683154bea8d5"} Jul 06 18:18:59.140979 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:59.140869 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" event={"ID":"9d57be21-cc58-4f3a-b9f8-5b418f0900bc","Type":"ContainerStarted","Data":"4fc2630fdedd2e1c6abb3530719c34cf26754a56f8582d6dfd481598dadcceb6"} Jul 06 18:18:59.154824 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:59.154804 2578 scope.go:117] "RemoveContainer" containerID="4a8100c2d2064f0cf327961c7183df0772e5fda4cf4d76f06d4479d8ae0d09c5" Jul 06 18:18:59.165827 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:59.165798 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2"] Jul 06 18:18:59.167570 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:59.167551 2578 scope.go:117] "RemoveContainer" containerID="e823bee4e641acf37189165bc0d1fd3d78b28d7158309c22e40d156ab4c027d5" Jul 06 18:18:59.168304 ip-10-0-130-37 kubenswrapper[2578]: E0706 18:18:59.167923 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e823bee4e641acf37189165bc0d1fd3d78b28d7158309c22e40d156ab4c027d5\": container with ID starting with e823bee4e641acf37189165bc0d1fd3d78b28d7158309c22e40d156ab4c027d5 not found: ID does not exist" containerID="e823bee4e641acf37189165bc0d1fd3d78b28d7158309c22e40d156ab4c027d5" Jul 06 18:18:59.168304 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:59.168273 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e823bee4e641acf37189165bc0d1fd3d78b28d7158309c22e40d156ab4c027d5"} err="failed to get container status \"e823bee4e641acf37189165bc0d1fd3d78b28d7158309c22e40d156ab4c027d5\": rpc error: code = NotFound desc = could not find container \"e823bee4e641acf37189165bc0d1fd3d78b28d7158309c22e40d156ab4c027d5\": container with ID starting with e823bee4e641acf37189165bc0d1fd3d78b28d7158309c22e40d156ab4c027d5 not found: ID does not exist" Jul 06 18:18:59.168304 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:59.168299 2578 scope.go:117] "RemoveContainer" containerID="4a8100c2d2064f0cf327961c7183df0772e5fda4cf4d76f06d4479d8ae0d09c5" Jul 06 18:18:59.168707 ip-10-0-130-37 kubenswrapper[2578]: E0706 18:18:59.168671 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a8100c2d2064f0cf327961c7183df0772e5fda4cf4d76f06d4479d8ae0d09c5\": container with ID starting with 4a8100c2d2064f0cf327961c7183df0772e5fda4cf4d76f06d4479d8ae0d09c5 not found: ID does not exist" containerID="4a8100c2d2064f0cf327961c7183df0772e5fda4cf4d76f06d4479d8ae0d09c5" Jul 06 18:18:59.168818 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:59.168715 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a8100c2d2064f0cf327961c7183df0772e5fda4cf4d76f06d4479d8ae0d09c5"} err="failed to get container status \"4a8100c2d2064f0cf327961c7183df0772e5fda4cf4d76f06d4479d8ae0d09c5\": rpc error: code = NotFound desc = could not find container \"4a8100c2d2064f0cf327961c7183df0772e5fda4cf4d76f06d4479d8ae0d09c5\": container with ID starting with 4a8100c2d2064f0cf327961c7183df0772e5fda4cf4d76f06d4479d8ae0d09c5 not found: ID does not exist" Jul 06 18:18:59.170577 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:59.170550 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a68cb1d3-openshift-default-dc8bb665f-8sxs2"] Jul 06 18:18:59.186677 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:59.186633 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" podStartSLOduration=1.186620472 podStartE2EDuration="1.186620472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:18:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:18:59.186230223 +0000 UTC m=+1659.870837298" watchObservedRunningTime="2026-07-06 18:18:59.186620472 +0000 UTC m=+1659.871227445" Jul 06 18:18:59.811899 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:59.811862 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:18:59.813333 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:59.813307 2578 patch_prober.go:28] interesting pod/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 06 18:18:59.813477 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:18:59.813352 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" podUID="9d57be21-cc58-4f3a-b9f8-5b418f0900bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 06 18:19:00.815849 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:00.815819 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:19:00.937248 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:00.937218 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="297dd056-4e24-40b1-a417-c1fdaa9f4e2c" path="/var/lib/kubelet/pods/297dd056-4e24-40b1-a417-c1fdaa9f4e2c/volumes" Jul 06 18:19:01.150330 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:01.150254 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:19:01.151157 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:01.151140 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:19:04.268597 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:04.268556 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f"] Jul 06 18:19:04.269052 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:04.268776 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" podUID="9d57be21-cc58-4f3a-b9f8-5b418f0900bc" containerName="istio-proxy" containerID="cri-o://ae5806093a79323882fb87b43be70f31a9c0e853fe4706fab33a683154bea8d5" gracePeriod=30 Jul 06 18:19:09.815752 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:09.815729 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:19:09.919514 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:09.919417 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istio-token\") pod \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " Jul 06 18:19:09.919514 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:09.919478 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istio-podinfo\") pod \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " Jul 06 18:19:09.919514 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:09.919499 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-workload-certs\") pod \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " Jul 06 18:19:09.919796 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:09.919521 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istiod-ca-cert\") pod \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " Jul 06 18:19:09.919796 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:09.919538 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-credential-socket\") pod \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " Jul 06 18:19:09.919796 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:09.919574 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istio-data\") pod \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " Jul 06 18:19:09.919796 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:09.919609 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dr7cd\" (UniqueName: \"kubernetes.io/projected/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-kube-api-access-dr7cd\") pod \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " Jul 06 18:19:09.919796 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:09.919642 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-workload-socket\") pod \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " Jul 06 18:19:09.919796 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:09.919722 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istio-envoy\") pod \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\" (UID: \"9d57be21-cc58-4f3a-b9f8-5b418f0900bc\") " Jul 06 18:19:09.920146 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:09.919835 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9d57be21-cc58-4f3a-b9f8-5b418f0900bc" (UID: "9d57be21-cc58-4f3a-b9f8-5b418f0900bc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:19:09.920146 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:09.919956 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9d57be21-cc58-4f3a-b9f8-5b418f0900bc" (UID: "9d57be21-cc58-4f3a-b9f8-5b418f0900bc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:19:09.920146 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:09.920068 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9d57be21-cc58-4f3a-b9f8-5b418f0900bc" (UID: "9d57be21-cc58-4f3a-b9f8-5b418f0900bc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:19:09.920146 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:09.920093 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-workload-certs\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:19:09.920146 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:09.920114 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-credential-socket\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:19:09.920422 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:09.920387 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9d57be21-cc58-4f3a-b9f8-5b418f0900bc" (UID: "9d57be21-cc58-4f3a-b9f8-5b418f0900bc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:19:09.920690 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:09.920655 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istio-data" (OuterVolumeSpecName: "istio-data") pod "9d57be21-cc58-4f3a-b9f8-5b418f0900bc" (UID: "9d57be21-cc58-4f3a-b9f8-5b418f0900bc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:19:09.921720 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:09.921696 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istio-token" (OuterVolumeSpecName: "istio-token") pod "9d57be21-cc58-4f3a-b9f8-5b418f0900bc" (UID: "9d57be21-cc58-4f3a-b9f8-5b418f0900bc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:19:09.921803 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:09.921787 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9d57be21-cc58-4f3a-b9f8-5b418f0900bc" (UID: "9d57be21-cc58-4f3a-b9f8-5b418f0900bc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 18:19:09.921927 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:09.921901 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9d57be21-cc58-4f3a-b9f8-5b418f0900bc" (UID: "9d57be21-cc58-4f3a-b9f8-5b418f0900bc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:19:09.922359 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:09.922331 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-kube-api-access-dr7cd" (OuterVolumeSpecName: "kube-api-access-dr7cd") pod "9d57be21-cc58-4f3a-b9f8-5b418f0900bc" (UID: "9d57be21-cc58-4f3a-b9f8-5b418f0900bc"). InnerVolumeSpecName "kube-api-access-dr7cd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:19:10.021229 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:10.021185 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istio-podinfo\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:19:10.021229 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:10.021222 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istiod-ca-cert\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:19:10.021229 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:10.021233 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istio-data\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:19:10.021467 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:10.021249 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dr7cd\" (UniqueName: \"kubernetes.io/projected/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-kube-api-access-dr7cd\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:19:10.021467 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:10.021258 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-workload-socket\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:19:10.021467 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:10.021266 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istio-envoy\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:19:10.021467 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:10.021274 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d57be21-cc58-4f3a-b9f8-5b418f0900bc-istio-token\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:19:10.192980 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:10.192940 2578 generic.go:356] "Generic (PLEG): container finished" podID="9d57be21-cc58-4f3a-b9f8-5b418f0900bc" containerID="ae5806093a79323882fb87b43be70f31a9c0e853fe4706fab33a683154bea8d5" exitCode=0 Jul 06 18:19:10.193203 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:10.192974 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" event={"ID":"9d57be21-cc58-4f3a-b9f8-5b418f0900bc","Type":"ContainerDied","Data":"ae5806093a79323882fb87b43be70f31a9c0e853fe4706fab33a683154bea8d5"} Jul 06 18:19:10.193203 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:10.193046 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" Jul 06 18:19:10.193203 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:10.193098 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f" event={"ID":"9d57be21-cc58-4f3a-b9f8-5b418f0900bc","Type":"ContainerDied","Data":"4fc2630fdedd2e1c6abb3530719c34cf26754a56f8582d6dfd481598dadcceb6"} Jul 06 18:19:10.193203 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:10.193138 2578 scope.go:117] "RemoveContainer" containerID="ae5806093a79323882fb87b43be70f31a9c0e853fe4706fab33a683154bea8d5" Jul 06 18:19:10.204369 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:10.204355 2578 scope.go:117] "RemoveContainer" containerID="ae5806093a79323882fb87b43be70f31a9c0e853fe4706fab33a683154bea8d5" Jul 06 18:19:10.204560 ip-10-0-130-37 kubenswrapper[2578]: E0706 18:19:10.204541 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae5806093a79323882fb87b43be70f31a9c0e853fe4706fab33a683154bea8d5\": container with ID starting with ae5806093a79323882fb87b43be70f31a9c0e853fe4706fab33a683154bea8d5 not found: ID does not exist" containerID="ae5806093a79323882fb87b43be70f31a9c0e853fe4706fab33a683154bea8d5" Jul 06 18:19:10.204638 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:10.204565 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae5806093a79323882fb87b43be70f31a9c0e853fe4706fab33a683154bea8d5"} err="failed to get container status \"ae5806093a79323882fb87b43be70f31a9c0e853fe4706fab33a683154bea8d5\": rpc error: code = NotFound desc = could not find container \"ae5806093a79323882fb87b43be70f31a9c0e853fe4706fab33a683154bea8d5\": container with ID starting with ae5806093a79323882fb87b43be70f31a9c0e853fe4706fab33a683154bea8d5 not found: ID does not exist" Jul 06 18:19:10.216481 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:10.216458 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f"] Jul 06 18:19:10.221084 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:10.221066 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-bce7a316-openshift-default-6f7d9698f9-6pr9f"] Jul 06 18:19:10.934859 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:19:10.934828 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d57be21-cc58-4f3a-b9f8-5b418f0900bc" path="/var/lib/kubelet/pods/9d57be21-cc58-4f3a-b9f8-5b418f0900bc/volumes" Jul 06 18:20:48.321278 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.321248 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj"] Jul 06 18:20:48.321792 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.321616 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d57be21-cc58-4f3a-b9f8-5b418f0900bc" containerName="istio-proxy" Jul 06 18:20:48.321792 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.321627 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d57be21-cc58-4f3a-b9f8-5b418f0900bc" containerName="istio-proxy" Jul 06 18:20:48.321792 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.321644 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="297dd056-4e24-40b1-a417-c1fdaa9f4e2c" containerName="istio-proxy" Jul 06 18:20:48.321792 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.321649 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="297dd056-4e24-40b1-a417-c1fdaa9f4e2c" containerName="istio-proxy" Jul 06 18:20:48.321792 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.321706 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d57be21-cc58-4f3a-b9f8-5b418f0900bc" containerName="istio-proxy" Jul 06 18:20:48.323739 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.323723 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:48.327292 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.327262 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-084930c2-openshift-default-dockercfg-782j9\"" Jul 06 18:20:48.350432 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.350402 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj"] Jul 06 18:20:48.360388 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.360366 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t88c8\" (UniqueName: \"kubernetes.io/projected/805162f0-7160-4c97-8693-09c78de9ebb0-kube-api-access-t88c8\") pod \"e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:48.360505 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.360398 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-credential-socket\") pod \"e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:48.360505 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.360415 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/805162f0-7160-4c97-8693-09c78de9ebb0-istiod-ca-cert\") pod \"e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:48.360505 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.360433 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-workload-certs\") pod \"e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:48.360505 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.360496 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-istio-envoy\") pod \"e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:48.360643 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.360528 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/805162f0-7160-4c97-8693-09c78de9ebb0-istio-podinfo\") pod \"e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:48.360643 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.360553 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/805162f0-7160-4c97-8693-09c78de9ebb0-istio-token\") pod \"e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:48.360643 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.360571 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-istio-data\") pod \"e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:48.360643 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.360629 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-workload-socket\") pod \"e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:48.461898 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.461866 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-credential-socket\") pod \"e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:48.461898 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.461900 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/805162f0-7160-4c97-8693-09c78de9ebb0-istiod-ca-cert\") pod \"e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:48.462171 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.461945 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-workload-certs\") pod \"e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:48.462171 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.461971 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-istio-envoy\") pod \"e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:48.462171 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.461993 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/805162f0-7160-4c97-8693-09c78de9ebb0-istio-podinfo\") pod \"e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:48.462327 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.462173 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/805162f0-7160-4c97-8693-09c78de9ebb0-istio-token\") pod \"e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:48.462327 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.462227 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-istio-data\") pod \"e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:48.462327 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.462302 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-credential-socket\") pod \"e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:48.462327 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.462315 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-workload-socket\") pod \"e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:48.462527 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.462382 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t88c8\" (UniqueName: \"kubernetes.io/projected/805162f0-7160-4c97-8693-09c78de9ebb0-kube-api-access-t88c8\") pod \"e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:48.462527 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.462393 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-workload-certs\") pod \"e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:48.462646 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.462530 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-istio-data\") pod \"e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:48.462756 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.462737 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-workload-socket\") pod \"e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:48.462821 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.462734 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/805162f0-7160-4c97-8693-09c78de9ebb0-istiod-ca-cert\") pod \"e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:48.464859 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.464832 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-istio-envoy\") pod \"e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:48.464991 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.464974 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/805162f0-7160-4c97-8693-09c78de9ebb0-istio-podinfo\") pod \"e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:48.470594 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.470571 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/805162f0-7160-4c97-8693-09c78de9ebb0-istio-token\") pod \"e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:48.471125 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.471102 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t88c8\" (UniqueName: \"kubernetes.io/projected/805162f0-7160-4c97-8693-09c78de9ebb0-kube-api-access-t88c8\") pod \"e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:48.635225 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.634912 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:48.769529 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.769506 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj"] Jul 06 18:20:48.771596 ip-10-0-130-37 kubenswrapper[2578]: W0706 18:20:48.771560 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod805162f0_7160_4c97_8693_09c78de9ebb0.slice/crio-5a9726d1a7e966fa325793e3e2cf6379e1992a1ff148ee559f538f9644188282 WatchSource:0}: Error finding container 5a9726d1a7e966fa325793e3e2cf6379e1992a1ff148ee559f538f9644188282: Status 404 returned error can't find the container with id 5a9726d1a7e966fa325793e3e2cf6379e1992a1ff148ee559f538f9644188282 Jul 06 18:20:48.773590 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.773559 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:20:48.773677 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.773627 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:20:48.773677 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:48.773655 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:20:49.641211 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:49.641179 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" event={"ID":"805162f0-7160-4c97-8693-09c78de9ebb0","Type":"ContainerStarted","Data":"2aea9833dee0bc5298790f8e63354d4dda2dfcaba1a77782dcc0ad8cb7ac9cc2"} Jul 06 18:20:49.641572 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:49.641230 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" event={"ID":"805162f0-7160-4c97-8693-09c78de9ebb0","Type":"ContainerStarted","Data":"5a9726d1a7e966fa325793e3e2cf6379e1992a1ff148ee559f538f9644188282"} Jul 06 18:20:49.662464 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:49.662412 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" podStartSLOduration=1.6623968059999998 podStartE2EDuration="1.662396806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:20:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:20:49.660645726 +0000 UTC m=+1770.345252698" watchObservedRunningTime="2026-07-06 18:20:49.662396806 +0000 UTC m=+1770.347003815" Jul 06 18:20:50.636115 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:50.636075 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:50.641339 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:50.641313 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:50.645853 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:50.645827 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:20:50.646447 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:20:50.646428 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:21:05.647336 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:05.647252 2578 patch_prober.go:28] interesting pod/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 06 18:21:05.647336 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:05.647325 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" podUID="805162f0-7160-4c97-8693-09c78de9ebb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 06 18:21:05.715880 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:05.715846 2578 generic.go:356] "Generic (PLEG): container finished" podID="805162f0-7160-4c97-8693-09c78de9ebb0" containerID="2aea9833dee0bc5298790f8e63354d4dda2dfcaba1a77782dcc0ad8cb7ac9cc2" exitCode=0 Jul 06 18:21:05.716061 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:05.715905 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" event={"ID":"805162f0-7160-4c97-8693-09c78de9ebb0","Type":"ContainerDied","Data":"2aea9833dee0bc5298790f8e63354d4dda2dfcaba1a77782dcc0ad8cb7ac9cc2"} Jul 06 18:21:05.716304 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:05.716290 2578 scope.go:117] "RemoveContainer" containerID="2aea9833dee0bc5298790f8e63354d4dda2dfcaba1a77782dcc0ad8cb7ac9cc2" Jul 06 18:21:05.717205 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:05.717181 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:21:05.717263 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:05.717246 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:21:05.717302 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:05.717285 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:21:06.721829 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:06.721798 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" event={"ID":"805162f0-7160-4c97-8693-09c78de9ebb0","Type":"ContainerStarted","Data":"14f8ca99c8087c3b208f7d1253a763eb2d1612e4ba3bda5d1f3a3a08088fec4c"} Jul 06 18:21:07.635665 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:07.635630 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:21:07.636127 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:07.636101 2578 patch_prober.go:28] interesting pod/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 06 18:21:07.636305 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:07.636282 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" podUID="805162f0-7160-4c97-8693-09c78de9ebb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 06 18:21:08.635508 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:08.635474 2578 patch_prober.go:28] interesting pod/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 06 18:21:08.636114 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:08.636081 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" podUID="805162f0-7160-4c97-8693-09c78de9ebb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 06 18:21:09.636009 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:09.635968 2578 patch_prober.go:28] interesting pod/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 06 18:21:09.636497 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:09.636068 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" podUID="805162f0-7160-4c97-8693-09c78de9ebb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 06 18:21:10.639821 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:10.639788 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:21:10.640198 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:10.640123 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:21:10.640867 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:10.640851 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:21:11.350309 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:11.350276 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj"] Jul 06 18:21:11.747772 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:11.747737 2578 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" secret="" err="secret \"e2e-mt-084930c2-openshift-default-dockercfg-782j9\" not found" Jul 06 18:21:12.752812 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:12.752753 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" podUID="805162f0-7160-4c97-8693-09c78de9ebb0" containerName="istio-proxy" containerID="cri-o://14f8ca99c8087c3b208f7d1253a763eb2d1612e4ba3bda5d1f3a3a08088fec4c" gracePeriod=30 Jul 06 18:21:18.008823 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.008796 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:21:18.125203 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.125116 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-istio-envoy\") pod \"805162f0-7160-4c97-8693-09c78de9ebb0\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " Jul 06 18:21:18.125203 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.125154 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/805162f0-7160-4c97-8693-09c78de9ebb0-istio-token\") pod \"805162f0-7160-4c97-8693-09c78de9ebb0\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " Jul 06 18:21:18.125203 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.125193 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-workload-certs\") pod \"805162f0-7160-4c97-8693-09c78de9ebb0\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " Jul 06 18:21:18.125489 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.125214 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-workload-socket\") pod \"805162f0-7160-4c97-8693-09c78de9ebb0\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " Jul 06 18:21:18.125489 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.125282 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/805162f0-7160-4c97-8693-09c78de9ebb0-istiod-ca-cert\") pod \"805162f0-7160-4c97-8693-09c78de9ebb0\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " Jul 06 18:21:18.125489 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.125319 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t88c8\" (UniqueName: \"kubernetes.io/projected/805162f0-7160-4c97-8693-09c78de9ebb0-kube-api-access-t88c8\") pod \"805162f0-7160-4c97-8693-09c78de9ebb0\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " Jul 06 18:21:18.125489 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.125347 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-istio-data\") pod \"805162f0-7160-4c97-8693-09c78de9ebb0\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " Jul 06 18:21:18.125489 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.125400 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-credential-socket\") pod \"805162f0-7160-4c97-8693-09c78de9ebb0\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " Jul 06 18:21:18.125489 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.125425 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/805162f0-7160-4c97-8693-09c78de9ebb0-istio-podinfo\") pod \"805162f0-7160-4c97-8693-09c78de9ebb0\" (UID: \"805162f0-7160-4c97-8693-09c78de9ebb0\") " Jul 06 18:21:18.125771 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.125533 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "805162f0-7160-4c97-8693-09c78de9ebb0" (UID: "805162f0-7160-4c97-8693-09c78de9ebb0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:21:18.125771 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.125545 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "805162f0-7160-4c97-8693-09c78de9ebb0" (UID: "805162f0-7160-4c97-8693-09c78de9ebb0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:21:18.125871 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.125713 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/805162f0-7160-4c97-8693-09c78de9ebb0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "805162f0-7160-4c97-8693-09c78de9ebb0" (UID: "805162f0-7160-4c97-8693-09c78de9ebb0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:21:18.125871 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.125744 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-workload-certs\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:21:18.125871 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.125858 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-workload-socket\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:21:18.126014 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.125743 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "805162f0-7160-4c97-8693-09c78de9ebb0" (UID: "805162f0-7160-4c97-8693-09c78de9ebb0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:21:18.126535 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.126495 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-istio-data" (OuterVolumeSpecName: "istio-data") pod "805162f0-7160-4c97-8693-09c78de9ebb0" (UID: "805162f0-7160-4c97-8693-09c78de9ebb0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:21:18.127438 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.127408 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "805162f0-7160-4c97-8693-09c78de9ebb0" (UID: "805162f0-7160-4c97-8693-09c78de9ebb0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:21:18.127548 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.127533 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/805162f0-7160-4c97-8693-09c78de9ebb0-istio-token" (OuterVolumeSpecName: "istio-token") pod "805162f0-7160-4c97-8693-09c78de9ebb0" (UID: "805162f0-7160-4c97-8693-09c78de9ebb0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:21:18.127616 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.127537 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/805162f0-7160-4c97-8693-09c78de9ebb0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "805162f0-7160-4c97-8693-09c78de9ebb0" (UID: "805162f0-7160-4c97-8693-09c78de9ebb0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 18:21:18.127682 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.127636 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/805162f0-7160-4c97-8693-09c78de9ebb0-kube-api-access-t88c8" (OuterVolumeSpecName: "kube-api-access-t88c8") pod "805162f0-7160-4c97-8693-09c78de9ebb0" (UID: "805162f0-7160-4c97-8693-09c78de9ebb0"). InnerVolumeSpecName "kube-api-access-t88c8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:21:18.226864 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.226831 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-istio-envoy\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:21:18.226864 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.226855 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/805162f0-7160-4c97-8693-09c78de9ebb0-istio-token\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:21:18.226864 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.226864 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/805162f0-7160-4c97-8693-09c78de9ebb0-istiod-ca-cert\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:21:18.227087 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.226873 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t88c8\" (UniqueName: \"kubernetes.io/projected/805162f0-7160-4c97-8693-09c78de9ebb0-kube-api-access-t88c8\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:21:18.227087 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.226882 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-istio-data\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:21:18.227087 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.226890 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/805162f0-7160-4c97-8693-09c78de9ebb0-credential-socket\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:21:18.227087 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.226899 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/805162f0-7160-4c97-8693-09c78de9ebb0-istio-podinfo\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:21:18.782517 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.782484 2578 generic.go:356] "Generic (PLEG): container finished" podID="805162f0-7160-4c97-8693-09c78de9ebb0" containerID="14f8ca99c8087c3b208f7d1253a763eb2d1612e4ba3bda5d1f3a3a08088fec4c" exitCode=0 Jul 06 18:21:18.782728 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.782531 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" Jul 06 18:21:18.782728 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.782567 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" event={"ID":"805162f0-7160-4c97-8693-09c78de9ebb0","Type":"ContainerDied","Data":"14f8ca99c8087c3b208f7d1253a763eb2d1612e4ba3bda5d1f3a3a08088fec4c"} Jul 06 18:21:18.782728 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.782618 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj" event={"ID":"805162f0-7160-4c97-8693-09c78de9ebb0","Type":"ContainerDied","Data":"5a9726d1a7e966fa325793e3e2cf6379e1992a1ff148ee559f538f9644188282"} Jul 06 18:21:18.782728 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.782638 2578 scope.go:117] "RemoveContainer" containerID="14f8ca99c8087c3b208f7d1253a763eb2d1612e4ba3bda5d1f3a3a08088fec4c" Jul 06 18:21:18.791624 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.791607 2578 scope.go:117] "RemoveContainer" containerID="2aea9833dee0bc5298790f8e63354d4dda2dfcaba1a77782dcc0ad8cb7ac9cc2" Jul 06 18:21:18.798979 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.798963 2578 scope.go:117] "RemoveContainer" containerID="14f8ca99c8087c3b208f7d1253a763eb2d1612e4ba3bda5d1f3a3a08088fec4c" Jul 06 18:21:18.799254 ip-10-0-130-37 kubenswrapper[2578]: E0706 18:21:18.799237 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14f8ca99c8087c3b208f7d1253a763eb2d1612e4ba3bda5d1f3a3a08088fec4c\": container with ID starting with 14f8ca99c8087c3b208f7d1253a763eb2d1612e4ba3bda5d1f3a3a08088fec4c not found: ID does not exist" containerID="14f8ca99c8087c3b208f7d1253a763eb2d1612e4ba3bda5d1f3a3a08088fec4c" Jul 06 18:21:18.799303 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.799262 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14f8ca99c8087c3b208f7d1253a763eb2d1612e4ba3bda5d1f3a3a08088fec4c"} err="failed to get container status \"14f8ca99c8087c3b208f7d1253a763eb2d1612e4ba3bda5d1f3a3a08088fec4c\": rpc error: code = NotFound desc = could not find container \"14f8ca99c8087c3b208f7d1253a763eb2d1612e4ba3bda5d1f3a3a08088fec4c\": container with ID starting with 14f8ca99c8087c3b208f7d1253a763eb2d1612e4ba3bda5d1f3a3a08088fec4c not found: ID does not exist" Jul 06 18:21:18.799303 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.799279 2578 scope.go:117] "RemoveContainer" containerID="2aea9833dee0bc5298790f8e63354d4dda2dfcaba1a77782dcc0ad8cb7ac9cc2" Jul 06 18:21:18.799547 ip-10-0-130-37 kubenswrapper[2578]: E0706 18:21:18.799531 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2aea9833dee0bc5298790f8e63354d4dda2dfcaba1a77782dcc0ad8cb7ac9cc2\": container with ID starting with 2aea9833dee0bc5298790f8e63354d4dda2dfcaba1a77782dcc0ad8cb7ac9cc2 not found: ID does not exist" containerID="2aea9833dee0bc5298790f8e63354d4dda2dfcaba1a77782dcc0ad8cb7ac9cc2" Jul 06 18:21:18.799601 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.799553 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2aea9833dee0bc5298790f8e63354d4dda2dfcaba1a77782dcc0ad8cb7ac9cc2"} err="failed to get container status \"2aea9833dee0bc5298790f8e63354d4dda2dfcaba1a77782dcc0ad8cb7ac9cc2\": rpc error: code = NotFound desc = could not find container \"2aea9833dee0bc5298790f8e63354d4dda2dfcaba1a77782dcc0ad8cb7ac9cc2\": container with ID starting with 2aea9833dee0bc5298790f8e63354d4dda2dfcaba1a77782dcc0ad8cb7ac9cc2 not found: ID does not exist" Jul 06 18:21:18.803639 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.803614 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj"] Jul 06 18:21:18.807908 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.807889 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-084930c2-openshift-default-b5689db7f-k7xgj"] Jul 06 18:21:18.934824 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:18.934799 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="805162f0-7160-4c97-8693-09c78de9ebb0" path="/var/lib/kubelet/pods/805162f0-7160-4c97-8693-09c78de9ebb0/volumes" Jul 06 18:21:31.782974 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.782943 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb"] Jul 06 18:21:31.783374 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.783281 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="805162f0-7160-4c97-8693-09c78de9ebb0" containerName="istio-proxy" Jul 06 18:21:31.783374 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.783292 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="805162f0-7160-4c97-8693-09c78de9ebb0" containerName="istio-proxy" Jul 06 18:21:31.783374 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.783359 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="805162f0-7160-4c97-8693-09c78de9ebb0" containerName="istio-proxy" Jul 06 18:21:31.783374 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.783367 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="805162f0-7160-4c97-8693-09c78de9ebb0" containerName="istio-proxy" Jul 06 18:21:31.785698 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.785680 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:31.789251 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.789228 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-12711072-openshift-default-dockercfg-g9rdb\"" Jul 06 18:21:31.809992 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.809962 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb"] Jul 06 18:21:31.852056 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.852006 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-istio-data\") pod \"e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:31.852254 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.852085 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a862b12c-c2f7-43cc-8ee1-4a488d462413-istio-token\") pod \"e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:31.852254 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.852122 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-credential-socket\") pod \"e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:31.852254 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.852150 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-workload-certs\") pod \"e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:31.852254 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.852198 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-workload-socket\") pod \"e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:31.852254 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.852222 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-istio-envoy\") pod \"e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:31.852254 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.852245 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a862b12c-c2f7-43cc-8ee1-4a488d462413-istiod-ca-cert\") pod \"e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:31.852599 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.852433 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a862b12c-c2f7-43cc-8ee1-4a488d462413-istio-podinfo\") pod \"e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:31.852599 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.852513 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csqwv\" (UniqueName: \"kubernetes.io/projected/a862b12c-c2f7-43cc-8ee1-4a488d462413-kube-api-access-csqwv\") pod \"e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:31.953175 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.953139 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csqwv\" (UniqueName: \"kubernetes.io/projected/a862b12c-c2f7-43cc-8ee1-4a488d462413-kube-api-access-csqwv\") pod \"e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:31.953175 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.953177 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-istio-data\") pod \"e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:31.953399 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.953226 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a862b12c-c2f7-43cc-8ee1-4a488d462413-istio-token\") pod \"e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:31.953399 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.953248 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-credential-socket\") pod \"e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:31.953399 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.953263 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-workload-certs\") pod \"e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:31.953604 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.953301 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-workload-socket\") pod \"e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:31.953750 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.953626 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-istio-envoy\") pod \"e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:31.953750 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.953656 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a862b12c-c2f7-43cc-8ee1-4a488d462413-istiod-ca-cert\") pod \"e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:31.953750 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.953659 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-istio-data\") pod \"e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:31.953750 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.953703 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-credential-socket\") pod \"e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:31.953750 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.953722 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-workload-certs\") pod \"e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:31.954012 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.953782 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a862b12c-c2f7-43cc-8ee1-4a488d462413-istio-podinfo\") pod \"e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:31.954012 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.953792 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-workload-socket\") pod \"e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:31.954288 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.954265 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a862b12c-c2f7-43cc-8ee1-4a488d462413-istiod-ca-cert\") pod \"e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:31.956224 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.956208 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a862b12c-c2f7-43cc-8ee1-4a488d462413-istio-podinfo\") pod \"e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:31.956383 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.956366 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-istio-envoy\") pod \"e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:31.961356 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.961335 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csqwv\" (UniqueName: \"kubernetes.io/projected/a862b12c-c2f7-43cc-8ee1-4a488d462413-kube-api-access-csqwv\") pod \"e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:31.961706 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:31.961685 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a862b12c-c2f7-43cc-8ee1-4a488d462413-istio-token\") pod \"e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:32.096861 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:32.096761 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:32.255520 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:32.255410 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb"] Jul 06 18:21:32.262484 ip-10-0-130-37 kubenswrapper[2578]: W0706 18:21:32.262433 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda862b12c_c2f7_43cc_8ee1_4a488d462413.slice/crio-de5e1853cdd79046d1c47da2ff5930fff9b6fad747a82cfccb7f1563e1819326 WatchSource:0}: Error finding container de5e1853cdd79046d1c47da2ff5930fff9b6fad747a82cfccb7f1563e1819326: Status 404 returned error can't find the container with id de5e1853cdd79046d1c47da2ff5930fff9b6fad747a82cfccb7f1563e1819326 Jul 06 18:21:32.267265 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:32.266068 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:21:32.267265 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:32.266150 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:21:32.267265 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:32.266191 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:21:32.853685 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:32.853643 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" event={"ID":"a862b12c-c2f7-43cc-8ee1-4a488d462413","Type":"ContainerStarted","Data":"6f455a280ff7df3a43cc1610e65666c107b05b5a775ab236721ac73d0e93dfdb"} Jul 06 18:21:32.854065 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:32.853740 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" event={"ID":"a862b12c-c2f7-43cc-8ee1-4a488d462413","Type":"ContainerStarted","Data":"de5e1853cdd79046d1c47da2ff5930fff9b6fad747a82cfccb7f1563e1819326"} Jul 06 18:21:32.876715 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:32.876664 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" podStartSLOduration=1.876650242 podStartE2EDuration="1.876650242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:21:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:21:32.874240074 +0000 UTC m=+1813.558847095" watchObservedRunningTime="2026-07-06 18:21:32.876650242 +0000 UTC m=+1813.561257236" Jul 06 18:21:33.097830 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:33.097788 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:33.102703 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:33.102678 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:33.858090 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:33.858064 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:33.858923 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:33.858907 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:47.924172 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:47.924138 2578 generic.go:356] "Generic (PLEG): container finished" podID="a862b12c-c2f7-43cc-8ee1-4a488d462413" containerID="6f455a280ff7df3a43cc1610e65666c107b05b5a775ab236721ac73d0e93dfdb" exitCode=0 Jul 06 18:21:47.924584 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:47.924197 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" event={"ID":"a862b12c-c2f7-43cc-8ee1-4a488d462413","Type":"ContainerDied","Data":"6f455a280ff7df3a43cc1610e65666c107b05b5a775ab236721ac73d0e93dfdb"} Jul 06 18:21:47.924584 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:47.924560 2578 scope.go:117] "RemoveContainer" containerID="6f455a280ff7df3a43cc1610e65666c107b05b5a775ab236721ac73d0e93dfdb" Jul 06 18:21:47.925578 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:47.925547 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:21:47.925671 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:47.925616 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:21:47.925671 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:47.925645 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:21:48.858522 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:48.858460 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:48.937927 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:48.937822 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" event={"ID":"a862b12c-c2f7-43cc-8ee1-4a488d462413","Type":"ContainerStarted","Data":"e4f2c5c1a4c63b79a2ae5fe2e29cec16c711b4108c7d87180e5d0461e0006a8e"} Jul 06 18:21:49.097104 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:49.097078 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:49.098304 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:49.098279 2578 patch_prober.go:28] interesting pod/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 06 18:21:49.098406 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:49.098327 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" podUID="a862b12c-c2f7-43cc-8ee1-4a488d462413" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 06 18:21:50.097500 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:50.097457 2578 patch_prober.go:28] interesting pod/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 06 18:21:50.097867 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:50.097531 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" podUID="a862b12c-c2f7-43cc-8ee1-4a488d462413" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 06 18:21:51.097555 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:51.097517 2578 patch_prober.go:28] interesting pod/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 06 18:21:51.097962 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:51.097602 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" podUID="a862b12c-c2f7-43cc-8ee1-4a488d462413" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 06 18:21:52.097270 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:52.097240 2578 patch_prober.go:28] interesting pod/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 06 18:21:52.097429 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:52.097306 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" podUID="a862b12c-c2f7-43cc-8ee1-4a488d462413" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 06 18:21:53.100860 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:53.100827 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:53.101257 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:53.101067 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:21:53.101844 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:21:53.101822 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:23:11.746493 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:11.746443 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb"] Jul 06 18:23:11.747056 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:11.746711 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" podUID="a862b12c-c2f7-43cc-8ee1-4a488d462413" containerName="istio-proxy" containerID="cri-o://e4f2c5c1a4c63b79a2ae5fe2e29cec16c711b4108c7d87180e5d0461e0006a8e" gracePeriod=30 Jul 06 18:23:17.000664 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.000637 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:23:17.093809 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.093699 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-workload-socket\") pod \"a862b12c-c2f7-43cc-8ee1-4a488d462413\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " Jul 06 18:23:17.093809 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.093748 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-istio-data\") pod \"a862b12c-c2f7-43cc-8ee1-4a488d462413\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " Jul 06 18:23:17.093809 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.093766 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-credential-socket\") pod \"a862b12c-c2f7-43cc-8ee1-4a488d462413\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " Jul 06 18:23:17.093809 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.093796 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-istio-envoy\") pod \"a862b12c-c2f7-43cc-8ee1-4a488d462413\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " Jul 06 18:23:17.093809 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.093818 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a862b12c-c2f7-43cc-8ee1-4a488d462413-istio-token\") pod \"a862b12c-c2f7-43cc-8ee1-4a488d462413\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " Jul 06 18:23:17.094252 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.093833 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-csqwv\" (UniqueName: \"kubernetes.io/projected/a862b12c-c2f7-43cc-8ee1-4a488d462413-kube-api-access-csqwv\") pod \"a862b12c-c2f7-43cc-8ee1-4a488d462413\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " Jul 06 18:23:17.094252 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.093910 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-workload-certs\") pod \"a862b12c-c2f7-43cc-8ee1-4a488d462413\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " Jul 06 18:23:17.094252 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.093939 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a862b12c-c2f7-43cc-8ee1-4a488d462413-istiod-ca-cert\") pod \"a862b12c-c2f7-43cc-8ee1-4a488d462413\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " Jul 06 18:23:17.094252 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.093968 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a862b12c-c2f7-43cc-8ee1-4a488d462413" (UID: "a862b12c-c2f7-43cc-8ee1-4a488d462413"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:23:17.094252 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.094067 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a862b12c-c2f7-43cc-8ee1-4a488d462413-istio-podinfo\") pod \"a862b12c-c2f7-43cc-8ee1-4a488d462413\" (UID: \"a862b12c-c2f7-43cc-8ee1-4a488d462413\") " Jul 06 18:23:17.094252 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.094214 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a862b12c-c2f7-43cc-8ee1-4a488d462413" (UID: "a862b12c-c2f7-43cc-8ee1-4a488d462413"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:23:17.094571 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.094347 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a862b12c-c2f7-43cc-8ee1-4a488d462413-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a862b12c-c2f7-43cc-8ee1-4a488d462413" (UID: "a862b12c-c2f7-43cc-8ee1-4a488d462413"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:23:17.094571 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.094412 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a862b12c-c2f7-43cc-8ee1-4a488d462413" (UID: "a862b12c-c2f7-43cc-8ee1-4a488d462413"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:23:17.094571 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.094546 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-credential-socket\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:23:17.094571 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.094564 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-workload-certs\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:23:17.094780 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.094578 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a862b12c-c2f7-43cc-8ee1-4a488d462413-istiod-ca-cert\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:23:17.094780 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.094589 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-workload-socket\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:23:17.094780 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.094587 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-istio-data" (OuterVolumeSpecName: "istio-data") pod "a862b12c-c2f7-43cc-8ee1-4a488d462413" (UID: "a862b12c-c2f7-43cc-8ee1-4a488d462413"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:23:17.096357 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.096309 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a862b12c-c2f7-43cc-8ee1-4a488d462413" (UID: "a862b12c-c2f7-43cc-8ee1-4a488d462413"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:23:17.096695 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.096666 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a862b12c-c2f7-43cc-8ee1-4a488d462413-kube-api-access-csqwv" (OuterVolumeSpecName: "kube-api-access-csqwv") pod "a862b12c-c2f7-43cc-8ee1-4a488d462413" (UID: "a862b12c-c2f7-43cc-8ee1-4a488d462413"). InnerVolumeSpecName "kube-api-access-csqwv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:23:17.096926 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.096846 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a862b12c-c2f7-43cc-8ee1-4a488d462413-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a862b12c-c2f7-43cc-8ee1-4a488d462413" (UID: "a862b12c-c2f7-43cc-8ee1-4a488d462413"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 18:23:17.097236 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.097211 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a862b12c-c2f7-43cc-8ee1-4a488d462413-istio-token" (OuterVolumeSpecName: "istio-token") pod "a862b12c-c2f7-43cc-8ee1-4a488d462413" (UID: "a862b12c-c2f7-43cc-8ee1-4a488d462413"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:23:17.195523 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.195488 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a862b12c-c2f7-43cc-8ee1-4a488d462413-istio-podinfo\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:23:17.195523 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.195517 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-istio-data\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:23:17.195523 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.195527 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a862b12c-c2f7-43cc-8ee1-4a488d462413-istio-envoy\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:23:17.195765 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.195535 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a862b12c-c2f7-43cc-8ee1-4a488d462413-istio-token\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:23:17.195765 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.195543 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csqwv\" (UniqueName: \"kubernetes.io/projected/a862b12c-c2f7-43cc-8ee1-4a488d462413-kube-api-access-csqwv\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:23:17.354327 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.354234 2578 generic.go:356] "Generic (PLEG): container finished" podID="a862b12c-c2f7-43cc-8ee1-4a488d462413" containerID="e4f2c5c1a4c63b79a2ae5fe2e29cec16c711b4108c7d87180e5d0461e0006a8e" exitCode=0 Jul 06 18:23:17.354327 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.354297 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" Jul 06 18:23:17.354561 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.354323 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" event={"ID":"a862b12c-c2f7-43cc-8ee1-4a488d462413","Type":"ContainerDied","Data":"e4f2c5c1a4c63b79a2ae5fe2e29cec16c711b4108c7d87180e5d0461e0006a8e"} Jul 06 18:23:17.354561 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.354376 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb" event={"ID":"a862b12c-c2f7-43cc-8ee1-4a488d462413","Type":"ContainerDied","Data":"de5e1853cdd79046d1c47da2ff5930fff9b6fad747a82cfccb7f1563e1819326"} Jul 06 18:23:17.354561 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.354405 2578 scope.go:117] "RemoveContainer" containerID="e4f2c5c1a4c63b79a2ae5fe2e29cec16c711b4108c7d87180e5d0461e0006a8e" Jul 06 18:23:17.364115 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.364098 2578 scope.go:117] "RemoveContainer" containerID="6f455a280ff7df3a43cc1610e65666c107b05b5a775ab236721ac73d0e93dfdb" Jul 06 18:23:17.372469 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.372448 2578 scope.go:117] "RemoveContainer" containerID="e4f2c5c1a4c63b79a2ae5fe2e29cec16c711b4108c7d87180e5d0461e0006a8e" Jul 06 18:23:17.372719 ip-10-0-130-37 kubenswrapper[2578]: E0706 18:23:17.372701 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4f2c5c1a4c63b79a2ae5fe2e29cec16c711b4108c7d87180e5d0461e0006a8e\": container with ID starting with e4f2c5c1a4c63b79a2ae5fe2e29cec16c711b4108c7d87180e5d0461e0006a8e not found: ID does not exist" containerID="e4f2c5c1a4c63b79a2ae5fe2e29cec16c711b4108c7d87180e5d0461e0006a8e" Jul 06 18:23:17.372767 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.372729 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4f2c5c1a4c63b79a2ae5fe2e29cec16c711b4108c7d87180e5d0461e0006a8e"} err="failed to get container status \"e4f2c5c1a4c63b79a2ae5fe2e29cec16c711b4108c7d87180e5d0461e0006a8e\": rpc error: code = NotFound desc = could not find container \"e4f2c5c1a4c63b79a2ae5fe2e29cec16c711b4108c7d87180e5d0461e0006a8e\": container with ID starting with e4f2c5c1a4c63b79a2ae5fe2e29cec16c711b4108c7d87180e5d0461e0006a8e not found: ID does not exist" Jul 06 18:23:17.372767 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.372747 2578 scope.go:117] "RemoveContainer" containerID="6f455a280ff7df3a43cc1610e65666c107b05b5a775ab236721ac73d0e93dfdb" Jul 06 18:23:17.373013 ip-10-0-130-37 kubenswrapper[2578]: E0706 18:23:17.372995 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f455a280ff7df3a43cc1610e65666c107b05b5a775ab236721ac73d0e93dfdb\": container with ID starting with 6f455a280ff7df3a43cc1610e65666c107b05b5a775ab236721ac73d0e93dfdb not found: ID does not exist" containerID="6f455a280ff7df3a43cc1610e65666c107b05b5a775ab236721ac73d0e93dfdb" Jul 06 18:23:17.373087 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.373019 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f455a280ff7df3a43cc1610e65666c107b05b5a775ab236721ac73d0e93dfdb"} err="failed to get container status \"6f455a280ff7df3a43cc1610e65666c107b05b5a775ab236721ac73d0e93dfdb\": rpc error: code = NotFound desc = could not find container \"6f455a280ff7df3a43cc1610e65666c107b05b5a775ab236721ac73d0e93dfdb\": container with ID starting with 6f455a280ff7df3a43cc1610e65666c107b05b5a775ab236721ac73d0e93dfdb not found: ID does not exist" Jul 06 18:23:17.379191 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.379164 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb"] Jul 06 18:23:17.382655 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:17.382637 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-12711072-openshift-default-879cdb4c5-fhqqb"] Jul 06 18:23:18.935376 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:23:18.935335 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a862b12c-c2f7-43cc-8ee1-4a488d462413" path="/var/lib/kubelet/pods/a862b12c-c2f7-43cc-8ee1-4a488d462413/volumes" Jul 06 18:24:08.025814 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.025784 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4"] Jul 06 18:24:08.026343 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.026155 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a862b12c-c2f7-43cc-8ee1-4a488d462413" containerName="istio-proxy" Jul 06 18:24:08.026343 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.026169 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a862b12c-c2f7-43cc-8ee1-4a488d462413" containerName="istio-proxy" Jul 06 18:24:08.026343 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.026191 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="805162f0-7160-4c97-8693-09c78de9ebb0" containerName="istio-proxy" Jul 06 18:24:08.026343 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.026198 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="805162f0-7160-4c97-8693-09c78de9ebb0" containerName="istio-proxy" Jul 06 18:24:08.026343 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.026284 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a862b12c-c2f7-43cc-8ee1-4a488d462413" containerName="istio-proxy" Jul 06 18:24:08.026343 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.026296 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a862b12c-c2f7-43cc-8ee1-4a488d462413" containerName="istio-proxy" Jul 06 18:24:08.028313 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.028296 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:08.032862 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.032839 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-a9cadd-openshift-default-dockercfg-whjzb\"" Jul 06 18:24:08.043422 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.043396 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4"] Jul 06 18:24:08.126423 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.126392 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/651dc021-a85c-4249-8e8d-44434bee97dd-istio-podinfo\") pod \"e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:08.126423 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.126425 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/651dc021-a85c-4249-8e8d-44434bee97dd-istiod-ca-cert\") pod \"e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:08.126610 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.126505 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-credential-socket\") pod \"e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:08.126610 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.126534 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-istio-data\") pod \"e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:08.126610 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.126560 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-istio-envoy\") pod \"e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:08.126610 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.126583 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/651dc021-a85c-4249-8e8d-44434bee97dd-istio-token\") pod \"e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:08.126750 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.126662 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-workload-socket\") pod \"e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:08.126750 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.126685 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-workload-certs\") pod \"e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:08.126750 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.126709 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v779q\" (UniqueName: \"kubernetes.io/projected/651dc021-a85c-4249-8e8d-44434bee97dd-kube-api-access-v779q\") pod \"e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:08.227363 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.227326 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-credential-socket\") pod \"e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:08.227363 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.227364 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-istio-data\") pod \"e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:08.227593 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.227399 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-istio-envoy\") pod \"e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:08.227593 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.227429 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/651dc021-a85c-4249-8e8d-44434bee97dd-istio-token\") pod \"e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:08.227593 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.227475 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-workload-socket\") pod \"e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:08.227593 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.227498 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-workload-certs\") pod \"e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:08.227593 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.227548 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v779q\" (UniqueName: \"kubernetes.io/projected/651dc021-a85c-4249-8e8d-44434bee97dd-kube-api-access-v779q\") pod \"e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:08.227855 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.227609 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/651dc021-a85c-4249-8e8d-44434bee97dd-istio-podinfo\") pod \"e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:08.227855 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.227636 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/651dc021-a85c-4249-8e8d-44434bee97dd-istiod-ca-cert\") pod \"e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:08.227855 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.227795 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-credential-socket\") pod \"e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:08.228223 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.227901 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-istio-data\") pod \"e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:08.228223 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.228013 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-workload-socket\") pod \"e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:08.228223 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.228073 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-workload-certs\") pod \"e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:08.228335 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.228323 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/651dc021-a85c-4249-8e8d-44434bee97dd-istiod-ca-cert\") pod \"e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:08.229703 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.229685 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-istio-envoy\") pod \"e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:08.230003 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.229984 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/651dc021-a85c-4249-8e8d-44434bee97dd-istio-podinfo\") pod \"e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:08.237058 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.236994 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/651dc021-a85c-4249-8e8d-44434bee97dd-istio-token\") pod \"e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:08.237253 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.237231 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v779q\" (UniqueName: \"kubernetes.io/projected/651dc021-a85c-4249-8e8d-44434bee97dd-kube-api-access-v779q\") pod \"e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:08.339188 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.339112 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:08.476704 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.476682 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4"] Jul 06 18:24:08.478772 ip-10-0-130-37 kubenswrapper[2578]: W0706 18:24:08.478748 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod651dc021_a85c_4249_8e8d_44434bee97dd.slice/crio-50b7511948a037fd16131fe185b959beb70e5b54e4a1ccd63753b95c79d1eb78 WatchSource:0}: Error finding container 50b7511948a037fd16131fe185b959beb70e5b54e4a1ccd63753b95c79d1eb78: Status 404 returned error can't find the container with id 50b7511948a037fd16131fe185b959beb70e5b54e4a1ccd63753b95c79d1eb78 Jul 06 18:24:08.480772 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.480741 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:24:08.480833 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.480802 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:24:08.480875 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.480833 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:24:08.584692 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.584654 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" event={"ID":"651dc021-a85c-4249-8e8d-44434bee97dd","Type":"ContainerStarted","Data":"8761cd8c17a0b5b80ec8b32c4c6593b61e65161eab4c2c366fa3e806143818bf"} Jul 06 18:24:08.584883 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.584716 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" event={"ID":"651dc021-a85c-4249-8e8d-44434bee97dd","Type":"ContainerStarted","Data":"50b7511948a037fd16131fe185b959beb70e5b54e4a1ccd63753b95c79d1eb78"} Jul 06 18:24:08.607042 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:08.606937 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" podStartSLOduration=0.606920917 podStartE2EDuration="606.920917ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:24:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:24:08.605601776 +0000 UTC m=+1969.290208744" watchObservedRunningTime="2026-07-06 18:24:08.606920917 +0000 UTC m=+1969.291527889" Jul 06 18:24:09.339938 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:09.339901 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:09.345186 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:09.345162 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:09.589701 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:09.589661 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:09.590786 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:09.590737 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:15.696464 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.696384 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m"] Jul 06 18:24:15.696950 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.696931 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a862b12c-c2f7-43cc-8ee1-4a488d462413" containerName="istio-proxy" Jul 06 18:24:15.697049 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.696954 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a862b12c-c2f7-43cc-8ee1-4a488d462413" containerName="istio-proxy" Jul 06 18:24:15.699164 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.699144 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:15.701999 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.701977 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-cd9691-openshift-default-dockercfg-7prhh\"" Jul 06 18:24:15.712970 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.712948 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m"] Jul 06 18:24:15.785512 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.785473 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-workload-certs\") pod \"e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:15.785512 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.785514 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-istio-data\") pod \"e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:15.785819 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.785533 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00095e57-8fba-46ec-9825-8c97fc91a02e-istio-podinfo\") pod \"e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:15.785819 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.785550 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-credential-socket\") pod \"e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:15.785819 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.785612 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00095e57-8fba-46ec-9825-8c97fc91a02e-istio-token\") pod \"e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:15.785819 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.785708 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00095e57-8fba-46ec-9825-8c97fc91a02e-istiod-ca-cert\") pod \"e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:15.785819 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.785748 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnqzq\" (UniqueName: \"kubernetes.io/projected/00095e57-8fba-46ec-9825-8c97fc91a02e-kube-api-access-bnqzq\") pod \"e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:15.785819 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.785789 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-workload-socket\") pod \"e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:15.786146 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.785858 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-istio-envoy\") pod \"e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:15.886716 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.886681 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00095e57-8fba-46ec-9825-8c97fc91a02e-istio-token\") pod \"e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:15.886924 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.886735 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00095e57-8fba-46ec-9825-8c97fc91a02e-istiod-ca-cert\") pod \"e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:15.886924 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.886751 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnqzq\" (UniqueName: \"kubernetes.io/projected/00095e57-8fba-46ec-9825-8c97fc91a02e-kube-api-access-bnqzq\") pod \"e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:15.886924 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.886770 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-workload-socket\") pod \"e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:15.886924 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.886807 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-istio-envoy\") pod \"e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:15.886924 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.886867 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-workload-certs\") pod \"e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:15.886924 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.886888 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-istio-data\") pod \"e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:15.886924 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.886911 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00095e57-8fba-46ec-9825-8c97fc91a02e-istio-podinfo\") pod \"e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:15.887343 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.886937 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-credential-socket\") pod \"e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:15.887343 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.887329 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-credential-socket\") pod \"e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:15.887453 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.887371 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-workload-certs\") pod \"e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:15.887453 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.887413 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-workload-socket\") pod \"e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:15.887565 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.887484 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-istio-data\") pod \"e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:15.887619 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.887583 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00095e57-8fba-46ec-9825-8c97fc91a02e-istiod-ca-cert\") pod \"e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:15.889441 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.889412 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-istio-envoy\") pod \"e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:15.889542 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.889497 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00095e57-8fba-46ec-9825-8c97fc91a02e-istio-podinfo\") pod \"e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:15.896112 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.896084 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00095e57-8fba-46ec-9825-8c97fc91a02e-istio-token\") pod \"e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:15.896265 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:15.896248 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnqzq\" (UniqueName: \"kubernetes.io/projected/00095e57-8fba-46ec-9825-8c97fc91a02e-kube-api-access-bnqzq\") pod \"e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:16.010346 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:16.010251 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:16.221853 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:16.221830 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m"] Jul 06 18:24:16.224649 ip-10-0-130-37 kubenswrapper[2578]: W0706 18:24:16.224617 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00095e57_8fba_46ec_9825_8c97fc91a02e.slice/crio-7022e714b4c8f2d380145e330f190a1943aaee45f326a26f63f008494a6d9a7a WatchSource:0}: Error finding container 7022e714b4c8f2d380145e330f190a1943aaee45f326a26f63f008494a6d9a7a: Status 404 returned error can't find the container with id 7022e714b4c8f2d380145e330f190a1943aaee45f326a26f63f008494a6d9a7a Jul 06 18:24:16.226929 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:16.226893 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:24:16.227075 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:16.226973 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:24:16.227075 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:16.227014 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:24:16.627958 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:16.627871 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" event={"ID":"00095e57-8fba-46ec-9825-8c97fc91a02e","Type":"ContainerStarted","Data":"80b94bd497fb881eba1b46e863d0f50212c63b59a13974a35123361730f29520"} Jul 06 18:24:16.627958 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:16.627925 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" event={"ID":"00095e57-8fba-46ec-9825-8c97fc91a02e","Type":"ContainerStarted","Data":"7022e714b4c8f2d380145e330f190a1943aaee45f326a26f63f008494a6d9a7a"} Jul 06 18:24:16.654871 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:16.654808 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" podStartSLOduration=1.654785141 podStartE2EDuration="1.654785141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:24:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:24:16.653903612 +0000 UTC m=+1977.338510584" watchObservedRunningTime="2026-07-06 18:24:16.654785141 +0000 UTC m=+1977.339392115" Jul 06 18:24:17.011286 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:17.011252 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:17.016153 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:17.016127 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:17.633576 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:17.633542 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:17.638510 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:17.638472 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:22.663748 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:22.663702 2578 generic.go:356] "Generic (PLEG): container finished" podID="651dc021-a85c-4249-8e8d-44434bee97dd" containerID="8761cd8c17a0b5b80ec8b32c4c6593b61e65161eab4c2c366fa3e806143818bf" exitCode=0 Jul 06 18:24:22.664095 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:22.663766 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" event={"ID":"651dc021-a85c-4249-8e8d-44434bee97dd","Type":"ContainerDied","Data":"8761cd8c17a0b5b80ec8b32c4c6593b61e65161eab4c2c366fa3e806143818bf"} Jul 06 18:24:22.664147 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:22.664134 2578 scope.go:117] "RemoveContainer" containerID="8761cd8c17a0b5b80ec8b32c4c6593b61e65161eab4c2c366fa3e806143818bf" Jul 06 18:24:22.665181 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:22.665151 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:24:22.665254 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:22.665222 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:24:22.665296 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:22.665261 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:24:23.669952 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:23.669916 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" event={"ID":"651dc021-a85c-4249-8e8d-44434bee97dd","Type":"ContainerStarted","Data":"5a033b772494279939f32dc6e3786f8c0c44b556d36bd47685adfabccac844ff"} Jul 06 18:24:24.340438 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:24.340390 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:24.341540 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:24.341506 2578 patch_prober.go:28] interesting pod/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 06 18:24:24.341663 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:24.341570 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" podUID="651dc021-a85c-4249-8e8d-44434bee97dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 06 18:24:24.589976 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:24.589949 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:25.339870 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:25.339821 2578 patch_prober.go:28] interesting pod/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 06 18:24:25.340421 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:25.339900 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" podUID="651dc021-a85c-4249-8e8d-44434bee97dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 06 18:24:26.340361 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:26.340318 2578 patch_prober.go:28] interesting pod/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 06 18:24:26.340837 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:26.340389 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" podUID="651dc021-a85c-4249-8e8d-44434bee97dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 06 18:24:27.340159 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:27.340112 2578 patch_prober.go:28] interesting pod/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 06 18:24:27.340370 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:27.340185 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" podUID="651dc021-a85c-4249-8e8d-44434bee97dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 06 18:24:28.358390 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:28.358359 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:28.359815 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:28.359791 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:24:33.635974 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:33.635240 2578 patch_prober.go:28] interesting pod/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 06 18:24:33.635974 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:33.635300 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" podUID="00095e57-8fba-46ec-9825-8c97fc91a02e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 06 18:24:33.719899 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:33.719868 2578 generic.go:356] "Generic (PLEG): container finished" podID="00095e57-8fba-46ec-9825-8c97fc91a02e" containerID="80b94bd497fb881eba1b46e863d0f50212c63b59a13974a35123361730f29520" exitCode=0 Jul 06 18:24:33.720106 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:33.719946 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" event={"ID":"00095e57-8fba-46ec-9825-8c97fc91a02e","Type":"ContainerDied","Data":"80b94bd497fb881eba1b46e863d0f50212c63b59a13974a35123361730f29520"} Jul 06 18:24:33.720441 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:33.720422 2578 scope.go:117] "RemoveContainer" containerID="80b94bd497fb881eba1b46e863d0f50212c63b59a13974a35123361730f29520" Jul 06 18:24:33.721489 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:33.721465 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:24:33.721546 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:33.721532 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:24:33.721588 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:33.721576 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:24:34.726359 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:34.726327 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" event={"ID":"00095e57-8fba-46ec-9825-8c97fc91a02e","Type":"ContainerStarted","Data":"f3489dd64c05ca72828908c7e9f26f6265e07df92579555cd4e8c44338da1c47"} Jul 06 18:24:35.011122 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:35.010992 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:35.011286 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:35.011243 2578 patch_prober.go:28] interesting pod/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 06 18:24:35.011351 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:35.011304 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" podUID="00095e57-8fba-46ec-9825-8c97fc91a02e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 06 18:24:36.010899 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:36.010849 2578 patch_prober.go:28] interesting pod/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 06 18:24:36.011332 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:36.010941 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" podUID="00095e57-8fba-46ec-9825-8c97fc91a02e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 06 18:24:37.010697 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:37.010663 2578 patch_prober.go:28] interesting pod/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 06 18:24:37.010882 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:37.010721 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" podUID="00095e57-8fba-46ec-9825-8c97fc91a02e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 06 18:24:38.011428 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:38.011385 2578 patch_prober.go:28] interesting pod/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 06 18:24:38.011939 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:38.011468 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" podUID="00095e57-8fba-46ec-9825-8c97fc91a02e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 06 18:24:39.014326 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:39.014296 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:39.014757 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:39.014660 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:24:39.015499 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:24:39.015482 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:26:01.102752 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:01.102721 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4"] Jul 06 18:26:01.103239 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:01.102937 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" podUID="651dc021-a85c-4249-8e8d-44434bee97dd" containerName="istio-proxy" containerID="cri-o://5a033b772494279939f32dc6e3786f8c0c44b556d36bd47685adfabccac844ff" gracePeriod=30 Jul 06 18:26:06.359699 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:06.359664 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:26:06.396094 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:06.395994 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/651dc021-a85c-4249-8e8d-44434bee97dd-istio-podinfo\") pod \"651dc021-a85c-4249-8e8d-44434bee97dd\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " Jul 06 18:26:06.396094 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:06.396071 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-credential-socket\") pod \"651dc021-a85c-4249-8e8d-44434bee97dd\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " Jul 06 18:26:06.396306 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:06.396103 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-istio-data\") pod \"651dc021-a85c-4249-8e8d-44434bee97dd\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " Jul 06 18:26:06.396306 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:06.396127 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-istio-envoy\") pod \"651dc021-a85c-4249-8e8d-44434bee97dd\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " Jul 06 18:26:06.396306 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:06.396180 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/651dc021-a85c-4249-8e8d-44434bee97dd-istio-token\") pod \"651dc021-a85c-4249-8e8d-44434bee97dd\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " Jul 06 18:26:06.396306 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:06.396238 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/651dc021-a85c-4249-8e8d-44434bee97dd-istiod-ca-cert\") pod \"651dc021-a85c-4249-8e8d-44434bee97dd\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " Jul 06 18:26:06.396306 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:06.396276 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v779q\" (UniqueName: \"kubernetes.io/projected/651dc021-a85c-4249-8e8d-44434bee97dd-kube-api-access-v779q\") pod \"651dc021-a85c-4249-8e8d-44434bee97dd\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " Jul 06 18:26:06.396306 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:06.396299 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-workload-certs\") pod \"651dc021-a85c-4249-8e8d-44434bee97dd\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " Jul 06 18:26:06.396598 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:06.396380 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-workload-socket\") pod \"651dc021-a85c-4249-8e8d-44434bee97dd\" (UID: \"651dc021-a85c-4249-8e8d-44434bee97dd\") " Jul 06 18:26:06.396598 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:06.396380 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "651dc021-a85c-4249-8e8d-44434bee97dd" (UID: "651dc021-a85c-4249-8e8d-44434bee97dd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:26:06.396716 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:06.396692 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-credential-socket\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:06.397402 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:06.397282 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "651dc021-a85c-4249-8e8d-44434bee97dd" (UID: "651dc021-a85c-4249-8e8d-44434bee97dd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:26:06.397402 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:06.397293 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-istio-data" (OuterVolumeSpecName: "istio-data") pod "651dc021-a85c-4249-8e8d-44434bee97dd" (UID: "651dc021-a85c-4249-8e8d-44434bee97dd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:26:06.397402 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:06.397313 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/651dc021-a85c-4249-8e8d-44434bee97dd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "651dc021-a85c-4249-8e8d-44434bee97dd" (UID: "651dc021-a85c-4249-8e8d-44434bee97dd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:26:06.397634 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:06.397525 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "651dc021-a85c-4249-8e8d-44434bee97dd" (UID: "651dc021-a85c-4249-8e8d-44434bee97dd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:26:06.398705 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:06.398667 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/651dc021-a85c-4249-8e8d-44434bee97dd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "651dc021-a85c-4249-8e8d-44434bee97dd" (UID: "651dc021-a85c-4249-8e8d-44434bee97dd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 18:26:06.398830 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:06.398789 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/651dc021-a85c-4249-8e8d-44434bee97dd-kube-api-access-v779q" (OuterVolumeSpecName: "kube-api-access-v779q") pod "651dc021-a85c-4249-8e8d-44434bee97dd" (UID: "651dc021-a85c-4249-8e8d-44434bee97dd"). InnerVolumeSpecName "kube-api-access-v779q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:26:06.399218 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:06.399195 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/651dc021-a85c-4249-8e8d-44434bee97dd-istio-token" (OuterVolumeSpecName: "istio-token") pod "651dc021-a85c-4249-8e8d-44434bee97dd" (UID: "651dc021-a85c-4249-8e8d-44434bee97dd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:26:06.399318 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:06.399251 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "651dc021-a85c-4249-8e8d-44434bee97dd" (UID: "651dc021-a85c-4249-8e8d-44434bee97dd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:26:06.497827 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:06.497789 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-workload-socket\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:06.497827 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:06.497822 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/651dc021-a85c-4249-8e8d-44434bee97dd-istio-podinfo\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:06.497827 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:06.497832 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-istio-data\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:06.497827 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:06.497840 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-istio-envoy\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:06.498151 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:06.497847 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/651dc021-a85c-4249-8e8d-44434bee97dd-istio-token\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:06.498151 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:06.497855 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/651dc021-a85c-4249-8e8d-44434bee97dd-istiod-ca-cert\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:06.498151 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:06.497863 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v779q\" (UniqueName: \"kubernetes.io/projected/651dc021-a85c-4249-8e8d-44434bee97dd-kube-api-access-v779q\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:06.498151 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:06.497872 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/651dc021-a85c-4249-8e8d-44434bee97dd-workload-certs\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:07.161598 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:07.161560 2578 generic.go:356] "Generic (PLEG): container finished" podID="651dc021-a85c-4249-8e8d-44434bee97dd" containerID="5a033b772494279939f32dc6e3786f8c0c44b556d36bd47685adfabccac844ff" exitCode=0 Jul 06 18:26:07.161762 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:07.161599 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" event={"ID":"651dc021-a85c-4249-8e8d-44434bee97dd","Type":"ContainerDied","Data":"5a033b772494279939f32dc6e3786f8c0c44b556d36bd47685adfabccac844ff"} Jul 06 18:26:07.161762 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:07.161624 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" Jul 06 18:26:07.161762 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:07.161653 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4" event={"ID":"651dc021-a85c-4249-8e8d-44434bee97dd","Type":"ContainerDied","Data":"50b7511948a037fd16131fe185b959beb70e5b54e4a1ccd63753b95c79d1eb78"} Jul 06 18:26:07.161762 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:07.161690 2578 scope.go:117] "RemoveContainer" containerID="5a033b772494279939f32dc6e3786f8c0c44b556d36bd47685adfabccac844ff" Jul 06 18:26:07.170307 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:07.170187 2578 scope.go:117] "RemoveContainer" containerID="8761cd8c17a0b5b80ec8b32c4c6593b61e65161eab4c2c366fa3e806143818bf" Jul 06 18:26:07.177795 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:07.177779 2578 scope.go:117] "RemoveContainer" containerID="5a033b772494279939f32dc6e3786f8c0c44b556d36bd47685adfabccac844ff" Jul 06 18:26:07.178100 ip-10-0-130-37 kubenswrapper[2578]: E0706 18:26:07.178082 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a033b772494279939f32dc6e3786f8c0c44b556d36bd47685adfabccac844ff\": container with ID starting with 5a033b772494279939f32dc6e3786f8c0c44b556d36bd47685adfabccac844ff not found: ID does not exist" containerID="5a033b772494279939f32dc6e3786f8c0c44b556d36bd47685adfabccac844ff" Jul 06 18:26:07.178156 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:07.178108 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a033b772494279939f32dc6e3786f8c0c44b556d36bd47685adfabccac844ff"} err="failed to get container status \"5a033b772494279939f32dc6e3786f8c0c44b556d36bd47685adfabccac844ff\": rpc error: code = NotFound desc = could not find container \"5a033b772494279939f32dc6e3786f8c0c44b556d36bd47685adfabccac844ff\": container with ID starting with 5a033b772494279939f32dc6e3786f8c0c44b556d36bd47685adfabccac844ff not found: ID does not exist" Jul 06 18:26:07.178156 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:07.178138 2578 scope.go:117] "RemoveContainer" containerID="8761cd8c17a0b5b80ec8b32c4c6593b61e65161eab4c2c366fa3e806143818bf" Jul 06 18:26:07.178378 ip-10-0-130-37 kubenswrapper[2578]: E0706 18:26:07.178358 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8761cd8c17a0b5b80ec8b32c4c6593b61e65161eab4c2c366fa3e806143818bf\": container with ID starting with 8761cd8c17a0b5b80ec8b32c4c6593b61e65161eab4c2c366fa3e806143818bf not found: ID does not exist" containerID="8761cd8c17a0b5b80ec8b32c4c6593b61e65161eab4c2c366fa3e806143818bf" Jul 06 18:26:07.178436 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:07.178387 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8761cd8c17a0b5b80ec8b32c4c6593b61e65161eab4c2c366fa3e806143818bf"} err="failed to get container status \"8761cd8c17a0b5b80ec8b32c4c6593b61e65161eab4c2c366fa3e806143818bf\": rpc error: code = NotFound desc = could not find container \"8761cd8c17a0b5b80ec8b32c4c6593b61e65161eab4c2c366fa3e806143818bf\": container with ID starting with 8761cd8c17a0b5b80ec8b32c4c6593b61e65161eab4c2c366fa3e806143818bf not found: ID does not exist" Jul 06 18:26:07.181356 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:07.181338 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4"] Jul 06 18:26:07.185195 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:07.185175 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-a9cadd-openshift-default-65c86554d5-gbld4"] Jul 06 18:26:08.666619 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:08.666583 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m"] Jul 06 18:26:08.666991 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:08.666826 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" podUID="00095e57-8fba-46ec-9825-8c97fc91a02e" containerName="istio-proxy" containerID="cri-o://f3489dd64c05ca72828908c7e9f26f6265e07df92579555cd4e8c44338da1c47" gracePeriod=30 Jul 06 18:26:08.934977 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:08.934947 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="651dc021-a85c-4249-8e8d-44434bee97dd" path="/var/lib/kubelet/pods/651dc021-a85c-4249-8e8d-44434bee97dd/volumes" Jul 06 18:26:09.017541 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.017510 2578 patch_prober.go:28] interesting pod/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 18:26:09.017698 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.017575 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" podUID="00095e57-8fba-46ec-9825-8c97fc91a02e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 18:26:09.600633 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.600599 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4"] Jul 06 18:26:09.600964 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.600953 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="651dc021-a85c-4249-8e8d-44434bee97dd" containerName="istio-proxy" Jul 06 18:26:09.601009 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.600966 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="651dc021-a85c-4249-8e8d-44434bee97dd" containerName="istio-proxy" Jul 06 18:26:09.601009 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.600975 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="651dc021-a85c-4249-8e8d-44434bee97dd" containerName="istio-proxy" Jul 06 18:26:09.601009 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.600980 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="651dc021-a85c-4249-8e8d-44434bee97dd" containerName="istio-proxy" Jul 06 18:26:09.601121 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.601072 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="651dc021-a85c-4249-8e8d-44434bee97dd" containerName="istio-proxy" Jul 06 18:26:09.601121 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.601083 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="651dc021-a85c-4249-8e8d-44434bee97dd" containerName="istio-proxy" Jul 06 18:26:09.604076 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.604054 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:09.607034 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.607007 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-1ee192-openshift-default-dockercfg-zkl7j\"" Jul 06 18:26:09.618837 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.618814 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4"] Jul 06 18:26:09.729109 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.729075 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-istio-data\") pod \"e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:09.729474 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.729125 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-workload-certs\") pod \"e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:09.729474 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.729150 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80464afc-01b1-46a8-961c-a15dd48c208d-istio-token\") pod \"e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:09.729474 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.729168 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-credential-socket\") pod \"e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:09.729474 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.729195 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-istio-envoy\") pod \"e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:09.729474 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.729315 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-workload-socket\") pod \"e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:09.729474 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.729342 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80464afc-01b1-46a8-961c-a15dd48c208d-istiod-ca-cert\") pod \"e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:09.729474 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.729417 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns76f\" (UniqueName: \"kubernetes.io/projected/80464afc-01b1-46a8-961c-a15dd48c208d-kube-api-access-ns76f\") pod \"e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:09.729474 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.729450 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80464afc-01b1-46a8-961c-a15dd48c208d-istio-podinfo\") pod \"e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:09.830008 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.829976 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-workload-socket\") pod \"e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:09.830008 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.830010 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80464afc-01b1-46a8-961c-a15dd48c208d-istiod-ca-cert\") pod \"e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:09.830248 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.830075 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns76f\" (UniqueName: \"kubernetes.io/projected/80464afc-01b1-46a8-961c-a15dd48c208d-kube-api-access-ns76f\") pod \"e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:09.830248 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.830098 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80464afc-01b1-46a8-961c-a15dd48c208d-istio-podinfo\") pod \"e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:09.830248 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.830172 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-istio-data\") pod \"e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:09.830248 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.830225 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-workload-certs\") pod \"e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:09.830458 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.830254 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80464afc-01b1-46a8-961c-a15dd48c208d-istio-token\") pod \"e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:09.830458 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.830281 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-credential-socket\") pod \"e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:09.830458 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.830397 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-workload-socket\") pod \"e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:09.830458 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.830400 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-istio-envoy\") pod \"e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:09.830683 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.830577 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-istio-data\") pod \"e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:09.830683 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.830594 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-workload-certs\") pod \"e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:09.830683 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.830649 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-credential-socket\") pod \"e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:09.830945 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.830925 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80464afc-01b1-46a8-961c-a15dd48c208d-istiod-ca-cert\") pod \"e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:09.832980 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.832934 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-istio-envoy\") pod \"e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:09.833194 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.833172 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80464afc-01b1-46a8-961c-a15dd48c208d-istio-podinfo\") pod \"e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:09.843017 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.842989 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80464afc-01b1-46a8-961c-a15dd48c208d-istio-token\") pod \"e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:09.843320 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.843300 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns76f\" (UniqueName: \"kubernetes.io/projected/80464afc-01b1-46a8-961c-a15dd48c208d-kube-api-access-ns76f\") pod \"e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:09.913912 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:09.913833 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:10.060062 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:10.060014 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4"] Jul 06 18:26:10.063512 ip-10-0-130-37 kubenswrapper[2578]: W0706 18:26:10.063488 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80464afc_01b1_46a8_961c_a15dd48c208d.slice/crio-33cb9909c602542c55bcb9c73bd9c53f58407354053bf5555639ac3fecc09f7c WatchSource:0}: Error finding container 33cb9909c602542c55bcb9c73bd9c53f58407354053bf5555639ac3fecc09f7c: Status 404 returned error can't find the container with id 33cb9909c602542c55bcb9c73bd9c53f58407354053bf5555639ac3fecc09f7c Jul 06 18:26:10.065725 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:10.065691 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:26:10.065816 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:10.065757 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:26:10.065816 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:10.065794 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:26:10.180934 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:10.180888 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" event={"ID":"80464afc-01b1-46a8-961c-a15dd48c208d","Type":"ContainerStarted","Data":"d249315c8589d2f33e5aafc7c73fd4e762d74ea158ce404abeed7aa42961ba30"} Jul 06 18:26:10.181148 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:10.180956 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" event={"ID":"80464afc-01b1-46a8-961c-a15dd48c208d","Type":"ContainerStarted","Data":"33cb9909c602542c55bcb9c73bd9c53f58407354053bf5555639ac3fecc09f7c"} Jul 06 18:26:10.207668 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:10.207448 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" podStartSLOduration=1.207427948 podStartE2EDuration="1.207427948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:26:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:26:10.204281252 +0000 UTC m=+2090.888888225" watchObservedRunningTime="2026-07-06 18:26:10.207427948 +0000 UTC m=+2090.892034921" Jul 06 18:26:10.914135 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:10.914092 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:11.920261 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:11.920234 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:12.189747 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:12.189719 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:12.190664 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:12.190644 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:13.930959 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:13.930903 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:26:14.069769 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.069736 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00095e57-8fba-46ec-9825-8c97fc91a02e-istio-podinfo\") pod \"00095e57-8fba-46ec-9825-8c97fc91a02e\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " Jul 06 18:26:14.069956 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.069776 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-workload-socket\") pod \"00095e57-8fba-46ec-9825-8c97fc91a02e\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " Jul 06 18:26:14.069956 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.069822 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-workload-certs\") pod \"00095e57-8fba-46ec-9825-8c97fc91a02e\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " Jul 06 18:26:14.069956 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.069847 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00095e57-8fba-46ec-9825-8c97fc91a02e-istiod-ca-cert\") pod \"00095e57-8fba-46ec-9825-8c97fc91a02e\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " Jul 06 18:26:14.069956 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.069868 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-istio-envoy\") pod \"00095e57-8fba-46ec-9825-8c97fc91a02e\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " Jul 06 18:26:14.069956 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.069884 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-credential-socket\") pod \"00095e57-8fba-46ec-9825-8c97fc91a02e\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " Jul 06 18:26:14.069956 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.069934 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-istio-data\") pod \"00095e57-8fba-46ec-9825-8c97fc91a02e\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " Jul 06 18:26:14.069956 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.069958 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00095e57-8fba-46ec-9825-8c97fc91a02e-istio-token\") pod \"00095e57-8fba-46ec-9825-8c97fc91a02e\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " Jul 06 18:26:14.070379 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.069984 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnqzq\" (UniqueName: \"kubernetes.io/projected/00095e57-8fba-46ec-9825-8c97fc91a02e-kube-api-access-bnqzq\") pod \"00095e57-8fba-46ec-9825-8c97fc91a02e\" (UID: \"00095e57-8fba-46ec-9825-8c97fc91a02e\") " Jul 06 18:26:14.070379 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.070178 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "00095e57-8fba-46ec-9825-8c97fc91a02e" (UID: "00095e57-8fba-46ec-9825-8c97fc91a02e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:26:14.070379 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.070211 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "00095e57-8fba-46ec-9825-8c97fc91a02e" (UID: "00095e57-8fba-46ec-9825-8c97fc91a02e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:26:14.070379 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.070222 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "00095e57-8fba-46ec-9825-8c97fc91a02e" (UID: "00095e57-8fba-46ec-9825-8c97fc91a02e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:26:14.070379 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.070322 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00095e57-8fba-46ec-9825-8c97fc91a02e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "00095e57-8fba-46ec-9825-8c97fc91a02e" (UID: "00095e57-8fba-46ec-9825-8c97fc91a02e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:26:14.070379 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.070350 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-credential-socket\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:14.070379 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.070368 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-workload-socket\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:14.070379 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.070381 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-workload-certs\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:14.070809 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.070778 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-istio-data" (OuterVolumeSpecName: "istio-data") pod "00095e57-8fba-46ec-9825-8c97fc91a02e" (UID: "00095e57-8fba-46ec-9825-8c97fc91a02e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:26:14.072301 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.072275 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/00095e57-8fba-46ec-9825-8c97fc91a02e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "00095e57-8fba-46ec-9825-8c97fc91a02e" (UID: "00095e57-8fba-46ec-9825-8c97fc91a02e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 18:26:14.072409 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.072313 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00095e57-8fba-46ec-9825-8c97fc91a02e-kube-api-access-bnqzq" (OuterVolumeSpecName: "kube-api-access-bnqzq") pod "00095e57-8fba-46ec-9825-8c97fc91a02e" (UID: "00095e57-8fba-46ec-9825-8c97fc91a02e"). InnerVolumeSpecName "kube-api-access-bnqzq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:26:14.072515 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.072495 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "00095e57-8fba-46ec-9825-8c97fc91a02e" (UID: "00095e57-8fba-46ec-9825-8c97fc91a02e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:26:14.072558 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.072498 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00095e57-8fba-46ec-9825-8c97fc91a02e-istio-token" (OuterVolumeSpecName: "istio-token") pod "00095e57-8fba-46ec-9825-8c97fc91a02e" (UID: "00095e57-8fba-46ec-9825-8c97fc91a02e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:26:14.171163 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.171131 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-istio-data\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:14.171163 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.171159 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00095e57-8fba-46ec-9825-8c97fc91a02e-istio-token\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:14.171163 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.171169 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnqzq\" (UniqueName: \"kubernetes.io/projected/00095e57-8fba-46ec-9825-8c97fc91a02e-kube-api-access-bnqzq\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:14.171374 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.171179 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00095e57-8fba-46ec-9825-8c97fc91a02e-istio-podinfo\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:14.171374 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.171187 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00095e57-8fba-46ec-9825-8c97fc91a02e-istiod-ca-cert\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:14.171374 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.171195 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00095e57-8fba-46ec-9825-8c97fc91a02e-istio-envoy\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:14.199376 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.199306 2578 generic.go:356] "Generic (PLEG): container finished" podID="00095e57-8fba-46ec-9825-8c97fc91a02e" containerID="f3489dd64c05ca72828908c7e9f26f6265e07df92579555cd4e8c44338da1c47" exitCode=0 Jul 06 18:26:14.199376 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.199360 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" Jul 06 18:26:14.199539 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.199392 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" event={"ID":"00095e57-8fba-46ec-9825-8c97fc91a02e","Type":"ContainerDied","Data":"f3489dd64c05ca72828908c7e9f26f6265e07df92579555cd4e8c44338da1c47"} Jul 06 18:26:14.199539 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.199455 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m" event={"ID":"00095e57-8fba-46ec-9825-8c97fc91a02e","Type":"ContainerDied","Data":"7022e714b4c8f2d380145e330f190a1943aaee45f326a26f63f008494a6d9a7a"} Jul 06 18:26:14.199539 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.199487 2578 scope.go:117] "RemoveContainer" containerID="f3489dd64c05ca72828908c7e9f26f6265e07df92579555cd4e8c44338da1c47" Jul 06 18:26:14.208256 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.208240 2578 scope.go:117] "RemoveContainer" containerID="80b94bd497fb881eba1b46e863d0f50212c63b59a13974a35123361730f29520" Jul 06 18:26:14.216158 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.216142 2578 scope.go:117] "RemoveContainer" containerID="f3489dd64c05ca72828908c7e9f26f6265e07df92579555cd4e8c44338da1c47" Jul 06 18:26:14.216441 ip-10-0-130-37 kubenswrapper[2578]: E0706 18:26:14.216422 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3489dd64c05ca72828908c7e9f26f6265e07df92579555cd4e8c44338da1c47\": container with ID starting with f3489dd64c05ca72828908c7e9f26f6265e07df92579555cd4e8c44338da1c47 not found: ID does not exist" containerID="f3489dd64c05ca72828908c7e9f26f6265e07df92579555cd4e8c44338da1c47" Jul 06 18:26:14.216535 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.216445 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3489dd64c05ca72828908c7e9f26f6265e07df92579555cd4e8c44338da1c47"} err="failed to get container status \"f3489dd64c05ca72828908c7e9f26f6265e07df92579555cd4e8c44338da1c47\": rpc error: code = NotFound desc = could not find container \"f3489dd64c05ca72828908c7e9f26f6265e07df92579555cd4e8c44338da1c47\": container with ID starting with f3489dd64c05ca72828908c7e9f26f6265e07df92579555cd4e8c44338da1c47 not found: ID does not exist" Jul 06 18:26:14.216535 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.216461 2578 scope.go:117] "RemoveContainer" containerID="80b94bd497fb881eba1b46e863d0f50212c63b59a13974a35123361730f29520" Jul 06 18:26:14.216682 ip-10-0-130-37 kubenswrapper[2578]: E0706 18:26:14.216667 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80b94bd497fb881eba1b46e863d0f50212c63b59a13974a35123361730f29520\": container with ID starting with 80b94bd497fb881eba1b46e863d0f50212c63b59a13974a35123361730f29520 not found: ID does not exist" containerID="80b94bd497fb881eba1b46e863d0f50212c63b59a13974a35123361730f29520" Jul 06 18:26:14.216725 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.216686 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80b94bd497fb881eba1b46e863d0f50212c63b59a13974a35123361730f29520"} err="failed to get container status \"80b94bd497fb881eba1b46e863d0f50212c63b59a13974a35123361730f29520\": rpc error: code = NotFound desc = could not find container \"80b94bd497fb881eba1b46e863d0f50212c63b59a13974a35123361730f29520\": container with ID starting with 80b94bd497fb881eba1b46e863d0f50212c63b59a13974a35123361730f29520 not found: ID does not exist" Jul 06 18:26:14.231251 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.231229 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m"] Jul 06 18:26:14.241742 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.241715 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-cd9691-openshift-default-7b5df65dd7-nrz5m"] Jul 06 18:26:14.935588 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:14.935551 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00095e57-8fba-46ec-9825-8c97fc91a02e" path="/var/lib/kubelet/pods/00095e57-8fba-46ec-9825-8c97fc91a02e/volumes" Jul 06 18:26:17.467217 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.467180 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc"] Jul 06 18:26:17.467565 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.467517 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00095e57-8fba-46ec-9825-8c97fc91a02e" containerName="istio-proxy" Jul 06 18:26:17.467565 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.467528 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="00095e57-8fba-46ec-9825-8c97fc91a02e" containerName="istio-proxy" Jul 06 18:26:17.467636 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.467594 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="00095e57-8fba-46ec-9825-8c97fc91a02e" containerName="istio-proxy" Jul 06 18:26:17.467636 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.467602 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="00095e57-8fba-46ec-9825-8c97fc91a02e" containerName="istio-proxy" Jul 06 18:26:17.472122 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.472101 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:17.474809 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.474790 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-30a7ce-openshift-default-dockercfg-ldgtw\"" Jul 06 18:26:17.486410 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.486384 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc"] Jul 06 18:26:17.601521 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.601486 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istio-envoy\") pod \"e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:17.601521 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.601533 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-workload-socket\") pod \"e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:17.601745 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.601557 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-workload-certs\") pod \"e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:17.601745 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.601616 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istio-podinfo\") pod \"e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:17.601745 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.601684 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nrp2\" (UniqueName: \"kubernetes.io/projected/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-kube-api-access-8nrp2\") pod \"e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:17.601745 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.601712 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istio-token\") pod \"e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:17.601878 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.601754 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istio-data\") pod \"e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:17.601878 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.601794 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istiod-ca-cert\") pod \"e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:17.601878 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.601838 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-credential-socket\") pod \"e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:17.702848 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.702794 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istiod-ca-cert\") pod \"e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:17.703062 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.702881 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-credential-socket\") pod \"e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:17.703062 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.702925 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istio-envoy\") pod \"e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:17.703062 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.702965 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-workload-socket\") pod \"e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:17.703062 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.702995 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-workload-certs\") pod \"e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:17.703062 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.703047 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istio-podinfo\") pod \"e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:17.703355 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.703097 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nrp2\" (UniqueName: \"kubernetes.io/projected/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-kube-api-access-8nrp2\") pod \"e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:17.703355 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.703132 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istio-token\") pod \"e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:17.703355 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.703192 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istio-data\") pod \"e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:17.703355 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.703338 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-credential-socket\") pod \"e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:17.703562 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.703543 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-workload-socket\") pod \"e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:17.703625 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.703559 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istio-data\") pod \"e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:17.703677 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.703624 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istiod-ca-cert\") pod \"e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:17.703803 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.703779 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-workload-certs\") pod \"e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:17.705335 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.705313 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istio-envoy\") pod \"e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:17.705715 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.705692 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istio-podinfo\") pod \"e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:17.712928 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.712905 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istio-token\") pod \"e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:17.713058 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.712964 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nrp2\" (UniqueName: \"kubernetes.io/projected/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-kube-api-access-8nrp2\") pod \"e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:17.783074 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.783004 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:17.925997 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.925950 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc"] Jul 06 18:26:17.928178 ip-10-0-130-37 kubenswrapper[2578]: W0706 18:26:17.928151 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96418a9a_9f3d_4319_9fe4_8f5c24a6c7bb.slice/crio-f526078ea410b60388d40a407e5a159a651fd582b5cc82a56c1403c8653855a3 WatchSource:0}: Error finding container f526078ea410b60388d40a407e5a159a651fd582b5cc82a56c1403c8653855a3: Status 404 returned error can't find the container with id f526078ea410b60388d40a407e5a159a651fd582b5cc82a56c1403c8653855a3 Jul 06 18:26:17.930213 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.930178 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:26:17.930310 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.930242 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:26:17.930310 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:17.930271 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:26:18.221975 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:18.221936 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" event={"ID":"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb","Type":"ContainerStarted","Data":"9c33fe8978282e40d25a6ff58734177415ac5f69f249f4cf88533cf218903c8d"} Jul 06 18:26:18.222157 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:18.221992 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" event={"ID":"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb","Type":"ContainerStarted","Data":"f526078ea410b60388d40a407e5a159a651fd582b5cc82a56c1403c8653855a3"} Jul 06 18:26:18.246558 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:18.246507 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" podStartSLOduration=1.246491424 podStartE2EDuration="1.246491424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:26:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:26:18.24459128 +0000 UTC m=+2098.929198253" watchObservedRunningTime="2026-07-06 18:26:18.246491424 +0000 UTC m=+2098.931098396" Jul 06 18:26:18.784208 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:18.784169 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:18.789087 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:18.789064 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:19.227538 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:19.227513 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:19.228624 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:19.228603 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:27.396950 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:27.396421 2578 patch_prober.go:28] interesting pod/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": read tcp 10.132.0.2:39734->10.132.0.51:15021: read: connection reset by peer" start-of-body= Jul 06 18:26:27.396950 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:27.396488 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" podUID="80464afc-01b1-46a8-961c-a15dd48c208d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": read tcp 10.132.0.2:39734->10.132.0.51:15021: read: connection reset by peer" Jul 06 18:26:28.281049 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:28.280994 2578 generic.go:356] "Generic (PLEG): container finished" podID="80464afc-01b1-46a8-961c-a15dd48c208d" containerID="d249315c8589d2f33e5aafc7c73fd4e762d74ea158ce404abeed7aa42961ba30" exitCode=0 Jul 06 18:26:28.281223 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:28.281067 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" event={"ID":"80464afc-01b1-46a8-961c-a15dd48c208d","Type":"ContainerDied","Data":"d249315c8589d2f33e5aafc7c73fd4e762d74ea158ce404abeed7aa42961ba30"} Jul 06 18:26:28.281581 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:28.281565 2578 scope.go:117] "RemoveContainer" containerID="d249315c8589d2f33e5aafc7c73fd4e762d74ea158ce404abeed7aa42961ba30" Jul 06 18:26:28.282671 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:28.282638 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:26:28.282781 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:28.282725 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:26:28.282781 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:28.282768 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:26:29.288870 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:29.288834 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" event={"ID":"80464afc-01b1-46a8-961c-a15dd48c208d","Type":"ContainerStarted","Data":"074c9b731bfbda3910f476b26ba8c1245d64b4d269febe3275797318262134d2"} Jul 06 18:26:29.914096 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:29.914066 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:29.914310 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:29.914217 2578 patch_prober.go:28] interesting pod/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 06 18:26:29.914310 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:29.914266 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" podUID="80464afc-01b1-46a8-961c-a15dd48c208d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 06 18:26:30.914545 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:30.914490 2578 patch_prober.go:28] interesting pod/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 06 18:26:30.914911 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:30.914568 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" podUID="80464afc-01b1-46a8-961c-a15dd48c208d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 06 18:26:31.914562 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:31.914529 2578 patch_prober.go:28] interesting pod/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 06 18:26:31.914920 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:31.914583 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" podUID="80464afc-01b1-46a8-961c-a15dd48c208d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 06 18:26:32.914125 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:32.914091 2578 patch_prober.go:28] interesting pod/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 06 18:26:32.914294 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:32.914139 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" podUID="80464afc-01b1-46a8-961c-a15dd48c208d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 06 18:26:33.918553 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:33.918518 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:33.918944 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:33.918888 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:33.919570 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:33.919547 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:35.269186 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:35.269149 2578 patch_prober.go:28] interesting pod/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 06 18:26:35.269616 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:35.269228 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" podUID="96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 06 18:26:36.323771 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:36.323719 2578 generic.go:356] "Generic (PLEG): container finished" podID="96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb" containerID="9c33fe8978282e40d25a6ff58734177415ac5f69f249f4cf88533cf218903c8d" exitCode=0 Jul 06 18:26:36.324193 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:36.323793 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" event={"ID":"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb","Type":"ContainerDied","Data":"9c33fe8978282e40d25a6ff58734177415ac5f69f249f4cf88533cf218903c8d"} Jul 06 18:26:36.324240 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:36.324202 2578 scope.go:117] "RemoveContainer" containerID="9c33fe8978282e40d25a6ff58734177415ac5f69f249f4cf88533cf218903c8d" Jul 06 18:26:36.325154 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:36.325129 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:26:36.325209 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:36.325193 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:26:36.325244 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:36.325225 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:26:37.330203 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:37.330171 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" event={"ID":"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb","Type":"ContainerStarted","Data":"a1a3110f3dbb2e336638e3258e8323994b56a827c85fa53453502e9a462a8369"} Jul 06 18:26:37.784080 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:37.784016 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:37.784403 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:37.784383 2578 patch_prober.go:28] interesting pod/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 06 18:26:37.784450 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:37.784431 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" podUID="96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 06 18:26:38.784293 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:38.784252 2578 patch_prober.go:28] interesting pod/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 06 18:26:38.784770 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:38.784317 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" podUID="96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 06 18:26:39.719503 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:39.719470 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4"] Jul 06 18:26:39.719705 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:39.719662 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" podUID="80464afc-01b1-46a8-961c-a15dd48c208d" containerName="istio-proxy" containerID="cri-o://074c9b731bfbda3910f476b26ba8c1245d64b4d269febe3275797318262134d2" gracePeriod=30 Jul 06 18:26:39.783546 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:39.783514 2578 patch_prober.go:28] interesting pod/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 06 18:26:39.783723 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:39.783567 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" podUID="96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 06 18:26:40.783761 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:40.783702 2578 patch_prober.go:28] interesting pod/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 06 18:26:40.784183 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:40.783777 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" podUID="96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 06 18:26:41.787128 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:41.787093 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:41.787516 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:41.787369 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:41.788141 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:41.788119 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:44.986352 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:44.986295 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:45.070329 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.070297 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-istio-envoy\") pod \"80464afc-01b1-46a8-961c-a15dd48c208d\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " Jul 06 18:26:45.070509 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.070343 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-credential-socket\") pod \"80464afc-01b1-46a8-961c-a15dd48c208d\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " Jul 06 18:26:45.070509 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.070365 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80464afc-01b1-46a8-961c-a15dd48c208d-istiod-ca-cert\") pod \"80464afc-01b1-46a8-961c-a15dd48c208d\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " Jul 06 18:26:45.070509 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.070387 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80464afc-01b1-46a8-961c-a15dd48c208d-istio-token\") pod \"80464afc-01b1-46a8-961c-a15dd48c208d\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " Jul 06 18:26:45.070509 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.070409 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-workload-socket\") pod \"80464afc-01b1-46a8-961c-a15dd48c208d\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " Jul 06 18:26:45.070509 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.070454 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ns76f\" (UniqueName: \"kubernetes.io/projected/80464afc-01b1-46a8-961c-a15dd48c208d-kube-api-access-ns76f\") pod \"80464afc-01b1-46a8-961c-a15dd48c208d\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " Jul 06 18:26:45.070790 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.070542 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-workload-certs\") pod \"80464afc-01b1-46a8-961c-a15dd48c208d\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " Jul 06 18:26:45.070790 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.070570 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-istio-data\") pod \"80464afc-01b1-46a8-961c-a15dd48c208d\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " Jul 06 18:26:45.070790 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.070595 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80464afc-01b1-46a8-961c-a15dd48c208d-istio-podinfo\") pod \"80464afc-01b1-46a8-961c-a15dd48c208d\" (UID: \"80464afc-01b1-46a8-961c-a15dd48c208d\") " Jul 06 18:26:45.070790 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.070595 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "80464afc-01b1-46a8-961c-a15dd48c208d" (UID: "80464afc-01b1-46a8-961c-a15dd48c208d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:26:45.070945 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.070785 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80464afc-01b1-46a8-961c-a15dd48c208d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "80464afc-01b1-46a8-961c-a15dd48c208d" (UID: "80464afc-01b1-46a8-961c-a15dd48c208d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:26:45.070945 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.070886 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "80464afc-01b1-46a8-961c-a15dd48c208d" (UID: "80464afc-01b1-46a8-961c-a15dd48c208d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:26:45.070945 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.070880 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "80464afc-01b1-46a8-961c-a15dd48c208d" (UID: "80464afc-01b1-46a8-961c-a15dd48c208d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:26:45.071128 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.071109 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-workload-certs\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:45.071178 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.071132 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-credential-socket\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:45.071178 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.071146 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80464afc-01b1-46a8-961c-a15dd48c208d-istiod-ca-cert\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:45.071178 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.071160 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-workload-socket\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:45.071774 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.071729 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-istio-data" (OuterVolumeSpecName: "istio-data") pod "80464afc-01b1-46a8-961c-a15dd48c208d" (UID: "80464afc-01b1-46a8-961c-a15dd48c208d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:26:45.072679 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.072644 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "80464afc-01b1-46a8-961c-a15dd48c208d" (UID: "80464afc-01b1-46a8-961c-a15dd48c208d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:26:45.072918 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.072886 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80464afc-01b1-46a8-961c-a15dd48c208d-kube-api-access-ns76f" (OuterVolumeSpecName: "kube-api-access-ns76f") pod "80464afc-01b1-46a8-961c-a15dd48c208d" (UID: "80464afc-01b1-46a8-961c-a15dd48c208d"). InnerVolumeSpecName "kube-api-access-ns76f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:26:45.073099 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.073063 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/80464afc-01b1-46a8-961c-a15dd48c208d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "80464afc-01b1-46a8-961c-a15dd48c208d" (UID: "80464afc-01b1-46a8-961c-a15dd48c208d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 18:26:45.073099 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.073060 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80464afc-01b1-46a8-961c-a15dd48c208d-istio-token" (OuterVolumeSpecName: "istio-token") pod "80464afc-01b1-46a8-961c-a15dd48c208d" (UID: "80464afc-01b1-46a8-961c-a15dd48c208d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:26:45.172400 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.172370 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-istio-data\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:45.172400 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.172397 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80464afc-01b1-46a8-961c-a15dd48c208d-istio-podinfo\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:45.172400 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.172407 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80464afc-01b1-46a8-961c-a15dd48c208d-istio-envoy\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:45.172666 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.172414 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80464afc-01b1-46a8-961c-a15dd48c208d-istio-token\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:45.172666 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.172423 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ns76f\" (UniqueName: \"kubernetes.io/projected/80464afc-01b1-46a8-961c-a15dd48c208d-kube-api-access-ns76f\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:45.376411 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.376331 2578 generic.go:356] "Generic (PLEG): container finished" podID="80464afc-01b1-46a8-961c-a15dd48c208d" containerID="074c9b731bfbda3910f476b26ba8c1245d64b4d269febe3275797318262134d2" exitCode=0 Jul 06 18:26:45.376411 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.376382 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" Jul 06 18:26:45.376583 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.376419 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" event={"ID":"80464afc-01b1-46a8-961c-a15dd48c208d","Type":"ContainerDied","Data":"074c9b731bfbda3910f476b26ba8c1245d64b4d269febe3275797318262134d2"} Jul 06 18:26:45.376583 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.376477 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4" event={"ID":"80464afc-01b1-46a8-961c-a15dd48c208d","Type":"ContainerDied","Data":"33cb9909c602542c55bcb9c73bd9c53f58407354053bf5555639ac3fecc09f7c"} Jul 06 18:26:45.376583 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.376506 2578 scope.go:117] "RemoveContainer" containerID="074c9b731bfbda3910f476b26ba8c1245d64b4d269febe3275797318262134d2" Jul 06 18:26:45.386430 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.386415 2578 scope.go:117] "RemoveContainer" containerID="d249315c8589d2f33e5aafc7c73fd4e762d74ea158ce404abeed7aa42961ba30" Jul 06 18:26:45.393836 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.393816 2578 scope.go:117] "RemoveContainer" containerID="074c9b731bfbda3910f476b26ba8c1245d64b4d269febe3275797318262134d2" Jul 06 18:26:45.394082 ip-10-0-130-37 kubenswrapper[2578]: E0706 18:26:45.394064 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"074c9b731bfbda3910f476b26ba8c1245d64b4d269febe3275797318262134d2\": container with ID starting with 074c9b731bfbda3910f476b26ba8c1245d64b4d269febe3275797318262134d2 not found: ID does not exist" containerID="074c9b731bfbda3910f476b26ba8c1245d64b4d269febe3275797318262134d2" Jul 06 18:26:45.394139 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.394093 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"074c9b731bfbda3910f476b26ba8c1245d64b4d269febe3275797318262134d2"} err="failed to get container status \"074c9b731bfbda3910f476b26ba8c1245d64b4d269febe3275797318262134d2\": rpc error: code = NotFound desc = could not find container \"074c9b731bfbda3910f476b26ba8c1245d64b4d269febe3275797318262134d2\": container with ID starting with 074c9b731bfbda3910f476b26ba8c1245d64b4d269febe3275797318262134d2 not found: ID does not exist" Jul 06 18:26:45.394139 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.394111 2578 scope.go:117] "RemoveContainer" containerID="d249315c8589d2f33e5aafc7c73fd4e762d74ea158ce404abeed7aa42961ba30" Jul 06 18:26:45.394318 ip-10-0-130-37 kubenswrapper[2578]: E0706 18:26:45.394304 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d249315c8589d2f33e5aafc7c73fd4e762d74ea158ce404abeed7aa42961ba30\": container with ID starting with d249315c8589d2f33e5aafc7c73fd4e762d74ea158ce404abeed7aa42961ba30 not found: ID does not exist" containerID="d249315c8589d2f33e5aafc7c73fd4e762d74ea158ce404abeed7aa42961ba30" Jul 06 18:26:45.394360 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.394323 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d249315c8589d2f33e5aafc7c73fd4e762d74ea158ce404abeed7aa42961ba30"} err="failed to get container status \"d249315c8589d2f33e5aafc7c73fd4e762d74ea158ce404abeed7aa42961ba30\": rpc error: code = NotFound desc = could not find container \"d249315c8589d2f33e5aafc7c73fd4e762d74ea158ce404abeed7aa42961ba30\": container with ID starting with d249315c8589d2f33e5aafc7c73fd4e762d74ea158ce404abeed7aa42961ba30 not found: ID does not exist" Jul 06 18:26:45.400006 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.399985 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4"] Jul 06 18:26:45.404704 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:45.404684 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-1ee192-openshift-default-55cff765b5-5f6v4"] Jul 06 18:26:46.941158 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:46.941118 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80464afc-01b1-46a8-961c-a15dd48c208d" path="/var/lib/kubelet/pods/80464afc-01b1-46a8-961c-a15dd48c208d/volumes" Jul 06 18:26:47.364139 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:47.364055 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc"] Jul 06 18:26:47.364286 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:47.364247 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" podUID="96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb" containerName="istio-proxy" containerID="cri-o://a1a3110f3dbb2e336638e3258e8323994b56a827c85fa53453502e9a462a8369" gracePeriod=30 Jul 06 18:26:48.214617 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.214581 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b"] Jul 06 18:26:48.214981 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.214942 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80464afc-01b1-46a8-961c-a15dd48c208d" containerName="istio-proxy" Jul 06 18:26:48.214981 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.214954 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="80464afc-01b1-46a8-961c-a15dd48c208d" containerName="istio-proxy" Jul 06 18:26:48.214981 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.214964 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80464afc-01b1-46a8-961c-a15dd48c208d" containerName="istio-proxy" Jul 06 18:26:48.214981 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.214970 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="80464afc-01b1-46a8-961c-a15dd48c208d" containerName="istio-proxy" Jul 06 18:26:48.214981 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.214979 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00095e57-8fba-46ec-9825-8c97fc91a02e" containerName="istio-proxy" Jul 06 18:26:48.214981 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.214984 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="00095e57-8fba-46ec-9825-8c97fc91a02e" containerName="istio-proxy" Jul 06 18:26:48.215224 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.215070 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="80464afc-01b1-46a8-961c-a15dd48c208d" containerName="istio-proxy" Jul 06 18:26:48.218234 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.218207 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:48.231714 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.231687 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b"] Jul 06 18:26:48.242827 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.242803 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-9c9be0-openshift-default-dockercfg-lntfq\"" Jul 06 18:26:48.304244 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.304202 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istio-data\") pod \"e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:48.304443 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.304258 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-workload-socket\") pod \"e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:48.304443 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.304288 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-credential-socket\") pod \"e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:48.304443 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.304312 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istio-podinfo\") pod \"e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:48.304443 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.304428 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-workload-certs\") pod \"e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:48.304683 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.304510 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istiod-ca-cert\") pod \"e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:48.304683 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.304587 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istio-envoy\") pod \"e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:48.304683 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.304637 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rt2v\" (UniqueName: \"kubernetes.io/projected/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-kube-api-access-8rt2v\") pod \"e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:48.304683 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.304673 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istio-token\") pod \"e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:48.405481 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.405447 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istio-data\") pod \"e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:48.405481 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.405484 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-workload-socket\") pod \"e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:48.405680 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.405502 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-credential-socket\") pod \"e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:48.405680 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.405616 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istio-podinfo\") pod \"e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:48.405680 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.405667 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-workload-certs\") pod \"e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:48.405797 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.405728 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istiod-ca-cert\") pod \"e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:48.405862 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.405843 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-workload-socket\") pod \"e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:48.405917 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.405887 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istio-data\") pod \"e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:48.405917 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.405895 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istio-envoy\") pod \"e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:48.406053 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.405929 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-credential-socket\") pod \"e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:48.406053 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.405968 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rt2v\" (UniqueName: \"kubernetes.io/projected/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-kube-api-access-8rt2v\") pod \"e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:48.406053 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.406010 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istio-token\") pod \"e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:48.406192 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.406056 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-workload-certs\") pod \"e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:48.406502 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.406476 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istiod-ca-cert\") pod \"e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:48.407971 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.407949 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istio-envoy\") pod \"e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:48.408264 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.408245 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istio-podinfo\") pod \"e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:48.416238 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.416218 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istio-token\") pod \"e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:48.416417 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.416397 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rt2v\" (UniqueName: \"kubernetes.io/projected/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-kube-api-access-8rt2v\") pod \"e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:48.528050 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.527948 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:48.671518 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.671491 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b"] Jul 06 18:26:48.673234 ip-10-0-130-37 kubenswrapper[2578]: W0706 18:26:48.673208 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59169ba0_346b_4e58_93f8_1a1dbdfed5e3.slice/crio-8a2e3f4a619fd217d6b59cf2293410468944e0247dc9bbeafcb175ea20e5abd5 WatchSource:0}: Error finding container 8a2e3f4a619fd217d6b59cf2293410468944e0247dc9bbeafcb175ea20e5abd5: Status 404 returned error can't find the container with id 8a2e3f4a619fd217d6b59cf2293410468944e0247dc9bbeafcb175ea20e5abd5 Jul 06 18:26:48.675333 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.675306 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:26:48.675397 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.675363 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:26:48.675397 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:48.675391 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:26:49.397803 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:49.397768 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" event={"ID":"59169ba0-346b-4e58-93f8-1a1dbdfed5e3","Type":"ContainerStarted","Data":"87538fdc35c64f4bd237287a7a235f1653cfe94d48b1b06b29aae05903f4c75f"} Jul 06 18:26:49.398183 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:49.397825 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" event={"ID":"59169ba0-346b-4e58-93f8-1a1dbdfed5e3","Type":"ContainerStarted","Data":"8a2e3f4a619fd217d6b59cf2293410468944e0247dc9bbeafcb175ea20e5abd5"} Jul 06 18:26:49.424119 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:49.424075 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" podStartSLOduration=1.424058779 podStartE2EDuration="1.424058779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:26:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:26:49.421984185 +0000 UTC m=+2130.106591155" watchObservedRunningTime="2026-07-06 18:26:49.424058779 +0000 UTC m=+2130.108665749" Jul 06 18:26:49.528480 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:49.528452 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:49.541684 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:49.541649 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:50.402457 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:50.402430 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:50.403385 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:50.403362 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:26:52.615753 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:52.615729 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:52.744763 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:52.744729 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istio-data\") pod \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " Jul 06 18:26:52.744763 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:52.744764 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istiod-ca-cert\") pod \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " Jul 06 18:26:52.745037 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:52.744804 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-workload-socket\") pod \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " Jul 06 18:26:52.745037 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:52.744842 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-workload-certs\") pod \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " Jul 06 18:26:52.745037 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:52.744862 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-credential-socket\") pod \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " Jul 06 18:26:52.745037 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:52.744901 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istio-token\") pod \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " Jul 06 18:26:52.745037 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:52.744948 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istio-podinfo\") pod \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " Jul 06 18:26:52.745288 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:52.745048 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istio-envoy\") pod \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " Jul 06 18:26:52.745288 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:52.745094 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8nrp2\" (UniqueName: \"kubernetes.io/projected/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-kube-api-access-8nrp2\") pod \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\" (UID: \"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb\") " Jul 06 18:26:52.745288 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:52.745156 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb" (UID: "96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:26:52.745288 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:52.745244 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb" (UID: "96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:26:52.745429 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:52.745350 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb" (UID: "96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:26:52.745429 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:52.745401 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb" (UID: "96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:26:52.745574 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:52.745540 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istiod-ca-cert\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:52.745574 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:52.745561 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-workload-socket\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:52.745685 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:52.745574 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-workload-certs\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:52.745685 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:52.745587 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-credential-socket\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:52.745864 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:52.745679 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istio-data" (OuterVolumeSpecName: "istio-data") pod "96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb" (UID: "96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:26:52.747333 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:52.747304 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb" (UID: "96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 18:26:52.747425 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:52.747325 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-kube-api-access-8nrp2" (OuterVolumeSpecName: "kube-api-access-8nrp2") pod "96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb" (UID: "96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb"). InnerVolumeSpecName "kube-api-access-8nrp2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:26:52.747553 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:52.747536 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb" (UID: "96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:26:52.747858 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:52.747838 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istio-token" (OuterVolumeSpecName: "istio-token") pod "96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb" (UID: "96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:26:52.846620 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:52.846590 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istio-token\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:52.846620 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:52.846615 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istio-podinfo\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:52.846620 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:52.846625 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istio-envoy\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:52.846847 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:52.846633 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nrp2\" (UniqueName: \"kubernetes.io/projected/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-kube-api-access-8nrp2\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:52.846847 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:52.846642 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb-istio-data\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:26:53.418673 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:53.418639 2578 generic.go:356] "Generic (PLEG): container finished" podID="96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb" containerID="a1a3110f3dbb2e336638e3258e8323994b56a827c85fa53453502e9a462a8369" exitCode=0 Jul 06 18:26:53.418881 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:53.418685 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" event={"ID":"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb","Type":"ContainerDied","Data":"a1a3110f3dbb2e336638e3258e8323994b56a827c85fa53453502e9a462a8369"} Jul 06 18:26:53.418881 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:53.418691 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" Jul 06 18:26:53.418881 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:53.418728 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc" event={"ID":"96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb","Type":"ContainerDied","Data":"f526078ea410b60388d40a407e5a159a651fd582b5cc82a56c1403c8653855a3"} Jul 06 18:26:53.418881 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:53.418760 2578 scope.go:117] "RemoveContainer" containerID="a1a3110f3dbb2e336638e3258e8323994b56a827c85fa53453502e9a462a8369" Jul 06 18:26:53.427919 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:53.427879 2578 scope.go:117] "RemoveContainer" containerID="9c33fe8978282e40d25a6ff58734177415ac5f69f249f4cf88533cf218903c8d" Jul 06 18:26:53.435526 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:53.435509 2578 scope.go:117] "RemoveContainer" containerID="a1a3110f3dbb2e336638e3258e8323994b56a827c85fa53453502e9a462a8369" Jul 06 18:26:53.435799 ip-10-0-130-37 kubenswrapper[2578]: E0706 18:26:53.435776 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1a3110f3dbb2e336638e3258e8323994b56a827c85fa53453502e9a462a8369\": container with ID starting with a1a3110f3dbb2e336638e3258e8323994b56a827c85fa53453502e9a462a8369 not found: ID does not exist" containerID="a1a3110f3dbb2e336638e3258e8323994b56a827c85fa53453502e9a462a8369" Jul 06 18:26:53.435879 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:53.435808 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1a3110f3dbb2e336638e3258e8323994b56a827c85fa53453502e9a462a8369"} err="failed to get container status \"a1a3110f3dbb2e336638e3258e8323994b56a827c85fa53453502e9a462a8369\": rpc error: code = NotFound desc = could not find container \"a1a3110f3dbb2e336638e3258e8323994b56a827c85fa53453502e9a462a8369\": container with ID starting with a1a3110f3dbb2e336638e3258e8323994b56a827c85fa53453502e9a462a8369 not found: ID does not exist" Jul 06 18:26:53.435879 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:53.435832 2578 scope.go:117] "RemoveContainer" containerID="9c33fe8978282e40d25a6ff58734177415ac5f69f249f4cf88533cf218903c8d" Jul 06 18:26:53.436089 ip-10-0-130-37 kubenswrapper[2578]: E0706 18:26:53.436072 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c33fe8978282e40d25a6ff58734177415ac5f69f249f4cf88533cf218903c8d\": container with ID starting with 9c33fe8978282e40d25a6ff58734177415ac5f69f249f4cf88533cf218903c8d not found: ID does not exist" containerID="9c33fe8978282e40d25a6ff58734177415ac5f69f249f4cf88533cf218903c8d" Jul 06 18:26:53.436136 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:53.436097 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c33fe8978282e40d25a6ff58734177415ac5f69f249f4cf88533cf218903c8d"} err="failed to get container status \"9c33fe8978282e40d25a6ff58734177415ac5f69f249f4cf88533cf218903c8d\": rpc error: code = NotFound desc = could not find container \"9c33fe8978282e40d25a6ff58734177415ac5f69f249f4cf88533cf218903c8d\": container with ID starting with 9c33fe8978282e40d25a6ff58734177415ac5f69f249f4cf88533cf218903c8d not found: ID does not exist" Jul 06 18:26:53.439579 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:53.439559 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc"] Jul 06 18:26:53.445600 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:53.445579 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-30a7ce-openshift-default-575984df79-2qlbc"] Jul 06 18:26:54.936383 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:54.936349 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb" path="/var/lib/kubelet/pods/96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb/volumes" Jul 06 18:26:56.450371 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.450340 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp"] Jul 06 18:26:56.450896 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.450751 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb" containerName="istio-proxy" Jul 06 18:26:56.450896 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.450763 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb" containerName="istio-proxy" Jul 06 18:26:56.450896 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.450776 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb" containerName="istio-proxy" Jul 06 18:26:56.450896 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.450781 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb" containerName="istio-proxy" Jul 06 18:26:56.450896 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.450833 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb" containerName="istio-proxy" Jul 06 18:26:56.450896 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.450841 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="96418a9a-9f3d-4319-9fe4-8f5c24a6c7bb" containerName="istio-proxy" Jul 06 18:26:56.450896 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.450850 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="80464afc-01b1-46a8-961c-a15dd48c208d" containerName="istio-proxy" Jul 06 18:26:56.453649 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.453628 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:56.456063 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.456036 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-b6a5ee-openshift-default-dockercfg-x9t7b\"" Jul 06 18:26:56.467881 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.467859 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp"] Jul 06 18:26:56.579615 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.579583 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-istio-envoy\") pod \"e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:56.579828 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.579628 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-workload-socket\") pod \"e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:56.579828 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.579655 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8st6\" (UniqueName: \"kubernetes.io/projected/21081366-d4ec-44e0-b9c7-cab354a8f759-kube-api-access-x8st6\") pod \"e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:56.579828 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.579692 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21081366-d4ec-44e0-b9c7-cab354a8f759-istio-token\") pod \"e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:56.579828 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.579767 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-istio-data\") pod \"e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:56.579828 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.579789 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21081366-d4ec-44e0-b9c7-cab354a8f759-istiod-ca-cert\") pod \"e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:56.579994 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.579838 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21081366-d4ec-44e0-b9c7-cab354a8f759-istio-podinfo\") pod \"e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:56.579994 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.579864 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-workload-certs\") pod \"e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:56.579994 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.579890 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-credential-socket\") pod \"e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:56.680745 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.680714 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-istio-envoy\") pod \"e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:56.680962 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.680753 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-workload-socket\") pod \"e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:56.680962 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.680772 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8st6\" (UniqueName: \"kubernetes.io/projected/21081366-d4ec-44e0-b9c7-cab354a8f759-kube-api-access-x8st6\") pod \"e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:56.680962 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.680799 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21081366-d4ec-44e0-b9c7-cab354a8f759-istio-token\") pod \"e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:56.680962 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.680830 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-istio-data\") pod \"e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:56.680962 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.680845 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21081366-d4ec-44e0-b9c7-cab354a8f759-istiod-ca-cert\") pod \"e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:56.680962 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.680874 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21081366-d4ec-44e0-b9c7-cab354a8f759-istio-podinfo\") pod \"e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:56.680962 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.680899 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-workload-certs\") pod \"e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:56.680962 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.680943 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-credential-socket\") pod \"e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:56.681400 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.681286 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-workload-socket\") pod \"e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:56.681400 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.681374 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-credential-socket\") pod \"e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:56.681512 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.681472 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-workload-certs\") pod \"e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:56.681567 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.681513 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-istio-data\") pod \"e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:56.681679 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.681655 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21081366-d4ec-44e0-b9c7-cab354a8f759-istiod-ca-cert\") pod \"e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:56.683108 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.683092 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-istio-envoy\") pod \"e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:56.683357 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.683341 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21081366-d4ec-44e0-b9c7-cab354a8f759-istio-podinfo\") pod \"e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:56.690394 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.690371 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21081366-d4ec-44e0-b9c7-cab354a8f759-istio-token\") pod \"e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:56.690859 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.690835 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8st6\" (UniqueName: \"kubernetes.io/projected/21081366-d4ec-44e0-b9c7-cab354a8f759-kube-api-access-x8st6\") pod \"e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:56.764085 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.763990 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:56.900666 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.900593 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp"] Jul 06 18:26:56.903295 ip-10-0-130-37 kubenswrapper[2578]: W0706 18:26:56.903268 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21081366_d4ec_44e0_b9c7_cab354a8f759.slice/crio-2cc8022c3695ceb176ae4c4ab4779042e2d7b75cb5527af18d92c5387a4e8979 WatchSource:0}: Error finding container 2cc8022c3695ceb176ae4c4ab4779042e2d7b75cb5527af18d92c5387a4e8979: Status 404 returned error can't find the container with id 2cc8022c3695ceb176ae4c4ab4779042e2d7b75cb5527af18d92c5387a4e8979 Jul 06 18:26:56.905540 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.905505 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:26:56.905632 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.905570 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:26:56.905632 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:56.905618 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:26:57.442780 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:57.442738 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" event={"ID":"21081366-d4ec-44e0-b9c7-cab354a8f759","Type":"ContainerStarted","Data":"581cdbe60ba744144f86dbc5ffae935cbd90b831ffcedd58b90fc98167654086"} Jul 06 18:26:57.442965 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:57.442806 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" event={"ID":"21081366-d4ec-44e0-b9c7-cab354a8f759","Type":"ContainerStarted","Data":"2cc8022c3695ceb176ae4c4ab4779042e2d7b75cb5527af18d92c5387a4e8979"} Jul 06 18:26:57.469014 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:57.468964 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" podStartSLOduration=1.468949539 podStartE2EDuration="1.468949539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:26:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:26:57.467639825 +0000 UTC m=+2138.152246796" watchObservedRunningTime="2026-07-06 18:26:57.468949539 +0000 UTC m=+2138.153556509" Jul 06 18:26:57.764834 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:57.764733 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:57.770160 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:57.770133 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:58.452000 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:58.451960 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:26:58.453042 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:26:58.452999 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:27:05.404047 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:05.403987 2578 patch_prober.go:28] interesting pod/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 06 18:27:05.404469 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:05.404073 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" podUID="59169ba0-346b-4e58-93f8-1a1dbdfed5e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 06 18:27:05.493659 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:05.493625 2578 generic.go:356] "Generic (PLEG): container finished" podID="59169ba0-346b-4e58-93f8-1a1dbdfed5e3" containerID="87538fdc35c64f4bd237287a7a235f1653cfe94d48b1b06b29aae05903f4c75f" exitCode=0 Jul 06 18:27:05.493821 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:05.493695 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" event={"ID":"59169ba0-346b-4e58-93f8-1a1dbdfed5e3","Type":"ContainerDied","Data":"87538fdc35c64f4bd237287a7a235f1653cfe94d48b1b06b29aae05903f4c75f"} Jul 06 18:27:05.494098 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:05.494085 2578 scope.go:117] "RemoveContainer" containerID="87538fdc35c64f4bd237287a7a235f1653cfe94d48b1b06b29aae05903f4c75f" Jul 06 18:27:05.495123 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:05.495094 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:27:05.495186 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:05.495165 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:27:05.495225 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:05.495200 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:27:06.500676 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:06.500638 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" event={"ID":"59169ba0-346b-4e58-93f8-1a1dbdfed5e3","Type":"ContainerStarted","Data":"399ab0a8e8837f27016ef42eeb1f8e5a66981fa1440b016eb757eea6f3760231"} Jul 06 18:27:06.529016 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:06.528984 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:27:06.529220 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:06.529154 2578 patch_prober.go:28] interesting pod/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 06 18:27:06.529220 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:06.529210 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" podUID="59169ba0-346b-4e58-93f8-1a1dbdfed5e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 06 18:27:07.529333 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:07.529298 2578 patch_prober.go:28] interesting pod/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 06 18:27:07.529703 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:07.529374 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" podUID="59169ba0-346b-4e58-93f8-1a1dbdfed5e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 06 18:27:08.529042 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:08.528992 2578 patch_prober.go:28] interesting pod/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 06 18:27:08.529222 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:08.529072 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" podUID="59169ba0-346b-4e58-93f8-1a1dbdfed5e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 06 18:27:09.528864 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:09.528815 2578 patch_prober.go:28] interesting pod/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 06 18:27:09.529284 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:09.528886 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" podUID="59169ba0-346b-4e58-93f8-1a1dbdfed5e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 06 18:27:10.533216 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:10.533184 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:27:10.533638 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:10.533568 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:27:10.534433 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:10.534412 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:27:12.529434 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:12.529363 2578 generic.go:356] "Generic (PLEG): container finished" podID="21081366-d4ec-44e0-b9c7-cab354a8f759" containerID="581cdbe60ba744144f86dbc5ffae935cbd90b831ffcedd58b90fc98167654086" exitCode=0 Jul 06 18:27:12.529812 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:12.529436 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" event={"ID":"21081366-d4ec-44e0-b9c7-cab354a8f759","Type":"ContainerDied","Data":"581cdbe60ba744144f86dbc5ffae935cbd90b831ffcedd58b90fc98167654086"} Jul 06 18:27:12.529926 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:12.529908 2578 scope.go:117] "RemoveContainer" containerID="581cdbe60ba744144f86dbc5ffae935cbd90b831ffcedd58b90fc98167654086" Jul 06 18:27:12.530945 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:12.530921 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:27:12.531007 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:12.530994 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:27:12.531102 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:12.531080 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 06 18:27:13.452001 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:13.451905 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:27:13.538778 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:13.538735 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" event={"ID":"21081366-d4ec-44e0-b9c7-cab354a8f759","Type":"ContainerStarted","Data":"f0828050906e599f6342f5ae7478d1d2fc0cd4cb44daf2a0a6352adc4952f01b"} Jul 06 18:27:13.764811 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:13.764714 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:27:13.765771 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:13.765750 2578 patch_prober.go:28] interesting pod/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 06 18:27:13.765826 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:13.765793 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" podUID="21081366-d4ec-44e0-b9c7-cab354a8f759" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 06 18:27:14.764634 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:14.764590 2578 patch_prober.go:28] interesting pod/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 06 18:27:14.765148 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:14.764652 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" podUID="21081366-d4ec-44e0-b9c7-cab354a8f759" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 06 18:27:15.765051 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:15.764725 2578 patch_prober.go:28] interesting pod/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 06 18:27:15.765051 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:15.764794 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" podUID="21081366-d4ec-44e0-b9c7-cab354a8f759" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 06 18:27:16.765414 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:16.765373 2578 patch_prober.go:28] interesting pod/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 06 18:27:16.765820 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:16.765429 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" podUID="21081366-d4ec-44e0-b9c7-cab354a8f759" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 06 18:27:17.768916 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:17.768873 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:27:17.769415 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:17.769285 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:27:17.769940 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:27:17.769922 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:33:02.634061 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:02.634006 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b"] Jul 06 18:33:02.634603 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:02.634263 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" podUID="59169ba0-346b-4e58-93f8-1a1dbdfed5e3" containerName="istio-proxy" containerID="cri-o://399ab0a8e8837f27016ef42eeb1f8e5a66981fa1440b016eb757eea6f3760231" gracePeriod=30 Jul 06 18:33:07.889882 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:07.889858 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:33:08.070664 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.070629 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-workload-certs\") pod \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " Jul 06 18:33:08.070866 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.070682 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istio-podinfo\") pod \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " Jul 06 18:33:08.070866 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.070737 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istio-token\") pod \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " Jul 06 18:33:08.070866 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.070756 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istio-envoy\") pod \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " Jul 06 18:33:08.070866 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.070780 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-credential-socket\") pod \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " Jul 06 18:33:08.070866 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.070806 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istiod-ca-cert\") pod \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " Jul 06 18:33:08.070866 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.070830 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istio-data\") pod \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " Jul 06 18:33:08.071263 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.070870 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rt2v\" (UniqueName: \"kubernetes.io/projected/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-kube-api-access-8rt2v\") pod \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " Jul 06 18:33:08.071263 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.070914 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-workload-socket\") pod \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\" (UID: \"59169ba0-346b-4e58-93f8-1a1dbdfed5e3\") " Jul 06 18:33:08.071263 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.070977 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "59169ba0-346b-4e58-93f8-1a1dbdfed5e3" (UID: "59169ba0-346b-4e58-93f8-1a1dbdfed5e3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:33:08.071263 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.071136 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "59169ba0-346b-4e58-93f8-1a1dbdfed5e3" (UID: "59169ba0-346b-4e58-93f8-1a1dbdfed5e3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:33:08.071458 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.071278 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "59169ba0-346b-4e58-93f8-1a1dbdfed5e3" (UID: "59169ba0-346b-4e58-93f8-1a1dbdfed5e3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:33:08.071458 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.071309 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-workload-certs\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:33:08.071458 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.071328 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-credential-socket\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:33:08.071458 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.071416 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "59169ba0-346b-4e58-93f8-1a1dbdfed5e3" (UID: "59169ba0-346b-4e58-93f8-1a1dbdfed5e3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:33:08.071922 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.071895 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istio-data" (OuterVolumeSpecName: "istio-data") pod "59169ba0-346b-4e58-93f8-1a1dbdfed5e3" (UID: "59169ba0-346b-4e58-93f8-1a1dbdfed5e3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:33:08.073135 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.073093 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "59169ba0-346b-4e58-93f8-1a1dbdfed5e3" (UID: "59169ba0-346b-4e58-93f8-1a1dbdfed5e3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:33:08.073219 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.073184 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-kube-api-access-8rt2v" (OuterVolumeSpecName: "kube-api-access-8rt2v") pod "59169ba0-346b-4e58-93f8-1a1dbdfed5e3" (UID: "59169ba0-346b-4e58-93f8-1a1dbdfed5e3"). InnerVolumeSpecName "kube-api-access-8rt2v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:33:08.073346 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.073332 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "59169ba0-346b-4e58-93f8-1a1dbdfed5e3" (UID: "59169ba0-346b-4e58-93f8-1a1dbdfed5e3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 18:33:08.073423 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.073405 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istio-token" (OuterVolumeSpecName: "istio-token") pod "59169ba0-346b-4e58-93f8-1a1dbdfed5e3" (UID: "59169ba0-346b-4e58-93f8-1a1dbdfed5e3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:33:08.172391 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.172357 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-workload-socket\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:33:08.172391 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.172384 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istio-podinfo\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:33:08.172391 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.172393 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istio-token\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:33:08.172624 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.172404 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istio-envoy\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:33:08.172624 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.172411 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istiod-ca-cert\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:33:08.172624 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.172418 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-istio-data\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:33:08.172624 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.172428 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rt2v\" (UniqueName: \"kubernetes.io/projected/59169ba0-346b-4e58-93f8-1a1dbdfed5e3-kube-api-access-8rt2v\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:33:08.200499 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.200464 2578 generic.go:356] "Generic (PLEG): container finished" podID="59169ba0-346b-4e58-93f8-1a1dbdfed5e3" containerID="399ab0a8e8837f27016ef42eeb1f8e5a66981fa1440b016eb757eea6f3760231" exitCode=0 Jul 06 18:33:08.200642 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.200517 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" Jul 06 18:33:08.200642 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.200549 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" event={"ID":"59169ba0-346b-4e58-93f8-1a1dbdfed5e3","Type":"ContainerDied","Data":"399ab0a8e8837f27016ef42eeb1f8e5a66981fa1440b016eb757eea6f3760231"} Jul 06 18:33:08.200642 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.200605 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b" event={"ID":"59169ba0-346b-4e58-93f8-1a1dbdfed5e3","Type":"ContainerDied","Data":"8a2e3f4a619fd217d6b59cf2293410468944e0247dc9bbeafcb175ea20e5abd5"} Jul 06 18:33:08.200642 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.200629 2578 scope.go:117] "RemoveContainer" containerID="399ab0a8e8837f27016ef42eeb1f8e5a66981fa1440b016eb757eea6f3760231" Jul 06 18:33:08.214931 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.214910 2578 scope.go:117] "RemoveContainer" containerID="87538fdc35c64f4bd237287a7a235f1653cfe94d48b1b06b29aae05903f4c75f" Jul 06 18:33:08.222537 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.222518 2578 scope.go:117] "RemoveContainer" containerID="399ab0a8e8837f27016ef42eeb1f8e5a66981fa1440b016eb757eea6f3760231" Jul 06 18:33:08.222763 ip-10-0-130-37 kubenswrapper[2578]: E0706 18:33:08.222745 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"399ab0a8e8837f27016ef42eeb1f8e5a66981fa1440b016eb757eea6f3760231\": container with ID starting with 399ab0a8e8837f27016ef42eeb1f8e5a66981fa1440b016eb757eea6f3760231 not found: ID does not exist" containerID="399ab0a8e8837f27016ef42eeb1f8e5a66981fa1440b016eb757eea6f3760231" Jul 06 18:33:08.222852 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.222770 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"399ab0a8e8837f27016ef42eeb1f8e5a66981fa1440b016eb757eea6f3760231"} err="failed to get container status \"399ab0a8e8837f27016ef42eeb1f8e5a66981fa1440b016eb757eea6f3760231\": rpc error: code = NotFound desc = could not find container \"399ab0a8e8837f27016ef42eeb1f8e5a66981fa1440b016eb757eea6f3760231\": container with ID starting with 399ab0a8e8837f27016ef42eeb1f8e5a66981fa1440b016eb757eea6f3760231 not found: ID does not exist" Jul 06 18:33:08.222852 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.222786 2578 scope.go:117] "RemoveContainer" containerID="87538fdc35c64f4bd237287a7a235f1653cfe94d48b1b06b29aae05903f4c75f" Jul 06 18:33:08.223171 ip-10-0-130-37 kubenswrapper[2578]: E0706 18:33:08.223142 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87538fdc35c64f4bd237287a7a235f1653cfe94d48b1b06b29aae05903f4c75f\": container with ID starting with 87538fdc35c64f4bd237287a7a235f1653cfe94d48b1b06b29aae05903f4c75f not found: ID does not exist" containerID="87538fdc35c64f4bd237287a7a235f1653cfe94d48b1b06b29aae05903f4c75f" Jul 06 18:33:08.223277 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.223177 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87538fdc35c64f4bd237287a7a235f1653cfe94d48b1b06b29aae05903f4c75f"} err="failed to get container status \"87538fdc35c64f4bd237287a7a235f1653cfe94d48b1b06b29aae05903f4c75f\": rpc error: code = NotFound desc = could not find container \"87538fdc35c64f4bd237287a7a235f1653cfe94d48b1b06b29aae05903f4c75f\": container with ID starting with 87538fdc35c64f4bd237287a7a235f1653cfe94d48b1b06b29aae05903f4c75f not found: ID does not exist" Jul 06 18:33:08.225746 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.225726 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b"] Jul 06 18:33:08.231472 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.231452 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-9c9be0-openshift-default-57464cd4dc-rxz7b"] Jul 06 18:33:08.935827 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:08.935756 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59169ba0-346b-4e58-93f8-1a1dbdfed5e3" path="/var/lib/kubelet/pods/59169ba0-346b-4e58-93f8-1a1dbdfed5e3/volumes" Jul 06 18:33:10.108580 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:10.108546 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp"] Jul 06 18:33:10.108988 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:10.108832 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" podUID="21081366-d4ec-44e0-b9c7-cab354a8f759" containerName="istio-proxy" containerID="cri-o://f0828050906e599f6342f5ae7478d1d2fc0cd4cb44daf2a0a6352adc4952f01b" gracePeriod=30 Jul 06 18:33:10.790066 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:10.790018 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7bf5958d55-fvwkg_cfdae435-11cd-4728-831b-ec7f388d5b0e/authorino/0.log" Jul 06 18:33:15.237254 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.237226 2578 generic.go:356] "Generic (PLEG): container finished" podID="21081366-d4ec-44e0-b9c7-cab354a8f759" containerID="f0828050906e599f6342f5ae7478d1d2fc0cd4cb44daf2a0a6352adc4952f01b" exitCode=0 Jul 06 18:33:15.237631 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.237298 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" event={"ID":"21081366-d4ec-44e0-b9c7-cab354a8f759","Type":"ContainerDied","Data":"f0828050906e599f6342f5ae7478d1d2fc0cd4cb44daf2a0a6352adc4952f01b"} Jul 06 18:33:15.237631 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.237357 2578 scope.go:117] "RemoveContainer" containerID="581cdbe60ba744144f86dbc5ffae935cbd90b831ffcedd58b90fc98167654086" Jul 06 18:33:15.370777 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.370718 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:33:15.425404 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.425370 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-workload-certs\") pod \"21081366-d4ec-44e0-b9c7-cab354a8f759\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " Jul 06 18:33:15.425577 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.425412 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8st6\" (UniqueName: \"kubernetes.io/projected/21081366-d4ec-44e0-b9c7-cab354a8f759-kube-api-access-x8st6\") pod \"21081366-d4ec-44e0-b9c7-cab354a8f759\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " Jul 06 18:33:15.425577 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.425432 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21081366-d4ec-44e0-b9c7-cab354a8f759-istiod-ca-cert\") pod \"21081366-d4ec-44e0-b9c7-cab354a8f759\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " Jul 06 18:33:15.425577 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.425462 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21081366-d4ec-44e0-b9c7-cab354a8f759-istio-token\") pod \"21081366-d4ec-44e0-b9c7-cab354a8f759\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " Jul 06 18:33:15.425781 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.425632 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21081366-d4ec-44e0-b9c7-cab354a8f759-istio-podinfo\") pod \"21081366-d4ec-44e0-b9c7-cab354a8f759\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " Jul 06 18:33:15.425781 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.425739 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-istio-data\") pod \"21081366-d4ec-44e0-b9c7-cab354a8f759\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " Jul 06 18:33:15.425872 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.425747 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "21081366-d4ec-44e0-b9c7-cab354a8f759" (UID: "21081366-d4ec-44e0-b9c7-cab354a8f759"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:33:15.425872 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.425809 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-istio-envoy\") pod \"21081366-d4ec-44e0-b9c7-cab354a8f759\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " Jul 06 18:33:15.425872 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.425840 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-workload-socket\") pod \"21081366-d4ec-44e0-b9c7-cab354a8f759\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " Jul 06 18:33:15.426126 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.425882 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-credential-socket\") pod \"21081366-d4ec-44e0-b9c7-cab354a8f759\" (UID: \"21081366-d4ec-44e0-b9c7-cab354a8f759\") " Jul 06 18:33:15.426126 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.425976 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21081366-d4ec-44e0-b9c7-cab354a8f759-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "21081366-d4ec-44e0-b9c7-cab354a8f759" (UID: "21081366-d4ec-44e0-b9c7-cab354a8f759"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:33:15.426240 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.426182 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "21081366-d4ec-44e0-b9c7-cab354a8f759" (UID: "21081366-d4ec-44e0-b9c7-cab354a8f759"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:33:15.426240 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.426191 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-workload-certs\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:33:15.426240 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.426209 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21081366-d4ec-44e0-b9c7-cab354a8f759-istiod-ca-cert\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:33:15.426399 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.426368 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "21081366-d4ec-44e0-b9c7-cab354a8f759" (UID: "21081366-d4ec-44e0-b9c7-cab354a8f759"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:33:15.426489 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.426460 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-istio-data" (OuterVolumeSpecName: "istio-data") pod "21081366-d4ec-44e0-b9c7-cab354a8f759" (UID: "21081366-d4ec-44e0-b9c7-cab354a8f759"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:33:15.427913 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.427884 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/21081366-d4ec-44e0-b9c7-cab354a8f759-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "21081366-d4ec-44e0-b9c7-cab354a8f759" (UID: "21081366-d4ec-44e0-b9c7-cab354a8f759"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 18:33:15.428134 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.428098 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "21081366-d4ec-44e0-b9c7-cab354a8f759" (UID: "21081366-d4ec-44e0-b9c7-cab354a8f759"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:33:15.428228 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.428157 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21081366-d4ec-44e0-b9c7-cab354a8f759-kube-api-access-x8st6" (OuterVolumeSpecName: "kube-api-access-x8st6") pod "21081366-d4ec-44e0-b9c7-cab354a8f759" (UID: "21081366-d4ec-44e0-b9c7-cab354a8f759"). InnerVolumeSpecName "kube-api-access-x8st6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:33:15.428228 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.428187 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21081366-d4ec-44e0-b9c7-cab354a8f759-istio-token" (OuterVolumeSpecName: "istio-token") pod "21081366-d4ec-44e0-b9c7-cab354a8f759" (UID: "21081366-d4ec-44e0-b9c7-cab354a8f759"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:33:15.452928 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.452905 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-dn4dc_4688d0ca-54e5-4e27-91fc-9891b4b7bf5e/manager/0.log" Jul 06 18:33:15.527428 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.527399 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8st6\" (UniqueName: \"kubernetes.io/projected/21081366-d4ec-44e0-b9c7-cab354a8f759-kube-api-access-x8st6\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:33:15.527428 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.527425 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21081366-d4ec-44e0-b9c7-cab354a8f759-istio-token\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:33:15.527428 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.527438 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21081366-d4ec-44e0-b9c7-cab354a8f759-istio-podinfo\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:33:15.527627 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.527446 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-istio-data\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:33:15.527627 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.527454 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-istio-envoy\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:33:15.527627 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.527461 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-workload-socket\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:33:15.527627 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.527468 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21081366-d4ec-44e0-b9c7-cab354a8f759-credential-socket\") on node \"ip-10-0-130-37.ec2.internal\" DevicePath \"\"" Jul 06 18:33:15.593188 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:15.593148 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-r4d29_bd638276-e86c-4a4c-906d-da266f83f4f8/manager/0.log" Jul 06 18:33:16.173603 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:16.173579 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-hkkq8_b83bc448-de88-4275-9138-c9ba7ccaa92f/server/0.log" Jul 06 18:33:16.244325 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:16.244298 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" Jul 06 18:33:16.244325 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:16.244316 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp" event={"ID":"21081366-d4ec-44e0-b9c7-cab354a8f759","Type":"ContainerDied","Data":"2cc8022c3695ceb176ae4c4ab4779042e2d7b75cb5527af18d92c5387a4e8979"} Jul 06 18:33:16.244867 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:16.244370 2578 scope.go:117] "RemoveContainer" containerID="f0828050906e599f6342f5ae7478d1d2fc0cd4cb44daf2a0a6352adc4952f01b" Jul 06 18:33:16.265489 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:16.265463 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp"] Jul 06 18:33:16.272141 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:16.272122 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-b6a5ee-openshift-default-7bc5f7db75-6hsdp"] Jul 06 18:33:16.286345 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:16.286321 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-rjwcv_c546bc20-63c6-4efc-b843-8d22961d31b1/manager/0.log" Jul 06 18:33:16.644300 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:16.644270 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f8c8d8b67-sv72h_1828c53e-91b1-4e6e-ad8b-55533a87db31/copy-manifests/0.log" Jul 06 18:33:16.657040 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:16.656994 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f8c8d8b67-sv72h_1828c53e-91b1-4e6e-ad8b-55533a87db31/manager/0.log" Jul 06 18:33:16.936230 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:16.936202 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21081366-d4ec-44e0-b9c7-cab354a8f759" path="/var/lib/kubelet/pods/21081366-d4ec-44e0-b9c7-cab354a8f759/volumes" Jul 06 18:33:18.042848 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:18.042821 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7bf5958d55-fvwkg_cfdae435-11cd-4728-831b-ec7f388d5b0e/authorino/0.log" Jul 06 18:33:18.163549 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:18.163518 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-bkjfg_13e24a1c-1a3e-42c7-b4b2-2f1ec25ddd9d/manager/0.log" Jul 06 18:33:18.271516 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:18.271485 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-bdk5r_e852b45e-c7f5-45c3-8080-e387bb535e17/manager/0.log" Jul 06 18:33:18.503110 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:18.503080 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-sf8kc_faf3b953-f640-4da3-b3d4-ab0683be26b2/registry-server/0.log" Jul 06 18:33:18.629979 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:18.629946 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-wvwml_f2588a3c-3682-412f-ad1d-cf83dd0ee181/manager/0.log" Jul 06 18:33:18.851323 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:18.851239 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-zsxwv_13482247-76ba-44e9-b3b8-af18ad469902/manager/0.log" Jul 06 18:33:19.214042 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:19.214009 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-568d56697dx666m_2e621372-e4af-48df-aaa6-f6551ca138b5/istio-proxy/0.log" Jul 06 18:33:19.442553 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:19.442516 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76c4c4d987-258bc_a4d95b91-3e89-4a11-a5ad-b1e38e587571/kube-auth-proxy/0.log" Jul 06 18:33:19.670877 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:19.670799 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5dfc694f5c-k589b_df84e41f-b630-463d-be34-180d0fd49f80/istio-proxy/1.log" Jul 06 18:33:20.021515 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:20.021486 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6844c8868c-2lnp8_383db5e4-be04-4210-92ca-08b4528901d2/router/0.log" Jul 06 18:33:20.490921 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:20.490878 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-mzvcf_f319be9c-4bea-4b59-bcbb-767112b3c0c8/main/0.log" Jul 06 18:33:20.603737 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:20.603711 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-st5wv_350a1045-a388-473e-8c60-9fa5d00cfe4b/main/0.log" Jul 06 18:33:20.941171 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:20.941145 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-sdp5s_69813dc9-45ef-46fa-8db5-6790a646110b/main/0.log" Jul 06 18:33:27.918482 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:27.918454 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2fsf2_3c9b8055-863b-43b0-8f1c-594c43656713/global-pull-secret-syncer/0.log" Jul 06 18:33:28.115913 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:28.115883 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vg7jb_ba941728-b986-47c7-b4d9-468ccf455c1f/konnectivity-agent/0.log" Jul 06 18:33:28.160597 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:28.160569 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-37.ec2.internal_5dd462233376de3e85db0937786544c4/haproxy/0.log" Jul 06 18:33:33.646684 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:33.646650 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7bf5958d55-fvwkg_cfdae435-11cd-4728-831b-ec7f388d5b0e/authorino/0.log" Jul 06 18:33:33.684895 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:33.684867 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-bkjfg_13e24a1c-1a3e-42c7-b4b2-2f1ec25ddd9d/manager/0.log" Jul 06 18:33:33.732179 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:33.732154 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-bdk5r_e852b45e-c7f5-45c3-8080-e387bb535e17/manager/0.log" Jul 06 18:33:33.810771 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:33.810742 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-sf8kc_faf3b953-f640-4da3-b3d4-ab0683be26b2/registry-server/0.log" Jul 06 18:33:33.895225 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:33.895200 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-wvwml_f2588a3c-3682-412f-ad1d-cf83dd0ee181/manager/0.log" Jul 06 18:33:33.988706 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:33.988674 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-zsxwv_13482247-76ba-44e9-b3b8-af18ad469902/manager/0.log" Jul 06 18:33:35.928728 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:35.928697 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-64jsf_0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81/node-exporter/0.log" Jul 06 18:33:35.950643 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:35.950618 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-64jsf_0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81/kube-rbac-proxy/0.log" Jul 06 18:33:35.971907 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:35.971881 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-64jsf_0d998a0f-b2bb-4510-a3d7-49a5ecf2bb81/init-textfile/0.log" Jul 06 18:33:37.903135 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:37.903105 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8v778/perf-node-gather-daemonset-hh499"] Jul 06 18:33:37.903520 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:37.903481 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59169ba0-346b-4e58-93f8-1a1dbdfed5e3" containerName="istio-proxy" Jul 06 18:33:37.903520 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:37.903494 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="59169ba0-346b-4e58-93f8-1a1dbdfed5e3" containerName="istio-proxy" Jul 06 18:33:37.903520 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:37.903512 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21081366-d4ec-44e0-b9c7-cab354a8f759" containerName="istio-proxy" Jul 06 18:33:37.903520 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:37.903518 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="21081366-d4ec-44e0-b9c7-cab354a8f759" containerName="istio-proxy" Jul 06 18:33:37.903681 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:37.903526 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21081366-d4ec-44e0-b9c7-cab354a8f759" containerName="istio-proxy" Jul 06 18:33:37.903681 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:37.903532 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="21081366-d4ec-44e0-b9c7-cab354a8f759" containerName="istio-proxy" Jul 06 18:33:37.903681 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:37.903586 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="21081366-d4ec-44e0-b9c7-cab354a8f759" containerName="istio-proxy" Jul 06 18:33:37.903681 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:37.903594 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="59169ba0-346b-4e58-93f8-1a1dbdfed5e3" containerName="istio-proxy" Jul 06 18:33:37.903681 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:37.903600 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="21081366-d4ec-44e0-b9c7-cab354a8f759" containerName="istio-proxy" Jul 06 18:33:37.903681 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:37.903607 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="59169ba0-346b-4e58-93f8-1a1dbdfed5e3" containerName="istio-proxy" Jul 06 18:33:37.906707 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:37.906686 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8v778/perf-node-gather-daemonset-hh499" Jul 06 18:33:37.909442 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:37.909421 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8v778\"/\"kube-root-ca.crt\"" Jul 06 18:33:37.909566 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:37.909456 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8v778\"/\"openshift-service-ca.crt\"" Jul 06 18:33:37.910509 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:37.910484 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8v778\"/\"default-dockercfg-zn8ng\"" Jul 06 18:33:37.917371 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:37.917351 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8v778/perf-node-gather-daemonset-hh499"] Jul 06 18:33:38.029053 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:38.028991 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2111d525-896e-4d85-9ad6-6912635fe10b-proc\") pod \"perf-node-gather-daemonset-hh499\" (UID: \"2111d525-896e-4d85-9ad6-6912635fe10b\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-hh499" Jul 06 18:33:38.029228 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:38.029065 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2111d525-896e-4d85-9ad6-6912635fe10b-sys\") pod \"perf-node-gather-daemonset-hh499\" (UID: \"2111d525-896e-4d85-9ad6-6912635fe10b\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-hh499" Jul 06 18:33:38.029228 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:38.029094 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2111d525-896e-4d85-9ad6-6912635fe10b-podres\") pod \"perf-node-gather-daemonset-hh499\" (UID: \"2111d525-896e-4d85-9ad6-6912635fe10b\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-hh499" Jul 06 18:33:38.029228 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:38.029116 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2111d525-896e-4d85-9ad6-6912635fe10b-lib-modules\") pod \"perf-node-gather-daemonset-hh499\" (UID: \"2111d525-896e-4d85-9ad6-6912635fe10b\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-hh499" Jul 06 18:33:38.029228 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:38.029203 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4jsp\" (UniqueName: \"kubernetes.io/projected/2111d525-896e-4d85-9ad6-6912635fe10b-kube-api-access-s4jsp\") pod \"perf-node-gather-daemonset-hh499\" (UID: \"2111d525-896e-4d85-9ad6-6912635fe10b\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-hh499" Jul 06 18:33:38.129858 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:38.129818 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2111d525-896e-4d85-9ad6-6912635fe10b-proc\") pod \"perf-node-gather-daemonset-hh499\" (UID: \"2111d525-896e-4d85-9ad6-6912635fe10b\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-hh499" Jul 06 18:33:38.130068 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:38.129871 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2111d525-896e-4d85-9ad6-6912635fe10b-sys\") pod \"perf-node-gather-daemonset-hh499\" (UID: \"2111d525-896e-4d85-9ad6-6912635fe10b\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-hh499" Jul 06 18:33:38.130068 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:38.129936 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2111d525-896e-4d85-9ad6-6912635fe10b-sys\") pod \"perf-node-gather-daemonset-hh499\" (UID: \"2111d525-896e-4d85-9ad6-6912635fe10b\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-hh499" Jul 06 18:33:38.130068 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:38.129944 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2111d525-896e-4d85-9ad6-6912635fe10b-proc\") pod \"perf-node-gather-daemonset-hh499\" (UID: \"2111d525-896e-4d85-9ad6-6912635fe10b\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-hh499" Jul 06 18:33:38.130068 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:38.129976 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2111d525-896e-4d85-9ad6-6912635fe10b-podres\") pod \"perf-node-gather-daemonset-hh499\" (UID: \"2111d525-896e-4d85-9ad6-6912635fe10b\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-hh499" Jul 06 18:33:38.130068 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:38.130012 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2111d525-896e-4d85-9ad6-6912635fe10b-lib-modules\") pod \"perf-node-gather-daemonset-hh499\" (UID: \"2111d525-896e-4d85-9ad6-6912635fe10b\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-hh499" Jul 06 18:33:38.130336 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:38.130088 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4jsp\" (UniqueName: \"kubernetes.io/projected/2111d525-896e-4d85-9ad6-6912635fe10b-kube-api-access-s4jsp\") pod \"perf-node-gather-daemonset-hh499\" (UID: \"2111d525-896e-4d85-9ad6-6912635fe10b\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-hh499" Jul 06 18:33:38.130336 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:38.130152 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2111d525-896e-4d85-9ad6-6912635fe10b-podres\") pod \"perf-node-gather-daemonset-hh499\" (UID: \"2111d525-896e-4d85-9ad6-6912635fe10b\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-hh499" Jul 06 18:33:38.130336 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:38.130237 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2111d525-896e-4d85-9ad6-6912635fe10b-lib-modules\") pod \"perf-node-gather-daemonset-hh499\" (UID: \"2111d525-896e-4d85-9ad6-6912635fe10b\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-hh499" Jul 06 18:33:38.139125 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:38.139106 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4jsp\" (UniqueName: \"kubernetes.io/projected/2111d525-896e-4d85-9ad6-6912635fe10b-kube-api-access-s4jsp\") pod \"perf-node-gather-daemonset-hh499\" (UID: \"2111d525-896e-4d85-9ad6-6912635fe10b\") " pod="openshift-must-gather-8v778/perf-node-gather-daemonset-hh499" Jul 06 18:33:38.216228 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:38.216196 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8v778/perf-node-gather-daemonset-hh499" Jul 06 18:33:38.346806 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:38.346769 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8v778/perf-node-gather-daemonset-hh499"] Jul 06 18:33:38.899589 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:38.899559 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5d85f469d5-2295j_04da93e0-5f90-4199-992e-205353a4aad7/console/0.log" Jul 06 18:33:39.361613 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:39.361576 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8v778/perf-node-gather-daemonset-hh499" event={"ID":"2111d525-896e-4d85-9ad6-6912635fe10b","Type":"ContainerStarted","Data":"9f66af35b5a1d32aed6e8ee479bb13fdf51a82fe220041cb1fe8ee80871e5e27"} Jul 06 18:33:39.362085 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:39.361652 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8v778/perf-node-gather-daemonset-hh499" event={"ID":"2111d525-896e-4d85-9ad6-6912635fe10b","Type":"ContainerStarted","Data":"9553cc66f526b691fcca7f9c4adfe0ab12b7328d622c6b2b4950a7f46c68c99e"} Jul 06 18:33:39.362085 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:39.361708 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8v778/perf-node-gather-daemonset-hh499" Jul 06 18:33:39.377673 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:39.377630 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8v778/perf-node-gather-daemonset-hh499" podStartSLOduration=2.377616205 podStartE2EDuration="2.377616205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:33:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:33:39.376858645 +0000 UTC m=+2540.061465618" watchObservedRunningTime="2026-07-06 18:33:39.377616205 +0000 UTC m=+2540.062223177" Jul 06 18:33:40.626487 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:40.626456 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f6glh_f94c1e12-5eed-4926-8cdb-d80695439c8c/dns/0.log" Jul 06 18:33:40.650299 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:40.650273 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f6glh_f94c1e12-5eed-4926-8cdb-d80695439c8c/kube-rbac-proxy/0.log" Jul 06 18:33:40.754666 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:40.754641 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g89hv_0bdf6bc9-0fd5-4579-98af-ab7b066fa383/dns-node-resolver/0.log" Jul 06 18:33:41.394931 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:41.394903 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d69n6_ed64f8b7-31b6-4d4b-9ca7-59783916ed57/node-ca/0.log" Jul 06 18:33:42.356483 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:42.356456 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-568d56697dx666m_2e621372-e4af-48df-aaa6-f6551ca138b5/istio-proxy/0.log" Jul 06 18:33:42.508743 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:42.508716 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76c4c4d987-258bc_a4d95b91-3e89-4a11-a5ad-b1e38e587571/kube-auth-proxy/0.log" Jul 06 18:33:42.567241 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:42.567210 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5dfc694f5c-k589b_df84e41f-b630-463d-be34-180d0fd49f80/istio-proxy/0.log" Jul 06 18:33:42.595078 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:42.595048 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5dfc694f5c-k589b_df84e41f-b630-463d-be34-180d0fd49f80/istio-proxy/1.log" Jul 06 18:33:42.693848 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:42.693823 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6844c8868c-2lnp8_383db5e4-be04-4210-92ca-08b4528901d2/router/0.log" Jul 06 18:33:43.353135 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:43.353106 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-474kx_f3ec2919-fbd0-4ea4-bbbe-9b48b9c5d1f2/serve-healthcheck-canary/0.log" Jul 06 18:33:43.905725 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:43.905695 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8r4q5_b8771806-daf9-42e9-ab05-a0cf4e357dc1/kube-rbac-proxy/0.log" Jul 06 18:33:43.926391 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:43.926366 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8r4q5_b8771806-daf9-42e9-ab05-a0cf4e357dc1/exporter/0.log" Jul 06 18:33:43.946679 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:43.946656 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8r4q5_b8771806-daf9-42e9-ab05-a0cf4e357dc1/extractor/0.log" Jul 06 18:33:45.376761 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:45.376734 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8v778/perf-node-gather-daemonset-hh499" Jul 06 18:33:46.299912 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:46.299882 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-dn4dc_4688d0ca-54e5-4e27-91fc-9891b4b7bf5e/manager/0.log" Jul 06 18:33:46.426394 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:46.426367 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-r4d29_bd638276-e86c-4a4c-906d-da266f83f4f8/manager/0.log" Jul 06 18:33:46.647512 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:46.647429 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-hkkq8_b83bc448-de88-4275-9138-c9ba7ccaa92f/server/0.log" Jul 06 18:33:46.715310 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:46.715290 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-rjwcv_c546bc20-63c6-4efc-b843-8d22961d31b1/manager/0.log" Jul 06 18:33:46.881912 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:46.881880 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f8c8d8b67-sv72h_1828c53e-91b1-4e6e-ad8b-55533a87db31/manager/0.log" Jul 06 18:33:46.903424 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:46.903354 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f8c8d8b67-sv72h_1828c53e-91b1-4e6e-ad8b-55533a87db31/copy-manifests/0.log" Jul 06 18:33:48.664766 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:48.664739 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-568d56697dx666m_2e621372-e4af-48df-aaa6-f6551ca138b5/istio-proxy/0.log" Jul 06 18:33:48.776218 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:48.776192 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76c4c4d987-258bc_a4d95b91-3e89-4a11-a5ad-b1e38e587571/kube-auth-proxy/0.log" Jul 06 18:33:48.812783 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:48.812751 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5dfc694f5c-k589b_df84e41f-b630-463d-be34-180d0fd49f80/istio-proxy/0.log" Jul 06 18:33:48.838604 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:48.838580 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5dfc694f5c-k589b_df84e41f-b630-463d-be34-180d0fd49f80/istio-proxy/1.log" Jul 06 18:33:48.918376 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:48.918273 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6844c8868c-2lnp8_383db5e4-be04-4210-92ca-08b4528901d2/router/0.log" Jul 06 18:33:50.097617 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:50.097589 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-568d56697dx666m_2e621372-e4af-48df-aaa6-f6551ca138b5/istio-proxy/0.log" Jul 06 18:33:50.220489 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:50.220460 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76c4c4d987-258bc_a4d95b91-3e89-4a11-a5ad-b1e38e587571/kube-auth-proxy/0.log" Jul 06 18:33:50.258543 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:50.258510 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5dfc694f5c-k589b_df84e41f-b630-463d-be34-180d0fd49f80/istio-proxy/0.log" Jul 06 18:33:50.288566 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:50.288535 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5dfc694f5c-k589b_df84e41f-b630-463d-be34-180d0fd49f80/istio-proxy/1.log" Jul 06 18:33:50.364888 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:50.364803 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6844c8868c-2lnp8_383db5e4-be04-4210-92ca-08b4528901d2/router/0.log" Jul 06 18:33:55.101401 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:55.101374 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r7nfr_555137f2-da9f-4814-a9b9-91b82e0bf677/kube-multus-additional-cni-plugins/0.log" Jul 06 18:33:55.121092 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:55.121057 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r7nfr_555137f2-da9f-4814-a9b9-91b82e0bf677/egress-router-binary-copy/0.log" Jul 06 18:33:55.141661 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:55.141631 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r7nfr_555137f2-da9f-4814-a9b9-91b82e0bf677/cni-plugins/0.log" Jul 06 18:33:55.161158 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:55.161129 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r7nfr_555137f2-da9f-4814-a9b9-91b82e0bf677/bond-cni-plugin/0.log" Jul 06 18:33:55.183213 ip-10-0-130-37 kubenswrapper[2578]: I0706 18:33:55.183189 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r7nfr_555137f2-da9f-4814-a9b9-91b82e0bf677/routeoverride-cni/0.log"